This is so we don't block responding to federation transaction while we try and fetch the device lists.
Erik Johnston