If Xia Longyuan were suffering from Mountain and River Qi rebound, then at this moment the various Family Heads were likewise suffering from their own Sword Spirits' rebound, and the intensity of such rebound was not lesser than Xia Longyuan's.
Previously, because their intents clashed and could not synchronize, the Sword Spirits ignored them, which was fine. After all, they hadn't gone too far, and the Sword Spirits themselves were weakened and, apart from being uncooperative, did not do much else.