In my case, the mod had defaulted to use my integrated GPU which made everything slow. Actually, vanilla did that too, but I updated it months ago and it has been consistent. Mod needed to set it again though. That helped a lot, though it is still not as responsive as official servers.