How does federation actually work?

...and why is it often PAINFULLY slow to acknowledge an up/down vote or to open the reply dialog?