To summarize : a little bit of lag makes a HUGE difference on usability. And before you realize it people won't use your software because of the lag that you thought don't make any practical difference.
https://www.hillelwayne.com/post/performance-matters/