I'd like to point out, as a former clan player in Quake, that flick turns require that the other entities are already networked
And that's in a lan environment....
Online, people can turn around 180 degrees in 200ms and still be behind their ping, if their ping is that high.
So as a rule, do not apply FOV culling on the server.