I think I've found the problem.
Like most nowadays mods, Silent doesn't execute the autoexec.cfg on start, which is setting my FOV.
So I had the same mousespeed (sensitivity, pitch, yaw), the same distance to move the mouse for a 360° turn but a different distance to move to mouse to an object X pixels away on the screen.