yes both the 45mm and 55mm really can't be focused manually. I was not aware of the XF having an AF and MF switch, Where is that found on the small LCD on the top of the camera? But if you are turning that off, and still feel the motor resisting you when you turn the ring, it must not be having any effect, which surprises me.
From what I can tell the only lenses that will focus manually are the ones with the AF/MF clutch on the lens.
Paul C