Another not-so-technical user here, also have both and actively using both in similar shoots (i.e. architecture for me). Happy to say that in real world usage, there's no difference in image quality for me.
I choose one over the other solely based on the fact whether I need movements or not, or which system I'm bringing to a shoot. The 32 on a tech cam will require LCC on the 100MP back and you'll have to dial in the lens corrections yourself given the actual movement. The 35mm on XF will send all info to Capture One and the lens corrections will be applied automatically, very convenient. So actually for work related shoots, whenever I can get away without using movements, I'll use the XF and 35mm.
But do note that the 35mm has a 105mm filter thread, which limits your choice of filter systems, however, if like me you are using the centre filter on the 32mm permanently, then 105mm is something you'll have to love with.
Welcome to comment if you need any specifics clarified....