I wouldn't disagree with any of that. I'm merely pointing out that in regards to a paper being equal in all other aspects, the one having the optical brightenner will not have the light fastness of the one without it.
Of course, within a set of papers containing OBA, there could be significant differences in the stability of those papers. Particle size of the OBA agent, surface coatings on the paper that can absorb the UV radiation as opposed to the OBA which would tend to increase the life of the OBA. On the other hand, it is the absorbance of the UV light that allows the OBA to re-emit in the blue region and create the "brighter" look.
I do not claim to be an expert on papers by any means, but I do know pigments, dyes and additives very well. Another thing I wonder about is what type titanium dioxide is used in the paper. I know that anatase is widely used, but the rules may change for photographic papers. It would be interesting to know since rutile has much better stability in most applications. Another factor could be what extenders are used in the papers. I know pigments such as barium sulfate, calcium carbonate, and zinc sulphide are used, but I wouldn't have a clue as to which papers use more, less, or none. I also don't know to what extent coatings are used in matte papers. Another factor that could significantly affect the paper's color stability. Perhaps that kind of information is available for the different papers, I have no idea but I find it an interesting topic.