I wonder if this is another case of a disconnect between physicists and color scientists.
From a color science perspective I think it's well understood that any "uniform" perceptual space is at best an approximation. There are too many interacting visual perception phenomena for it to be anything else.