By default rating and color tagging is applied to all selected images, or variants in Capture One talk.
If you only like to rate/tag the primary variant, either deselect the other images, or keep them selected but toggle off the switch "Edit All Selected Variants" in the Edit menu.