Samsung's UHD Color is merely a "switch" that automatically triggers when 10 bit or higher signals are detected. It has nothing to do with color "enhancement or whatever. So, say you robbed a bank and bought the latest and greatest 4k HDR BluRay. Instead of having to manually set the TV for HDR material (on the same input), It does it automatically. That's all it is. HDR is the color monster.
So it really doesn't matter if I leave it on or off? Shouldn't matter either way?