Yeah, using the retarder is probably the exception to the rule.

I certainly wouldn't take Tamiya Black, and add Vallejo White to it to lighten it up, or visa versa, but using the retarder would be ok, as it wouldn't be the same as using an actual paint.