Thats a big generalisation, really it's all relative.
I started with a mini compressor and twin AB package from ebay, under £100 delivered, ($200ish).
Tankless compressor, (tank is better speaking as someone with a garage compressor and automotive spray tools)
2 brushes, one a gravity feed, used constantly and one a syphone feed, barely touched the syphone, a PITA to clean the jars.
The gravity is your typical cheap chinese Iwata clone, BUT, it has teflon seals, and works incredibly well, I use this one for detail work and lacquer work exclusivley at the moment because it retains it's 0.3mm needle nozzle set, I have a spraymaster with interchangeable cups, also very good for a cheap brush, this is set with the 0.5 needle and is my general use brush now.
The cheap one i used solidly and regularly for a year and use quite regularly now with lacquer, acrylic and enamel, it cleans easily and sprays spot on everytime I take it out the case.
The compressor has now been on the go for about 2 years, i've had some very prolonged sessions and aside from moisture build up in the lines after a long long session spraying have had no problems whatsoever, i now use an additional water trap under the airbrush, problem solved.
I've just now ordered my first Iwata and will be comparing it as soon as I get it but to be frank, if someone had said to me, no, the cheap opes are no good, get an Iwata / Badger / H&S etc and a decent brand compressor at over £100, it wouldn't have happened, plain and simple, I'd still be stuck with brush and my ancient badger single action and air propellant can.
I think oftentimes it helps to start cheap as then when you're able to upgrade you won't begrudge the cost layout knowing the brush should be much better.
Incidentally, once I get my Iwata, I may possibly be selling the Spraymaster but i'll certainly be keeping hold of my cheap chinese gravity AB and i'll still use it.