I doubt the ruler had much to do with the actual building and treatment of the workers. He probably just visited once in awhile, and spent most of his time in his palace with his friends. It is very hot and dusty in that country, so the rich tend to stay indoors.