I've used plaster of paris for this, use a strainer to control the amount. The stuff from hobby stores is white, sometimes the stuff from home-improvement stores can be a bit off-white. I think they use it for sheetrock 
I've also heard that tile grout works well too.