The biggest complaint I've seen for using organics is in fact allergens/chemical reactions. If it's no bother to you awesome, but I can see it being  show stopper for some.

The other consideration (probably not much of an issue with dirt) is organic materials in Dios can continue changing over time.

I do hate buying fake dirt, as expensive as it is, but my sinuses also regularly try to strangle me. lol.