I was thinking a simple solution to the dirt being too constant would be a "Soap" or "Towel" item, that the player could carry and use to clean their character up.
Or to slow down the accumulation of the dirt, as it does accumulate too fast.
Or just having water fountains in inhabited places that you can use to get rid of the grime