That is a fair point- dwarves seem to be associated with mountains because there's a lot of stone there for them to work, I think. Perhaps there are farming communities in the valleys, which then feed into stone-based cities in the cave-systems of the mountains.