rammed earth survives in climatic extremes.
A large portion of the great wall of China is primarily rammed earth with whatever brush was available not unlike modern use of rebar in concrete. Yes, the wall is thousands of years old and exposed to extreme weather and altitude.
Yes, in most cases it has a hand laid stone or brick facade. a similar structure for housing would hold up the weighty timber frame roof truss system with ease.