In a modern timberframe, the major function of the infill is to close in the structure and provide insulation. Historical infill techniques like cob or wattle and daub certainly closed in the structure and to a lesser extend added to the structural integrity while performing poorly as insulation. --- but then, what would be the purpose of insulation in a structure that may have had a hole in the roof to function as a chimney?

Thus, it seems to me that the best application of your abundant supplies would be in some sort of rubble foundation rather than as an infill material.