You nailed Tim...

I don't recommend SB but that doesn't mean I don't like it or would build one for/with the right project and people...

There are just key elments that must be addressed...

NO OPC CONCRETES!! in contact with the straw at all...

EXCELLENT physical pest control measures...

Breathable natural plasters, and/or good ventilation around the bales...

At least 600mm of of the ground in all areas including arid regions...

At least a 800mm roof overhang...

Get those done and it can work, though typically other insulation forms will be less expensive and easier to facilitate (but not always...)