I remember so clearly, genuinely believing that it would be the end of me if I ever spoke up,’ the country icon’s ex-wife ...