I am sure Dr Rand would adjust if his estrogen crashed. Dr Rand sees thousands of TRT guys so just can't imagine he is guessing at this.
On the other hand lots of guys with personal experience saying it's not good.
For what it's worth about 10 years ago I developed gyno due to low test levels...