I've queried our firmware team about this and the response was: The IDF had a bug there at the beginning, so we disabled it He is welcome to enable it and submit a pull request

This was due to a change in the ESP32 IDF a couple of month ago. I've seen the brownout also in some C projects on the WROOM32. Make sure you can compensate when the MCU is spiking in power consumption by placing a big capacitor in the circuit. Google is your friend.