Yes, you should be fine, especially if your LEDs are also run from the same voltage.
The ESP32 will run down to 3V, and the LDO regulator should steal only about 125mv, so things might get iffy when your battery drops to 3.125v or so, but that is near completely discharged for a lipo.
1 Like