Can you draw out your wiring diagram and how this is powered? It sounds like some type of voltage drop issue or power issue, not a heat issue – that board tends to run quite warm to hot to the touch and be totally “fine” when that happens usually – although it COULD a heat problem as well – @wizard answered a similar question a while back here: Pixelblaze Pico processor runs hot which may help you.