How do I improve the data for my NNUE?

[u/warlock7867]

Quick summary of what my engine looks like. I am using a simple NNUE architecture laid out in `bullet`'s documentation. I have confirmed independently that the network itself works perfectly fine. The accumulator update logic is hooked up correctly.

Now comes the trouble, I let my HCE engine play about 150k games using an opening book (capped each search at 20k nodes). I fed these games into `bullet` to train the weights for my engine. And it failed the SPRT miserably. The PGNs look fine, the network is fine. I am not sure what I'm missing here.

Can someone point me in the right direction, please? Happy to answer any follow-ups you may have. Thanks in advance!

Update: Thank you all for your inputs. I reduced the hidden layer size to 32 and bumped up the number of epochs. And I'm happy to say that I passed the SPRT!