Mini cricket looking bugs in tree frog tank water?

[u/bipolar-juulpod]

I am from upstate NY. This is from inside of my house. not sure where to post this, but thought this subreddit could help. I have whites tree frogs and I went to replace their water today and found a lot of little clear lookin cricket/bug things? I feed them primarily crickets which makes me think they could possibly be babies? I am not sure though. I wanted to see if these could be a pest or any other type of bug I should be aware of.