Well I'll be honest.
I'm really look around and find that diatomaceous earth food grade especially.
Next up use a high-powered fan spray of water. Helps to blow any critters off. Then place that right in front of the fan to speed dry.
I generally take my plants outside and let them soak up some really nice Sun. Rotate and leave the vegetation in front of a pretty stiff breeze but not anything that's going to break branches.
If you have to support the plant physically I've actually done that and with larger plants had multiple people helping.
And however you can kill those bugs.... I put a couple extra fans in there moving air around to make it difficult for flying insects.
And also some rocks as well as a little bit of sand on top. See if you can't prevent them from burrowing into the soil.
Don't feel too bad! I've had experiences with bugs that just frustrated the heck out of me...
And hey one year I had elk. Imagine your tree going from 10 ft to a foot tall overnight. And then you also got a 2000 lb horned animal passed out in the middle of your patch.... Yep elk are bad.