That's a lovely thing you've done, to make @lizziesworld 100% beneficiary!
For aphids I have had success using clove essential oil, 15ml in a 2 1/2 gallon sprayer. It does not harm the foliage, but I'm pretty sure it would kill the ladybugs too - it kills stuff that are very hard to get rid of except for some beetles. Clove is one of the least expensive of the oils, and much cheaper than chemicals from the gardening store.
Good luck!