We Floridians are well acquainted with scale infestations!
I second Glen's advice to start treatment immediately with insecticide as these things will suck the life out your plants in no time. I use Bayer Advanced 3in1 with very good results. It's available everywhere, has very little odor and is quite safe. The toothbrush or alcohol swab is a temporary measure -- at best. And yes, treat all of your plants.