On the other hand, the most likely replacement will be Juncker, and Juncker would be a whole lot better.
The best thing you can do to get rid of Barroso and assure that someone better (other than Juncker) takes his place is to make sure the EPP loses big in the next European Parliament elections.