Vitamin B5 / Pantothenic acid (cheap B vitamin at GNC -- no don't get the B-complex - you want specifically B5) -- load it like 3-4 x the listed dosage (no bad sides from loading it) -- it does wonders for clearing out acne.
Also if your skin is getting oily from whatever you are cycling, showers, some astringent, don't rub, change quickly if you are sweating, etc. Tanning helps as well.