Ball size will return when your testes are stimulated to produce testosterone. You can do this instantly with HCG or wait for full recovery (testosterone production is the final step in the chain reaction).
Even with nolvadex or clomid this can take 6 or 7 weeks after the esters have cleared your system.