The only answer I can give is when it's safe. :D Test your water, there should be 0 ammonia, 0 nitrite, and as close to 0 as you can get with nitrate (for corals at least, fish have *some* tolerance to nitrate).
Of course you should have a rise in all of these (a spike in the nitrogen...