You are correct, it is tax free on any investment which was made within your $5000/year allotment. It is tax free, and of course goes the same if there was a loss, it cannot be claimed. You can take the money out as you wish, however, you can only put back in the equivalent of $5000/year back in.