Qualified plans allowed non-deductible contributions (i.e. the employee’s contributions had already been taxed).
IRS rules allow contributions to IRAs that may not be tax deductible.
Since these funds have already been taxed, you don’t want to pay tax on them again when you distribute them. With regard to your IRA, it’s your job to keep track of these already taxed amounts (IRS provides form 8606). If you have lost this form or failed to keep track, the folks at IRS will probably not get upset. If you cannot show the amounts on which you have already paid tax, you will pay tax on them again and you probably won’t get a notice from the IRS for this error.
Regarding your employer’s plan, most employers keep track of these amounts and report them to you when you retire. The good news here is that these are post-tax funds you can take at retirement and use as you desire, as you have already paid tax. You need not roll them to an IRA but are permitted to do so and enjoy further tax deferred potential growth.
Note that you can take out all of your after-tax contributions, tax-free, before rolling your qualified plan dollars to an IRA. The key word is “before.”
Before you complete a rollover, consider if you will need the money soon. If so, it probably won’t pay to rollover the after-tax money to an IRA. This is because once you roll over after-tax money to an IRA, you cannot withdraw it tax-free. The after-tax funds become part of the IRA and any withdrawals from the IRA are subject to the “Pro Rata Rule.”
The Pro Rata Rule requires that each distribution from an IRA contain a proportionate amount of both the taxable and the nontaxable amounts in the account. The non-taxable amounts are called “basis.” In an IRA, basis is the amount of nondeductible contributions made to the IRA.
Paula has $100,000 in an IRA, $20,000 is the basis (the total of her nondeductible contributions made over the years). She rolls over $200,000 from her former employer’s plan to the IRA, of which $10,000 is from after-tax contributions. After the rollover, she’ll have $300,000 in her IRA. The basis becomes $30,000 (the $20,000 nondeductible plus the $10,000 of after-tax funds rolled into the IRA = $30,000 basis).
Now Paula wants to withdraw $10,000 of after-tax money from the IRA, figuring it will all be tax-free. It won’t. Only $1,000 of the withdrawal will be tax-free. She’ll pay tax on the other $9,000. The Pro Rata Rule requires that each withdrawal contain a proportionate amount of both taxable and nontaxable funds. Therefore, the nontaxable amount in the IRA is $30,000 and that is 10% of the total $300,000 IRA balance after the rollover. This means that each withdrawal will be 10% tax-free and 90% taxable.
Another option is to convert Paula’s entire $300,000 IRA to a Roth IRA (assuming she otherwise qualifies for the conversion). Then all withdrawals will be tax-free. She’ll pay tax on $270,000; the $30,000 of basis will transfer tax-free to the Roth IRA. A partial conversion would require the use of the Pro Rata Rule.