If this should be the condition, then you can might have to start a new IRA for gold or silver purchase. A rollover takes place when a custodian asks the administrator of ones own portfolio to transfer his or her assets directly to an alternative custodian. When buy in a fund, the investor is actually the mercy of the fund manager and lacks any control over their fees or expenses inside the fund.