Just don't try to fix your Silver game before it's battery dies. If you remove the old one, you will erase your save file and lose your completed Pokedex.

The only way I can think of to replace the battery without losing the game save would be to solder a 3 volt power source to the circuit card before removing the battery.