If you are using Internet Explorer you could try an alternative like Firefox or Opera and see if the problem persists.If you try and uninstall IE it will probably just 'roll back' to IE 6 (assuming you're using IE 7 now) and may not make any difference to your problem.
Any browser you install will want you to make it your default browser, but you don't have to make that choice until you have tried the alternatives (although you may have to go through the installation options in any new browser to make sure that default status is not pre-selected).
If you were to try Opera you would see a screen the first time you opened it asking if you wanted it to be your default browser, I can't remember if the same thing happened when I installed Firefox but it is likely. You can refuse that 'offer' until you have decided whether you want to keep either alternative browser.
I use Opera as my default browser and have Firefox as well, but I don't use IE at all so I don't know where you would look for the 'default' status option. In Firefox, the option is under' Tools/Options/Main/System Defaults' while in Opera it's under 'Tools/Preferences/Advanced/Programs'.
Assuming that you are using IE, you can get the alternatives here (or at least read about them) ;
http://www.filehippo.com/ (don't use the Opera Beta version, the latest stable version is 9.24). You could also check them out at Wikipedia and at the Secunia Vulnerabilities site, Opera ;
http://secunia.com/product/10615/ Firefox;
http://secunia.com/product/12434/ and, for contrast, IE 7;
http://secunia.com/product/12366/
I don't think any of the vulnerabilities are rated 'Critical' and it has to be borne in mind that many of the 'exploits' that are discovered are only theoretical. Nevertheless, I decided not to use browser software which, until fairly recently, appeared to need an Important or Critical patch nearly every month!