I thought I had done this before.

It worked this time. I did 2 things:
1. Went to Start > Set Program Access and Dfaults > Custom and made Quicktime the default media player. Just to make sure, set Windows Media Player as not enabled.
2. I made sure that files ending in mp3 would be handled by Quickime.
The first item was probably enough.
Thanks,
Daniel