Using the latest release, I now got it up and running. (Opposed to the crash I got with the previous version)
See a small review I did with screenshots and the download location in this article.
So this is the point where we can really start saying goodbye to Visual Source Safe :-) and migrate all sources we need to maintain in Visual Studio 2003 to Team Foundation Server.