My colleague Edwin pointed me out to this tool to remove the junk Vista’s SP1 leaves behind.
The Windows Vista Service Pack 1 (SP1) Files Removal Tool (VSP1CLN.exe) can be used to remove the files that are archived after Windows Vista SP1 is applied. Running this tool is optional.
Installing Windows Vista SP1 increases the amount of disk space that is used by the operating system. This space is used to archive files so that SP1 can be uninstalled. Typically, you should run VSP1CLN.exe if you want to reclaim this disk space after applying SP1 and if you will not need to uninstall SP1.