If you installed the latest version, then I wonder if it is something to do with your path. Find out if, when it was installed, it installed to a different directory, other than where the original install was. If so, then it didn't overwrite/update it, it simply installed a second version.
Unfortunately, even on Windows I don't use Active State. I prefer Strawberry Perl as it is more like Unix based Perl and you interact with CPAN directly, instead of a third party package manager.