Access to path denied error while debugging VS 2012 WPF

I'm working on the "Building a Simple WPF Application WalkThrough" on MSDN and am getting an UnauthorizedAccessException error when trying to read the contents of certain folders, such as "My Music". This only happens when I am debugging. If I start the program without debugging, then the application works fine.

Are there some options that I need to set in VS 2012 to make this work while debugging?

Thanks.