Default action for Windows Explorer Pin under Taskbar is set to Libraries, which is kind of unusable. If I want to start Computer, either I have to Go to Start Menu and select Computer, or I have to go to Desktop, and launch Computer from there in Windows 7. But in Windows 8, since there is no Start Menu, I've to go to Desktop, and launch Computer from there.
With this small process, you can change your Windows Explorer Pin/Icon under Taskbar to Computer, Control Panel, Documents, C: Drive, D: Drive or whatever you want.