Are you trying to remove AVG through Control Panel/Add-remove programs.
It's possible that AVG is still running on your computer and so can't be removed. Use Ctrl-ALT-Del to start Task Manager and see if AVG is actually running. If so stop it and try removing it again. Also if I remember correctly you will need to restart your computer in order for it to delete some of the files.