@dengelhardt said:
AJ, this was caused by the length of the path of the folder. At least through Windows XP, the total path must be less than 254 characters to have Windows copy, move, or delete or even backup files.
That makes sense. The folder I was trying to delete had a crazy long name and it was at a root + 2 directories deep level.