OK, so you have some output from the PWM pin.
If you attach it to some port other than 0, when you remove power from VCC, it should go out and stay out until the sketch gets around to that port.
It is actually brighter than I expected. It is a low duty cycle, but at 5v it is overdriving the led by quite a bit.
Now the mystery still remains: Why no servo movement?