Should I keep my PIN number written down in my purse/wallet, just in case I'm at an ATM and can't remember it?

No. Never keep your PIN in the same vicinity as your card.  This makes it too easy for a criminal to use your card if they have it.  Even if you think it is disguised well as a phone number or address, a clever thief knows what to try.