... sleeping with a watch on for the same reason as you - I am not in control and may damage it unknowingly. The few times I have gone to sleep wearing a watch I visually check it over after awakening.
I also try to prolong the life of my leather straps and prefer not to wear them 'unnecessarily'. A metal bracelet would be a different issue.
Interesting to read Abel's comments so, as with everything, you get used to it.
Andrew