Questionable at best. Tall people have significantly lower longevity and height is positively correlated with a host of health problems, including cancer, blood clots, lung and cardiovascular disease. I would say that the unwillingness to date shorter men probably correlates with lower self confidence and greater desire to hew to social norms. Given our cultural assumptions about men and our habit of assessing our own attractiveness by the perceived attractiveness of our mate, I would say it takes more self confidence to buck those norms and assumptions than to acceed to them.

I know one couple, he is tall and striking, she is short plain and round...no doubt he could "get" a more "attractive" mate. They seem very happy and obviously unthreatened by the inevitable superficial judgements they face.