First, as a beach bum, Caribbean hoppin', Hawaiian shirt afficianado, not all are created equal, nor are all ugly.
Secondly, there are tons of lightweight patterned shirts out there. Find some you like and go with them.
I just flipped through a new LL Bean catalog and found quite a few, including some from their "tropic weight" line.