He's made it pretty clear that what he wants and what you want aren't compatible. From the distance of the internet, that you are at least under the impression that he works 80 hours a week is not actually a good sign, at least from where we sit. I believe there is cause to question the relationship I wouldn't have posted if I didn't. Either way, it's beneath you, at any age. When I was a youngster, I dated a few guys who were much older and, yeah, they all turned out to be sort of losers.
The cynical, burned by similar behavior part of me wants to say that if you do end up having sex with him which, you want to, and his recent withholding is maybe making you want it morehe will probably suddenly feel "comfortable" with no contact and pulling away from you completely.
"I'm 19, he's 32. Is it weird that we're dating?"
Haven't you a choice and a responsibility in the matter too? It really sucks to hear "I met someone else" or "I'm going to start seeing [Katie] exclusively" rather than the general "this isn't working out" breakup script. I believe she deserves to have someone at her level, with her popular cultural background, who she can have as a friend as well as a lover. It is free and quick. I wonder if this is in part what's behind the meeting in public places requirement? So you are having second thoughts about this, great!