I basically don't notice that I don't have a headphone jack. My usb-c adapter is just permanently affixed to my wired IEMs and it basically makes no difference to me if the plug is round or usb-c shaped.
I definitely recommend biting the bullet and getting a good adapter. Since I have a pixel I use the Google one. I made sure my partner got an official apple one for their iPhone since I remember seeing rumors about a volume difference between them if mixed and matched. Aside from Apple shenanigans I haven't really had an issue with them. I also only charge at night so I never have the problem of needing to charge and listen at the same time.