No, romantasy is going to have explicitly sexual conduct, express or implied, which is not present in YA. YA is explicitly written for under 18 year olds. New adult, NA, is the term used for ~18-22 year olds. So you should be able to filter out YA and NA romantasy and find what you’re looking for. It’s a newer publishing term so you’re going to be looking for new releases more than a large back catalogue.

Not sure if you’re looking for recommendations, but {the undertaking of hart and mercy by Megan bannen} is excellent.

You can just say you didn’t like The Fourth Wing. It’s ok, we don’t all have to like all the books. There are plenty of non-spicy dragon and fantasy books out there.