Everyone experiences slumps of things they enjoy. Don’t worry about forcing yourself to rush back into reading if you’re not feeling it. You’ll get back into it on your own time, and that’s ok.
As for people judging you, it’s a smart move to distance yourself from judgmental people. As you get older, you’ll get better at ignoring it and not caring what others think. As presidential advisor Bernard Baruch once said, “Those who matter don’t mind, and those who mind don’t matter.”
I’m still hung up on the idea of not wanting to read it if you’re not part of the target audience. If it’s a book you enjoy, who cares if it’s directed at the YA crowd or not?