I do think he was justified. However, at the end of the conversation, they switch to a wider shot right after he says “only after you give up everything can you begin to find a way to be happy.” I feel like they did that to emphasize that he’s not like Tyler Durden living in some dilapidated house with a bunch of other dudes, talking about giving up everything; he’s at his second house in Ojai. Again, I do think he was justified, but it’s just something interesting I noticed yesterday while watching this episode that I hadn’t picked up on during previous watches