FOUND: Fantasy/Metaphor for Coming of Age book

I am trying to remember an audiobook I listened to (not sure if I was able to finish). Listened around 2004, so book would not be after that year. It is Fantasy/Metaphor for Coming of Age book that takes place in the modern world -- where the main character is a Young Man (sorry - no name recalled here) lives with his mother and is sexually frustrated, but finds his way into a magical kingdom. After a few hours there he struggles to find his way back out and back to the real world. Later, while searching for the way back in he meets a young woman who has also apparently entered this world.

Key idea: The Young Man can find his way in, but is easily lost while trying to find the way out. The Young woman cannot find her way back in, but can easily find the way out. Anyway ... can not remember enough of the rest of the book to write plainly here, but I am pretty sure the two of them have to go face a monster together.

The book is kind of an analogy of sexual awakening, growing up, the needs that men and women have for eachother. Not really a young adult (YA) book so much as an older teen or adult book.

ANSWERED/FOUND: The Beginning Place, by Ursula K. Le Guin
I think this may be The Beginning Place, by Ursula K. Le Guin. (It's not one of her more famous works, but I've always had a soft spot for it.)