I came up with "shermit" & can be applied as the female character as such.
My ex started calling me this "hermit" after we first split up several years ago. I actually found it amusing and so thus I added a spin to it and claimed it as my own...by simply adding an (s) in front of the more masculine form of the word...which is known as "hermit"
In the series Yogi Bear, we see a character Herman the Hermit, who ends up teaming up with a lonely boy to ruin Yogi, Boo Boo (Yogi Bear) and the rest of the characters, Christmas. However, at the end, they're shown the error of their ways.
In the popular anime Dragon Ball, a martial-arts master named Muten Roshi is often referred to as a Turtle Hermit, despite the fact that over the course of the series characters are often visiting or even living in his island home.
A Shermit could be substituted as a female version of all that I just previously referenced above.