This term came from the woman, Yoko Ono. Who is blamed for the breakup of The Beatles. She dated John Lennon. Yoko is said to have fought often with the other band members and did not keep her distance during recording sessions. She was the factor for The Beatles breakup.
Another Person: "Yeah, that episode was called 'The Yoko Factor'"