Yahoo! is a website that provides free e-mail, and also has a search engine and chat rooms, along with an instant messenger service. It is correctly spelled with the exclamation point.
I find it humorous when people say that Yahoo!'s search engine is worse than Google's, because Yahoo! uses Google's search engine to get results. Thus, no matter which one you use, you'lll always come up with the same results.