Obviously a shortened version of "you're crazy." Meaning: 1. Why that is just silly. 2. That's another stupid idea from you. 3. Hello, I'm with crazy over here. 4. You just plain crazy.
Lindsey insisted that Scott were the velvetjumper, to which he replied, "you crazy."