If said straightfaced and/or casually, the effect can be greater than that of other, milder insults. However, its use and effectiveness depend heavily upon timing.
Conversely, "I fail at life" can be used to acknowlege one's own failiure.
Person B: "Wow. You fail at life."