A reply to a person who has used the word "we". The person making the reply is telling the speaker no one is effected by their statement other than them. Or, in an organization (work or volunteer positions), someone has just said that "we" all need to do something. This reply means that it's agreed the work needs to be done, but the speaker is the only one who must do it.
Employee to Boss: "Have you considered my program initiative? I think it's important, we really need it implemented to make my fall task easier."
Boss: "You got a mouse in your pocket?"