A wanker is always used as someone who is ineffectual or useless. It does not substitute for asshole
etc. It´s roots are in the assumtion that someone who is so useless he cannot find another human being to have sexual relations with has to have sex with himself.
Hence the term meaning to be one who masturbates frequently.