The surname TASKER is an old 'occupational' name for someone who did tasks. In the same way that SMITH is for Black Smith.
Essentially English, but of French origin.
Mainly the task would have been reaping the grain at harvest time, but obviously Taskers did other tasks too during the farming year.
