This phrase has absolutely _no_ racial dimension, despite appearances. It is a Northern British (e.g. Yorkshire) term referring to a silly person. It does not derive from nigger and should not be considered racist at all.
Someone who really gets on your nerves. A person who is ignorant, typically from da souf. Also, someone who you would find up a banana tree doing things you are unfamiliar with.