Diddler is a newer term coined from P. Diddy, as he had a sexual assault case involving a minor. If you're called a diddler, you're more than likely being compared to P. Diddy, and your current actions are probably illegal or taboo
"I heard Jason got in trouble for sexting a minor..."
"I didn't know he was a diddler!"