Part of the problem is the amount of loons who insist on sending their crazy to scientists. The maths department I studied in used to get a fair amount of crazies sending their newest wonderful discovery to them, and they're a small school with no-one famous - I assume famous scientists get lots of crap sent to them. Cranks are apparently annoying when they insist on bothering you with their stuff.