Stupid Filter

It works you know. Tried it out, as recommended here.

However, a couple of unknown geniuses have come up with a shield for tender minds. They are building Stupidfilter, an application of spam-fighting algorithms to the problem of stupidity. The heart of modern spam technology is Bayesian filtering. This uses statistical analysis to pick out spam by its resemblance to other known spam and its dissimilarity to real mail. All you need is a sufficiently large corpus of email to start with, and a human to sort through it the first time. Once a Bayesian filter has been trained, it will go on learning all by itself, requiring only the occasional adjustment by a human operator.

I\’ve added it to my browser now.

The solution we\’re creating is simple: an open-source filter software that can detect rampant stupidity in written English. This will be accomplished with weighted Bayesian analysis and some rules-based processing, similar to spam detection engines. The primary challenge inherent in our task is that stupidity is not a binary distinction, but rather a matter of degree. To this end, we\’re collecting a ranked corpus of stupid text, gleaned from user comments on public websites and ranked on a five-point scale.

It works too. I can no longer access The Guardian.

3 comments on “Stupid Filter

  1. I think what the economically disadvantaged need is a radical shake up of the schools system and much more investment in education and skills to make Britain a fairer and more dynamic society.

Leave a Reply

Name and email are required. Your email address will not be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.