doi: 10.4304/jsw.6.1.116-123
Application of Linear Classifier on Chinese Spam Filtering
- Beijing Language and Culture University, Beijing, China
Abstract
Spam is a key problem in electroniccommunication. Especially in large-scale email systems.Content-based filtering is one mainstream method ofcombating this threat in its forms, an e-mail filtering systemcan learn directly from a user’s mail set, but the previousContent-based filtering methods are hard to find a balancebetween efficiency and effectiveness. Such algorithms of textcategorization as Naïve Bayes, kNN, Decision Tree andBoosting can be applied in spam filtering. However, theeffectiveness of Naïve Bayes is limited and it is not fit forinstant feedback learning. Others algorithm such as SVMare more effective but complicated to compute. Because in areal email system a large volume of emails often need to behandled in a short time, efficiency will often be as importantas effectiveness when implementing an anti-spam filteringmethod. So we intend to find a linear classifier to solve thisproblem, two online linear classifiers: the Perception andWinnow were explored for this task, which are two fastlinear classifiers. The training of these two methods is onlineand mistake driven. Furthermore, they are suitable forfeedback. We employ the two methods in three benchmarkcorpora, including PU1, Ling spam and 2005-Jun, theexperiments in public e-mail corpus show an effective result.We conclude that the two online linear classifiers have astate-of-the-art performance for filtering spam, especiallyfor Chinese spam emails.
Keywords
- anti-spam
- information filtering
- Winnow
How to Cite
Yongqin Qiu, Yan Xu, and Dan Li, "Application of Linear Classifier on Chinese Spam Filtering," Journal of Software, vol. 6, no. 1, pp. 116-123, 2011. https://doi.org/ 10.4304/jsw.6.1.116-123
Copyright & License
Copyright © 2011 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
