School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China.

---

Abstract—With the appearance of big data’s era, some problems caused in recommendation systems are needed to solve immediately. So it is very useful to design parallel recommendation algorithms. An improved parallel item-based collaborative filtering (IP_Item-basedCF) algorithm based on Hadoop is proposed in this paper. In order to consider the influence of user’s activity, a new parameter called IUF is introduced that can give the active users soft punishment. And the user’s rating is also considered in prediction model. Finally, we evaluate the performance of our approach by using two real datasets – MovieLens and Douban. The experimental results show that this new parallel algorithm outperforms the algorithms existed and has a good scalability and speedup.

Index Terms—Collaborative filtering, Hadoop, co-occurrence matrix, parallel algorithm.

[PDF]

Cite: Qun Liu, Xiaobing Li, "A New Parallel Item-Based Collaborative Filtering Algorithm Based on Hadoop," Journal of Software vol. 10, no. 4, pp. 416-426, 2015.