Skip Navigation

IEICE Transactions on Information and Systems 2008 E91-D(4):1032-1041; doi:10.1093/ietisy/e91-d.4.1032
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Request Permissions
Google Scholar
Right arrow Articles by WANG, G.
Right arrow Articles by ARAKI, K.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

Copyright © 2008 The Institute of Electronics, Information and Communication Engineers

Regular Section -- Papers -- Data Mining

An Unsupervised Opinion Mining Approach for Japanese Weblog Reputation Information Using an Improved SO-PMI Algorithm

Guangwei WANG1 and Kenji ARAKI1

1 The authors are with the Graduate School of Information Science and Technology, Hokkaido University, Sapporo-shi, 060–0814 Japan. E-mail: wgw{at}media.eng.hokudai.ac.jp

In this paper, we propose an improved SO-PMI (Semantic Orientation Using Pointwise Mutual Information) algorithm, for use in Japanese Weblog Opinion Mining. SO-PMI is an unsupervised approach proposed by Turney that has been shown to work well for English. When this algorithm was translated into Japanese naively, most phrases, whether positive or negative in meaning, received a negative SO. For dealing with this slanting phenomenon, we propose three improvements: to expand the reference words to sets of words, to introduce a balancing factor and to detect neutral expressions. In our experiments, the proposed improvements obtained a well-balanced result: both positive and negative accuracy exceeded 62%, when evaluated on 1,200 opinion sentences sampled from three different domains (reviews of Electronic Products, Cars and Travels from Kakaku.com). In a comparative experiment on the same corpus, a supervised approach (SA-Demo) achieved a very similar accuracy to our method. This shows that our proposed approach effectively adapted SO-PMI for Japanese, and it also shows the generality of SO-PMI.

Key Words: SO-PMI, opinion mining, Weblog reputation information, sentiment analysis, unsupervised learning, supervised learning


Manuscript received May 24, 2007. Manuscript revised November 30, 2007.

Reference

[1] M. Gamon, A. Aue, S. Corston-Oliver, and E. Ringger, "Pulse: Mining customer opinions from free text," Proc. 6th International Symposiumon Intelligent Data Analysis, pp.121–132, Madrid, Spain, Sept. 2005.

[2] A. Popescu and O. Etzioni, "Extracting product features and opinions from reviews," Proc. HLT/EMNLP 2005, pp.339–346, Vancouver, B.C., Canada, Oct. 2005.

[3] P. Chaovalit and L. Zhou, "Movie review mining: A comparison between supervised and unsupervised classification approaches," Proc. 38th Annual Hawaii International Conf. on System Sciences, p.112c, Hawaii, Jan. 2005.

[4] H. Yu and V. Hatzivassiloglou, "Towards answering opinion questions: Separating facts from opinions and identifying the polarity of opinion sentences," Proc. EMNLP, pp.129–136, Sapporo, Japan, July 2003.

[5] B. Pang, L. Lee, and S. Vaithyanathan, "Thumbs up? Sentiment Classification Using Machine Learning Techniques," Proc. EMNLP, pp.79–86, Philadelphia, PA, USA, July 2002.

[6] B. Pang and L. Lee, "A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts," Proc. 42th Annual Meeting of the ACL, pp.271–278, Barcelona, Spain, July 2004.

[7] K. Dave, S. Lawrence, and D.M. Pennock, "Mining the peanut gallery: Opinion extraction and semantic classification of product reviews," Proc. 12th International World Wide Web Conf., pp.519–528, Hungary, May 2003.

[8] A. Yasuda, "Reviewing text mining: Textual data mining," Proc. IEEJ Trans. on EIS, vol.125, no.5, pp.682–689, 2005.

[9] P.D. Turney, "Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews," Proc. 40th Annual Meeting of the ACL, pp.417–424, Philadelphia, PA, USA, July 2002.

[10] Computational Linguistics Laboratory, Graduate School of Information Science, Nara Institute of Science and Technology, "CaboCha: A dependency structure analyzer," http://www.chasen.org/~taku/software/cabocha/

[11] G. Wang and K. Araki, "A decision support system using text mining technology," Proc. IEICE SIG Notes WI2-2006-6, pp.55–56, 2006.

[12] G. Wang and K. Araki, "Modifying SO-PMI for Japanese Weblog opinion mining by using a balancing factor and detecting neutral expressions," Proc. NAACL HLT 2007, pp.189–192, Rochester, NY, USA, April 2007.

[13] N. Kobayashi, K. Inui, Y. Matsumoto, K. Tateishi, and T. Fukushima, "Collecting evaluative expressions for opinion extraction," Proc. NLP. vol.12, no.2, pp.203–222, July 2005, http://www.syncha.org/evaluative_expressions.html

[14] T. Kudoh and Y. Matsumoto, "Applying cascaded chunking to Japanese dependency structure analysis," Proc. IPSJ, vol.43, no.6, pp.1834–1842, 2002.

[15] H. Takamura, T. Inui, and M. Okumura, "Latent variable models for semantic orientations of phrases," Proc. IPSJ, vol.47, no.11, pp.3021–3031, 2006, http://www.cisr.iri.titech.ac.jp/~inui/cgi-bin/sa-demo/sa.cgi

[16] G. Wang and K. Araki, "OMS-J: An opinion mining system for Japanese Weblog reviews using a combination of supervised and unsupervised approaches," Proc. NAACL HLT 2007 Demonstration Program, pp.19–20, Rochester, NY, USA, April 2007.

[17] P.D. Turney and M.L. Littman, "Measuring praise and criticism: Inference of semantic orientation from association," ACM Trans. Information Systems, vol.21, no.4, pp.315–346, Oct. 2003.

[18] M. Taboada and J. Grieve, "Analyzing appraisal automatically," Proc. AAAI Spring Symposium on Exploring Attitude and Affect in Text, pp.158–161, California, USA, March 2004.

[19] M. Gamon, "Sentiment classification on customer feedback data: Noisy data, large feature vectors, and the role of linguistic analysis," Proc. 20th International Conf. on Computational Linguistics, pp.611–617, Switzerland, Aug. 2004.

[20] B. Liu, M. Hu, and J. Cheng, "Opinion observer: Analyzing and comparing opinions on the Web," Proc. 14th International World Wide Web Conf., pp.342–351, Chiba, Japan, May 2005.

[21] T. Wilson, J. Wiebe, and P. Hoffmann, "Recognizing contextual polarity in phrase-level sentiment analysis," Proc. HLT/EMNLP 2005, pp.347–354, Vancouver, B.C., Canada, Oct. 2005.

[22] Y. Suzuki, T. Takamura, and M. Okumura, "Evaluation expression extraction for Weblog," Proc. SIG-SW-ONT-A401-02, 2004.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?



This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrow Request Permissions
Google Scholar
Right arrow Articles by WANG, G.
Right arrow Articles by ARAKI, K.
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?