Sentiment analysis with knowledge resource and NLP tools

Scott Piao, Yoshimasa Tsuruoka, Sophia Ananiadou

    Research output: Contribution to journalArticlepeer-review


    Automatic sentiment analysis is an important and challenging topic in Human Language Technology (HLT) and text mining, with several applications for social sciences. Over recent years, much effort has been devoted to this subject. Many published works on this subject employ various machine learning techniques. In our work, we investigate the feasibility of automatically identifying text sentiment orientation by combining knowledge resources and NLP techniques, as a complementary method to those based on machine learning. Our approach involves resources and tools including a subjectivity lexicon (Wilson et al., 2005), a set of NLP tools and weighting algorithms. We developed a sentiment analysis tool with a web demonstrator ( opinion- analysis). This tool has been used jointly with other text mining tools to support social scientists in frame analysis from newspaper articles. In this paper, we describe our system and report on our evaluation of the functionality of identifying sentiment orientation at the sentence and document levels. We used the Multi-Perspective Question Answering (MPQA) Corpus (Wiebe et al., 2005) and a collection of 2,000 manually classified film reviews (Pang and Lee, 2004) as the test data. As evaluation measure, we used f-score, a performance measure that combines precision and recall and ranges between 0 (worst performance) and 1 (best performance). In the evaluation, our sentiment analysis tool obtained encouraging results, producing f-scores ranging from 0.6012 to 0.8333 for sentencelevel sentiment analysis and an average f-score of 0.7196 for document-level sentiment analysis. © Common Ground, Scott Piao, Yoshimasa Tsuruoka, Sophia Ananiadou, All Rights Reserved.
    Original languageEnglish
    Pages (from-to)17-28
    Number of pages11
    JournalInternational Journal of Interdisciplinary Social Sciences
    Issue number5
    Publication statusPublished - 2009


    • Frame Analysis
    • Natural Language Processing
    • Sentiment Analysis
    • Subjectivity Lexicon
    • Text Mining


    Dive into the research topics of 'Sentiment analysis with knowledge resource and NLP tools'. Together they form a unique fingerprint.

    Cite this