Sentiment Analysis and Opinion Mining
Sentiment Analysis and Opinion Mining
April 22, 2012
Bing Liu
liub@cs.uic.edu
Draft: Due to copyediting, the published version is slightly different
Bing Liu. Sentiment Analysis and Opinion Mining, Morgan & Claypool Publishers, May 2012.
Sentiment Analysis and Opinion Mining
Table of Contents
Preface ..............................................................................................5 Sentiment Analysis: A Fascinating Problem ...................................7 1.1 Sentiment Analysis Applications ..........................................8 1.2 Sentiment Analysis Research ..............................................10
1.2.1 Different Levels of Analysis......................................................... 10 1.2.2 Sentiment Lexicon and Its Issues ................................................. 12 1.2.3 Natural Language Processing Issues............................................. 13
1.3 Opinion Spam Detection .....................................................14 1.4 What's Ahead ......................................................................14 The Problem of Sentiment Analysis ..............................................16 2.1 Problem Definitions ............................................................17
2.1.1 Opinion Defintion......................................................................... 17 2.1.2 Sentiment Analysis Tasks............................................................. 21
2.2 Opinion Summarization ......................................................24 2.3 Different Types of Opinions................................................25
2.3.1 Regular and Comparative Opinions.............................................. 25 2.3.2 Explicit and Implicit Opinions...................................................... 26
2.4 Subjectivity and Emotion ....................................................27 2.5 Author and Reader Standing Point ......................................29 2.6 Summary .............................................................................29 Document Sentiment Classification...............................................30 3.1 Sentiment Classification Using Supervised Learning .........31 3.2 Sentiment Classification Using Unsupervised Learning .....34 3.3 Sentiment Rating Prediction................................................36 3.4 Cross-Domain Sentiment Classification .............................38 3.5 Cross-Language Sentiment Classification...........................41 3.6 Summary .............................................................................43 Sentence Subjectivity and Sentiment Classification......................44
2
Sentiment Analysis and Opinion Mining
4.1 Subectivity Classification....................................................45 4.2 Sentence Sentiment Classification ......................................49 4.3 Dealing with Conditional Sentences ...................................51 4.4 Dealing with Sarcastic Sentences........................................52 4.5 Cross-language Subjectivity and Sentiment Classification.53 4.6 Using Discourse Information for Sentiment Classification 55 4.7 Summary .............................................................................56 Aspect-based Sentiment Analysis..................................................58 5.1 Aspect Sentiment Classification..........................................59 5.2 Basic Rules of Opinions and Compositional Semantics .....62 5.3 Aspect Extraction ................................................................67
5.3.1 Finding Frequent Nouns and Noun Phrases.................................. 68 5.3.2 Using Opinion and Target Relations ............................................ 71 5.3.3 Using Supervised Learning........................................................... 71 5.3.4 Using Topic Models ..................................................................... 73 5.3.5 Mapping Implicit Aspects ............................................................ 77
5.4 Identifying Resource Usage Aspect ....................................78 5.5 Simutaneous Opinion Lexicon Expansion and Aspect
Extraction ............................................................................79 5.6 Grouping Aspects into Categories.......................................81 5.7 Entity, Opinion Holder and Time Extraction ......................84 5.8 Coreference Resolution and Word Sense Disambiguation .86 5.9 Summary .............................................................................88 Sentiment Lexicon Generation ......................................................90 6.1 Dictionary-based Approach.................................................91 6.2 Corpus-based Approach ......................................................95 6.3 Desirable and Undesirable Facts .........................................99 6.4 Summary ...........................................................................100 Opinion Summarization ...............................................................102 7.1 Aspect-based Opinion Summarization ..............................102 7.2 Improvements to Aspect-based Opinion Summarization..105 7.3 Contrastive View Summarization .....................................107 7.4 Traditional Summarization................................................108 7.5 Summary ...........................................................................108
3
Sentiment Analysis and Opinion Mining
Analysis of Comparative Opinions ..............................................110 8.1 Problem Definitions ..........................................................110 8.2 Identify Comparative Sentences........................................113 8.3 Identifying Preferred Entities ............................................115 8.4 Summary ...........................................................................117 Opinion Search and Retrieval ......................................................118 9.1 Web Search vs. Opinion Search ........................................118 9.2 Existing Opinion Retrieval Techniques ............................119 9.3 Summary ...........................................................................122 Opinion Spam Detection..............................................................123 10.1 Types of Spam and Spamming..........................................124
10.1.1 Harmful Fake Reviews ............................................................... 125 10.1.2 Individual and Group Spamming................................................ 125 10.1.3 Types of Data, Features and Detection ....................................... 126
10.2 Supervised Spam Detection...............................................127 10.3 Unsupervised Spam Detection ..........................................130
10.3.1 Spam Detection based on Atypical Behaviors............................ 130 10.3.2 Spam Detection Using Review Graph ........................................ 133
10.4 Group Spam Detection ......................................................134 10.5 Summary ...........................................................................135 Quality of Reviews ......................................................................136 11.1 Quality as Regression Problem .........................................136 11.2 Other Methods ...................................................................138 11.3 Summary ...........................................................................140 Concluding Remarks....................................................................141 Bibliography ................................................................................143
4
Sentiment Analysis and Opinion Mining
Preface
Opinions are central to almost all human activities and are key influencers of our behaviors. Our beliefs and perceptions of reality, and the choices we make, are, to a considerable degree, conditioned upon how others see and evaluate the world. For this reason, when we need to make a decision we often seek out the opinions of others. This is not only true for individuals but also true for organizations.
Opinions and its related concepts such as sentiments, evaluations, attitudes, and emotions are the subjects of study of sentiment analysis and opinion mining. The inception and rapid growth of the field coincide with those of the social media on the Web, e.g., reviews, forum discussions, blogs, microblogs, Twitter, and social networks, because for the first time in human history, we have a huge volume of opinionated data recorded in digital forms. Since early 2000, sentiment analysis has grown to be one of the most active research areas in natural language processing. It is also widely studied in data mining, Web mining, and text mining. In fact, it has spread from computer science to management sciences and social sciences due to its importance to business and society as a whole. In recent years, industrial activities surrounding sentiment analysis have also thrived. Numerous startups have emerged. Many large corporations have built their own inhouse capabilities. Sentiment analysis systems have found their applications in almost every business and social domain.
The goal of this book is to give an in-depth introduction to this fascinating problem and to present a comprehensive survey of all important research topics and the latest developments in the field. As evidence of that, this book covers more than 400 references from all major conferences and journals. Although the field deals with the natural language text, which is often considered the unstructured data, this book takes a structured approach in introducing the problem with the aim of bridging the unstructured and structured worlds and facilitating qualitative and quantitative analysis of opinions. This is crucial for practical applications. In this book, I first define the problem in order to provide an abstraction or structure to the problem. From the abstraction, we will naturally see its key sub-problems. The subsequent chapters discuss the existing techniques for solving these subproblems.
This book is suitable for students, researchers, and practitioners who are interested in social media analysis in general and sentiment analysis in particular. Lecturers can readily use it in class for courses on natural
5
................
................
In order to avoid copyright disputes, this page is only a partial summary.
To fulfill the demand for quickly locating and searching documents.
It is intelligent file search solution for home and business.
Related download
- social welfare policy and social programs a
- gender as a social determinant of health gender as a
- equity social and emotional learning a cultural analysis
- vader a parsimonious rule based model lab
- sentiment analysis and opinion mining
- social problem and policy analysis frameworks
- does income inequality cause health and social problems
- critical analysis of the problems of education in pakistan
Related searches
- fact and opinion words list
- fact and opinion video
- fact and opinion activities
- fact and opinion videos for kids
- fact and opinion key words
- fact and opinion quiz pdf
- fact and opinion signal words
- fact and opinion printable quiz
- fact and opinion worksheets
- fact and opinion exercises
- fact and opinion worksheets pdf
- fact and opinion worksheets answers