Tuesday, 10 July 2018

Sick! Text Mining and Words With Multiple Definitions

When you read the title of this article, you must wonder what I'm talking about when I say, "That's sick!"

It makes sense if I just witnessed a car accident so heinous that it made me feel sick to my stomach. However, it also makes sense if I just saw Sidney Crosby score the game-winning goal for the gold medal game at the 2014 Socchi Olympics. A difficulty with linguistics is that the same word can have multiple meanings.

In the English language, the word "sick" is defined by the Oxford dictionary as follows: "affected by physical or mental illness". What you won't find in the Oxford dictionary is the slang meaning for "sick", which urban dictionary defines as: "crazy; cool; insane".

Good or bad?

How can a machine decipher whether we are talking about the "good sick" or the "bad sick"? It's called sentiment analysis, but first, let's take a step back.

How can humans tell which "sick" we are talking about? Humans get help from things like: body language, the tone of the communicator's voice, eye contact, facial expression, as well as cultural symbols like clothing, hair style, and location.

Natural language processing technology like text mining can't use the aforementioned methods of communication. It's just not possible... Yet. In about 5-10 years down the road, when image recognition and emotion analytics become more advanced, then we may start to get cues from body language and voice tone.

Text mining must rely on the contextual understanding of the sentence to tell the difference between the two meanings of the same word.

Text Mining Engine

The words that surround "sick", and the order of these other words attribute to the contextual understanding of a sentence. Let's take a look at a couple of examples:

Twitter Delicious Facebook Digg Stumbleupon Favorites More

 
Design by Free WordPress Themes | Bloggerized by Lasantha - Premium Blogger Themes | Affiliate Network Reviews