Super fast and accurate Indonesian sentiment analysis

Not all languages are the same

Grammar rules vary from one language to another. The rules of verb conjugation, noun-verb agreement and negations vary from one language to another.

Indonesian is a unique language and it differs from English in a number of ways. To use the same techniques and language models that work for English sentiment analysis when conducting Indonesian sentiment analysis would yield terribly inaccurate results.

That's why Repustate developed Indonesian-specific tools to help in Indonesian sentiment analysis, including an Indonesian part of speech tagger, an Indonesian lemmatizer, and of course, Indonesian-specific sentiment models.

Indonesian part of speech tagging

Indonesian part of speech tagging allows Repustate to narrow in on where sentiment may lie within a block of text. Verbs, nouns and adjectives, provide the cues necessary to determine sentiment.

In order to create a fast and accurate Indonesian part of speech tagger, you have to have a massive corpus of manually tagged Indonesian text. This Indonesian text can then be fed into a machine learning algorithm to create a Indonesian part of speech tagger.

The larger the corpus, and more importantly, the more varied the corpus, the better the results in creating the Indonesian part of speech tagger. Repustate has created a massive corpus of Indonesian text grabbing data from a variety of sources to ensure good coverage.

Indonesian language sentiment models

Repustate has developed sentiment language models specific to Indonesian to capture the various phrases, idioms and expressions that help define sentiment when writing in Indonesian. Understanding the various grammatical aspects of the Indonesian language that make it unique and very different from English is what allows Repustate's Indonesian sentiment analysis to be as fast and as accurate as it is.