In this article, we will examine the problem of Information extraction (IE), an advanced branch of research that focuses on extracting semantic information from texts. From here, we will have many applications for many domains such as Web mining (extracting famous names, hot products, comparing product prices, researching competitors, analyzing customer psychology), Biomedical , Business intelligent, Financial professional (market assessment from different sources: rising and falling petrol prices, war information, politics between countries, new laws in the business market), Terrism event (use of weapons) what gas, who is the target of the attack).
Viewing: What is natural language processing
After lexical and syntactic preprocessing steps such as sentence separation, word separation, parsing, and word classification. From IE we will simplify into subproblems including: Named entity recognition (NER: people, organization, location), Coreference resolution and Relation between two entities. possible (Relation extraction – RE: founderOf, headQuartedIn). The experimental models will be evaluated through the Precision, Recall, F1-score indexes. Here is an example of extracting relationships in a sentence.
Continue reading “Information extraction – The problem of extracting information from the text” →
” data-medium-file=”https://ongxuanhong.files.wordpress.com/2015/09/tagging-problem.jpg?w=300″ data-large-file=”https://ongxuanhong.files.wordpress .com/2015/09/tagging-problem.jpg?w=1024″ class=”size-full wp-image-3296″ src=”https://ongxuanhong.files.wordpress.com/2015/09/tagging- problem.jpg?w=1100″ alt=”Tagging problem” srcset=”https://ongxuanhong.files.wordpress.com/2015/09/tagging-problem.jpg?w=1100 1100w, https://ongxuanhong. files.wordpress.com/2015/09/tagging-problem.jpg?w=150 150w, https://ongxuanhong.files.wordpress.com/2015/09/tagging-problem.jpg?w=300 300w, https: //ongxuanhong.files.wordpress.com/2015/09/tagging-problem.jpg?w=768 768w, https://ongxuanhong.files.wordpress.com/2015/09/tagging-problem.jpg?w=1024 1024w, https://ongxuanhong.files.wordpress.com/2015/09/tagging-problem.jpg 1200w” sizes=”(max-width: 1100px) 100vw, 1100px” />Tagging problemIn many tasks of Language Processing natural language (XLNNTN), we want to build a model where the sequence of input observations (from, phrases, sentences, …) accompanied by a sequence of output labels (from type, term boundary, entity name, …) called pairs of sequences.
Part-of-speech tagging (POS) is probably the earliest problem studied and known to everyone when starting to specialize in natural language processing. In this article, we will learn about the problem of labeling from the type, the basic approaches and algorithms to solve this problem.
Continue reading “Part-of-Speech taggingPOS” →
” data-medium-file=”https://ongxuanhong.files.wordpress.com/2015/09/language-model.jpg?w=300″ data-large-file=”https://ongxuanhong.files.wordpress .com/2015/09/language-model.jpg?w=1024″ class=”size-full wp-image-3294″ src=”https://ongxuanhong.files.wordpress.com/2015/09/language- model.jpg?w=1100″ alt=”Language model” srcset=”https://ongxuanhong.files.wordpress.com/2015/09/language-model.jpg?w=1100 1100w, https://ongxuanhong. files.wordpress.com/2015/09/language-model.jpg?w=150 150w, https://ongxuanhong.files.wordpress.com/2015/09/language-model.jpg?w=300 300w, https: //ongxuanhong.files.wordpress.com/2015/09/language-model.jpg?w=768 768w, https://ongxuanhong.files.wordpress.com/2015/09/language-model.jpg?w=1024 1024w, https://ongxuanhong.files.wordpress.com/2015/09/language-model.jpg 1200w” sizes=”(max-width: 1100px) 100vw, 1100px” />Language modelIn this article, we will find understand what a language model is. How to build a language model from a set of sentence patterns of any language (English, Vietnamese, Japanese, …). Language modeling was initially applied in speech recognition and has been applied to other related tasks in the field of Natural Language Processing (NLP) such as labeling. tagging, parsing, machine translation, etc.
Why do we need language models? The first reason, this model gives you information about the prior probability distribution ” data-medium-file=” https://ongxuanhong.files.wordpress.com/2016/02/nlp -tools.png?w=300″ data-large-file=”https://ongxuanhong.files.wordpress.com/2016/02/nlp-tools.png?w=800″ class=”size-full wp- image-7744″ src=”https://ongxuanhong.files.wordpress.com/2016/02/nlp-tools.png?w=1100″ alt=”NLP tools” srcset=”https://ongxuanhong.files. wordpress.com/2016/02/nlp-tools.png 800w, https://ongxuanhong.files.wordpress.com/2016/02/nlp-tools.png?w=150 150w, https://ongxuanhong.files. wordpress.com/2016/02/nlp-tools.png?w=300 300w, https://ongxuanhong.files.wordpress.com/2016/02/nlp-tools.png?w=768 768w” sizes=”( max-width: 800px) 100vw, 800px” />NLP toolsIf you are working and studying For research on English language, we can use Python’s NLP libraries/modules listed below. The purpose of this article is to list libraries/modules and useful functions in NLP. You can refer to the list of terms related to the functions in this article.
Continue reading “Introduction to Natural Language Processing tools” →
” data-medium-file=”https://ongxuanhong.files.wordpress.com/2016/02/natural-language-processing.jpg?w=300″ data-large-file=”https://ongxuanhong.files .wordpress.com/2016/02/natural-language-processing.jpg?w=900″ class=”alignnone size-full wp-image-7746″ src=”https://ongxuanhong.files.wordpress.com/2016 /02/natural-language-processing.jpg?w=1100″ alt=”Natural Language Processing” srcset=”https://ongxuanhong.files.wordpress.com/2016/02/natural-language-processing.jpg 900w, https://ongxuanhong.files.wordpress.com/2016/02/natural-language-processing.jpg?w=150 150w, https://ongxuanhong.files.wordpress.com/2016/02/natural-language-processing .jpg?w=300 300w, https://ongxuanhong.files.wordpress.com/2016/02/natural-language-processing.jpg?w=768 768w” sizes=”(max-width: 900px) 100vw, 900px “ />Natural Language Processing The role of Natural Language Processing-XLNNTN (Natural Language Processing-NLP) in Big Data mining is undeniable in the development context of today’s businesses. As for the English language, we have inherited a lot of knowledge as well as many tools available for immediate application in practice. However, for the Vietnamese language, we still face many difficulties (limited qualified personnel, insufficient training materials) besides great opportunities (Vietnamese market has not yet been developed). mining) for those who are passionate about the field.
Therefore, in this article, I would like to make a list of commonly encountered terms in NLP for easy reference as well as for beginners to quickly look up to conduct research immediately. science. The article will always be updated. If there are unclear terms, you can comment so we can continue to expand this list.
Continue reading “Natural Language Processing Terms” →
” data-medium-file=”https://ongxuanhong.files.wordpress.com/2015/08/natural-langage-processing.png?w=300″ data-large-file=”https://ongxuanhong.files .wordpress.com/2015/08/natural-langage-processing.png?w=934″ class=”size-full wp-image-13019″ src=”https://ongxuanhong.files.wordpress.com/2015/ 08/natural-langage-processing.png?w=1100″ alt=”natural langage processing” srcset=”https://ongxuanhong.files.wordpress.com/2015/08/natural-langage-processing.png 934w, https ://ongxuanhong.files.wordpress.com/2015/08/natural-langage-processing.png?w=150 150w, https://ongxuanhong.files.wordpress.com/2015/08/natural-langage-processing. png?w=300 300w, https://ongxuanhong.files.wordpress.com/2015/08/natural-langage-processing.png?w=768 768w” sizes=”(max-width: 934px) 100vw, 934px” /> natural langage processing Businesses are now facing a “flood” of data in all aspects: customer feedback, competitor information, customer emails, tweets, press conference information, legal documents theory, texts product and technical publications. The exploitation of these data is the key point for businesses to quickly implement their decisions compared to the competition.
What is the problem here? There is too much information to process at once (more than 85% of the world’s data is unstructured), and the data size is increasing. For many businesses, it is impossible to have staff read everything that is supposed to be important (what customers are saying about the product, what our competitors are doing). .
Continue reading “What is Natural Language Processing?” →
There are 2 things you should save, that is health and promise.
There are two things you have to give: knowledge and kindness.
There are 2 things you have to change, that is yourself and your perception.
There are two things you have to keep, that is faith and character.
There are 2 things you must cherish, that is family and present.
There are two things you have to do yourself, that is labor and responsibility for what you do.
See also: What is Keep On – 15 Phrases With Keep
There are two things you must forget, that is pain and hatred.
There are two things you have to remember, the gratitude to your mother and father and the help of others.
There are two things you must have to be successful: passion and perseverance.
There are two things you must not do, that is harming others and betraying trust.
There are 2 things you have to protect, that is reputation and reason.
There are two things you have to accept, death and difference.
There are two things you have to control, instinct and emotions.
There are two things you must stay away from, temptation and selfishness.
There are two things you always have to use without being miserly, money and experience.
There are two things you must not be afraid of, evil and real life.
There are two things you have to nurture, love and tolerance.
There are 2 things that you need to achieve in life, that is success and happy.
There are two things you must always be ready for, the difficulty and tomorrow.
See also: What is the English Test, What is the English Test
There are two things you must always keep in mind, that is to do the above things and do them well in your daily life.