Shallow parsing

Shallow parsing (also chunking, "light parsing") is an analysis of a sentence which identifies the constituents (noun groups or phrases, verbs, verb groups, etc.), but does not specify their internal structure, nor their role in the main sentence.

It is a technique widely used in natural language processing. It is similar to the concept of lexical analysis for computer languages. Under the name of the Shallow Structure Hypothesis, it is also used as an explanation for why second language learners often fail to parse complex sentences correctly.^[1]

References

1. Clahsen, Felser, Harald, Claudia (2006). "Grammatical Processing in Language Learners". Applied Psycholinguistics 27: 3–42. doi:10.1017/S0142716406060024.

• "NP Chunking (State of the art)". Association for Computational Linguistics. Retrieved 2016-01-30.
• Abney, Steven (1991), Parsing By Chunks (PDF), Kluwer Academic Publishers, pp. 257–278.

External links

• Apache OpenNLP OpenNLP includes a chunker.
• GATE General Architecture for Text Engineering GATE includes a chunker.
• NLTK chunking
• Illinois Shallow Parser Shallow Parser Demo

See also

• Parser
• Semantic role labeling
• Named entity recognition