Type-Token Analysis on LDC-IL Text Corpus

Rejitha K S; Rajesha N; Narayan Kumar Choudhary

doi:10.1109/o-cocosda60357.2023.10482978

Home
Search
Type-Token Analysis on LDC-IL Text Corpus

https://doi.org/10.1109/o-cocosda60357.2023.10482978

Type-Token Analysis on LDC-IL Text Corpus

Dec 4, 2023
Rejitha K S +2 more

Listen

Abstract
Literature Map
References
Similar Papers

Abstract

Large quantity of text data is essential to develop natural language processing applications. This paper describes the statistical analysis of LDC-IL text data. Type token analysis is carried out on 8 languages of a substantial size to check for closure. The study shows how similar language or same language family languages are giving an equivalent pattern of saturation curve.