90
Views
3
CrossRef citations to date
0
Altmetric
Review Article

Deep Insights of Erroneous Bengali–English Code-Mixed Bilingual Language

, &
Pages 3334-3345 | Published online: 16 Jun 2021
 

ABSTRACT

Code-switching, the combination of more than one language within a single utterance is popular in social media sites for informal communication, generating a huge amount of data, though not fully analysed for knowledge extraction due to lack of documentation. Moreover, the code-mixed data is erroneous, and to detect and correct different types of errors, the model requires large erroneous code-mixed language data, not publicly available. This paper first defines generic rules to write Bengali–English code-mixed language in English script, considering the inherent complexity of the Bengali language. Different types of typographical and cognitive errors are induced to obtain the huge erroneous data, based on human behaviour and perception as consulted with the language experts. The errors considered here are applicable to other code-mixed Indic languages and would be beneficial for the researchers. To demonstrate the applicability of the model, we have included the errors in the Hindi–English code-mixed Indic language. An attention-based two-level deep network architecture (uses LSTM as a basic unit) is used for error detection, correction, and translation of code-mixed sentences into a monolingual sentence. Results are reported in terms of accuracy, ROUGE score, and BLEU scores at word level and sentence level for both Bengali–English and Hindi–English code-mixed languages.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Isha Ganguli

Isha Ganguli is presently working as PhD research scholar in IIEST, Shibpur, India. Her areas of interest are text mining, deep learning etc.

Rajat Subhra Bhowmick

Rajat Subhra Bhowmik is presently working as PhD scholar in IIEST, Shibpur, India. His areas of interest are data mining, deep learning, etc. Email: [email protected]

Jaya Sil

Jaya Sil is presently working as professor in IIEST, Shibpur, India. Her domain of interest includes artificial intelligence, image processing and computer vision, bio-informatics, etc. Email: [email protected]

Log in via your institution

Log in to Taylor & Francis Online

PDF download + Online access

  • 48 hours access to article PDF & online version
  • Article PDF can be downloaded
  • Article PDF can be printed
USD 61.00 Add to cart

Issue Purchase

  • 30 days online access to complete issue
  • Article PDFs can be downloaded
  • Article PDFs can be printed
USD 100.00 Add to cart

* Local tax will be added as applicable

Related Research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.