39
Views
4
CrossRef citations to date
0
Altmetric
Original Articles

ZIPF'S LAWS IN TEXT MODELING

Pages 233-252 | Received 30 Sep 1998, Accepted 19 Jan 1989, Published online: 27 Apr 2007
 

Abstract

Zipf's first and second laws define two striking phenomena in literary text. The two laws have applications in various fields of computer science. Recently, the study of continuous speech recognition in artificial intelligence has called for the use of statistical models of text generation. A major issue is the lack of effective and objective evaluation of the models. In this paper, four leading statistical models of text generation are evaluated with respect to Zipf's laws and we identify the Simon-Yule model as a promising approach. A significant implication of the findings for text modeling is also discussed.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.