A Robust statistical model of word frequencies
dc.contributor.author | Ingelby, Michael | |
dc.contributor.author | Sharoff, Serge | |
dc.date.accessioned | 2021-05-07T12:04:35Z | |
dc.date.available | 2021-05-07T12:04:35Z | |
dc.date.issued | 2019-08 | |
dc.description | Paper presented at the 5th Strathmore International Mathematics Conference (SIMC 2019), 12 - 16 August 2019, Strathmore University, Nairobi, Kenya | en_US |
dc.description.abstract | For the purposes of language teaching or automatic language processing it is important to know how frequent a word is. However, a simple procedure counting the number of times a word occurs in a collection of texts leads to many unfortunate artefacts because some words occur too often in a small number of texts leading to frequency bursts. Our task in this paper is to introduce a statistical model which uses methods from robust statistics to estimate the frequencies of words in a collection of texts. | en_US |
dc.description.sponsorship | University of Leeds, United Kingdom. | en_US |
dc.identifier.uri | http://hdl.handle.net/11071/10467 | |
dc.language.iso | en_US | en_US |
dc.publisher | Strathmore University | en_US |
dc.subject | Robust statistics | en_US |
dc.subject | Word frequencies | en_US |
dc.subject | Core lexicon | en_US |
dc.title | A Robust statistical model of word frequencies | en_US |
dc.type | Article | en_US |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- A robust statistical model of word frequencies.pdf
- Size:
- 89 KB
- Format:
- Adobe Portable Document Format
- Description:
- Abstract - SIMC Conference paper, 2019
License bundle
1 - 1 of 1
Loading...
- Name:
- license.txt
- Size:
- 1.71 KB
- Format:
- Item-specific license agreed upon to submission
- Description: