Copyright © 2006 The Institute of Electronics, Information and Communication Engineers
Regular Section -- Papers -- Natural Language Processing |
Construction of Thai Lexicon from Existing Dictionaries and Texts on the Web
1 The authors are with Sirindhorn International Institute of Technology, Thammasat University, 131 Tiwanont Rd. Bangkadi, Pathumthani, Thailand. E-mail: thatsanee{at}tcllab.org, 2 The authors are with Thai Computational Linguistics Lab., NICT Asia Research Center, Thailand.
A lexicon is an important linguistic resource needed for both shallow and deep language processing. Currently, there are few machine-readable Thai dictionaries available, and most of them do not satisfy the computational requirements. This paper presents the design of a Thai lexicon named the TCL's Computational Lexicon (TCLLEX) and proposes a method to construct a large-scale Thai lexicon by re-using two existing dictionaries and a large number of texts on the Internet. In addition to morphological, syntactic, semantic case role and logical information in the existing dictionaries, a sort of semantic constraint called selectional preference is automatically acquired by analyzing Thai texts on the web and then added into the lexicon. In the acquisition process of the selectional preferences, the so-called Bayesian Information Criterion (BIC) is applied as the measure in a tree cut model. The experiments are done to verify the feasibility and effectiveness of obtained selection preferences.
Key Words: Thai lexicon construction, logical and selectional preferences semantic constraints, semantics constraint acquisition, tree cut model
Manuscript received April 21, 2005. Manuscript revised October 18, 2005.
References
[1] G.A. Miller, R Beckwith, C Fellbaum, D Gross, and K Miller, Introduction to WordNet: An On-Line Lexical Database, CSL Report 43, 1993.
[2] C.F. Baker, C.J. Fillmore, and J.B. Lowe, "The Berkeley FrameNet project," Proc. COLING-ACL, Montreal, Canada, pp.86–90, 1998.
[3] EDR, EDR Electronic Dictionary Technical Guide, Japan Electronic Dictionary Research Institute, Ltd., 1990.
[4] Z. Dong and Q. Dong, "Hownet" [online], Available at http://www.keenage.com/zhiwang/e_zhiwang.html
[5] http://www.ipa.go.jp/STC/NIHONGO/IPAL/ipal.html
[6] Center of the International Cooperation for Computerization (CICC), "Thai basic dictionary: Technical report," 1995.
[7] Lexitron, Available at http://lexitron.nectec.or.th
[8] M. Berland and E. Charniak, "Finding parts in very large corpora," Proc. 37th Annual Meeting of the Association for Computational Linguistics, New Brunswick, NJ, pp.57–64, 1999.
[9] H. Sundblad, "Acquisition of hyponyms and meronyms from question corpora," Proc. Workshop on Natural Language Processing and Machine Learning for Ontology Engineering, Lyon, France, pp.19–22, 2002.
[10] R. Girju, A. Badulescu, and D. Moldovan, "Learning semantic constraints for the automatic discovery of part-whole relations," Proc. Human Language Technology Conference, Edmonton, Canada, pp.80–87, 2003.
[11] L. Wasserman, "Bayesian model selection and model averaging," J. Mathematical Psychology, vol.44, pp.92–107, 1999.
[12] D.M. Chickering and D. Heckerman, "Efficient approximations for the marginal likelihood of Bayesian networks with hidden variables," Machine Learning, vol.29, pp.181–212, 1997.
[13] H. Li and N. Abe, "Generalizing case frames using a thesaurus and the MDL principle," Computational Linguistics, vol.24, no.2, pp.217–244, 1998.
[14] C. Kruengkrai, T. Charoenporn, V. Sornlertlamvanich, and H. Isahara, "Acquiring selectional preferences in a thai lexical database," Proc. 1st Joint Conference on Natural Language Processing (IJCNLP-04), China, pp.668–675, 2004.
[15] T. Dunning, "Accurate methods for the statistics of surprise and coincidence," Computational Linguistics, vol.19, no.1, pp.61–74, 1994.
[16] T. Tanaka, "Measuring the similarity between compound nouns in different languages using non-parallel corpora," Proc. 19th International Conference on Computational Linguistics, pp.981–987, 2002.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  T. CHAROENPORN, C. KRUENGKRAI, T. THEERAMUNKONG, and V. SORNLERTLAMVANICH An EM-Based Approach for Mining Word Senses from Corpora IEICE Trans D: Information, March 1, 2007; E90-D(4): 775 - 782. [Abstract] [PDF]
|
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||