000 02393nam a2200337Ia 4500
005 20260803094148.0
008 251212s2013 xx 000 0 und d
245 1 _aWeb corpus construction /
_cRoland Schèafer and Felix Bildhauer.
100 _aSchèafer, Roland
100 _d1974-
700 _aBildhauer, Felix.
260 _a[San Rafael, Calif.] :
_bMorgan & Claypool,
_cc2013.
300 _axv, 129 p. : ill.:
300 _c24 cm.
490 _aSynthesis lectures on human language technologies,|x1947-4059 ; #22.
500 _aIncludes bibliographical references (p. 111-128)
020 _a978-1-60845-983-4
_qpbk.
650 _aCorpora (Linguistics)
_xData processing.
650 _aComputational linguistics.
650 _aWeb search engines.
050 _a410.188 Sch14 c2013
943 _b0
_c0
_d0
_e1
_f0
_g0
_h0
_i0
_j0
944 _b1
_c1
_d0
953 _pHED5421
546 _ain English
953 _cCollLib
505 _aThe World Wide Web constitutes the largest existing source of texts written in a great variety of languages. A feasible and sound way of exploiting this data for linguistic research is to compile a static corpus for a given language. There are several advantages of this approach: (i) Working with such corpora obviates the problems encountered when using Internet search engines in quantitative linguistic research (such as non-transparent ranking algorithms). (ii) Creating a corpus from web data is virtually free. (iii) The size of corpora compiled from the WWW may exceed by several orders of magnitudes the size of language resources offered elsewhere. (iv) The data is locally available to the user, and it can be linguistically post-processed and queried with the tools preferred by her/him. This book addresses the main practical tasks in the creation of web corpora up to giga-token size. Among these tasks are the sampling process (i. e., web crawling) and the usual cleanups including boilerplate removal and removal of duplicated content. Linguistic processing and problems with linguistic processing coming from the different kinds of noise in web corpora are also covered. Finally, the authors show how web corpora can be evaluated and compared to other corpora (such as traditionally compiled corpora)
591 _a0
942 _2lcc
_cBK
_ahpayson
_b2015-05-22 09:28:38
_dhpayson
_e2015-05-22 09:30:13
998 _a8283
999 _c8257
_d8257