Boris L Alperin1, Andrey O Kuzmin2, Ludmila Yu Ilina1, Vladimir D Gusev3, Natalia V Salomatina3, Valentin N Parmon2. 1. Boreskov Institute of Catalysis SB RAS, Pr. Lavrentieva 5, Novosibirsk, Russia 630090. 2. Boreskov Institute of Catalysis SB RAS, Pr. Lavrentieva 5, Novosibirsk, Russia 630090 ; Novosibirsk State University, Pirogova 2, Novosibirsk, Russia 630090. 3. Sobolev Institute of Mathematics SB RAS, Acad. Koptyug Avenue 4, Novosibirsk, Russia 630090.
Abstract
BACKGROUND: This study seeks to develop, test and assess a methodology for automatic extraction of a complete set of 'term-like phrases' and to create a terminology spectrum from a collection of natural language PDF documents in the field of chemistry. The definition of 'term-like phrases' is one or more consecutive words and/or alphanumeric string combinations with unchanged spelling which convey specific scientific meanings. A terminology spectrum for a natural language document is an indexed list of tagged entities including: recognized general scientific concepts, terms linked to existing thesauri, names of chemical substances/reactions and term-like phrases. The retrieval routine is based on n-gram textual analysis with a sequential execution of various 'accept and reject' rules with taking into account the morphological and structural information. RESULTS: The assessment of the retrieval process, expressed quantitatively with a precision (P), recall (R) and F1-measure, which are calculated manually from a limited set of documents (the full set of text abstracts belonging to 5 EuropaCat events were processed) by professional chemical scientists, has proved the effectiveness of the developed approach. The term-like phrase parsing efficiency is quantified with precision (P = 0.53), recall (R = 0.71) and F1-measure (F1 = 0.61) values. CONCLUSION: The paper suggests using such terminology spectra to perform various types of textual analysis across document collections. This sort of the terminology spectrum may be successfully employed for text information retrieval, for reference database development, to analyze research trends in subject fields of research and to look for the similarity between documents.Graphical abstractTerminology spectrum building process with term-like phrases retrieval.
BACKGROUND: This study seeks to develop, test and assess a methodology for automatic extraction of a complete set of 'term-like phrases' and to create a terminology spectrum from a collection of natural language PDF documents in the field of chemistry. The definition of 'term-like phrases' is one or more consecutive words and/or alphanumeric string combinations with unchanged spelling which convey specific scientific meanings. A terminology spectrum for a natural language document is an indexed list of tagged entities including: recognized general scientific concepts, terms linked to existing thesauri, names of chemical substances/reactions and term-like phrases. The retrieval routine is based on n-gram textual analysis with a sequential execution of various 'accept and reject' rules with taking into account the morphological and structural information. RESULTS: The assessment of the retrieval process, expressed quantitatively with a precision (P), recall (R) and F1-measure, which are calculated manually from a limited set of documents (the full set of text abstracts belonging to 5 EuropaCat events were processed) by professional chemical scientists, has proved the effectiveness of the developed approach. The term-like phrase parsing efficiency is quantified with precision (P = 0.53), recall (R = 0.71) and F1-measure (F1 = 0.61) values. CONCLUSION: The paper suggests using such terminology spectra to perform various types of textual analysis across document collections. This sort of the terminology spectrum may be successfully employed for text information retrieval, for reference database development, to analyze research trends in subject fields of research and to look for the similarity between documents.Graphical abstractTerminology spectrum building process with term-like phrases retrieval.
Entities:
Keywords:
Natural language text analysis; Term-like phrases retrieval; Terminology spectrum; Text information retrieval; n-Gram analysis