Literature DB >> 17213502

A comparative evaluation of full-text, concept-based, and context-sensitive search.

Robert Moskovitch1, Susana B Martins, Eytan Behiri, Aviram Weiss, Yuval Shahar.   

Abstract

OBJECTIVES: Study comparatively (1) concept-based search, using documents pre-indexed by a conceptual hierarchy; (2) context-sensitive search, using structured, labeled documents; and (3) traditional full-text search. Hypotheses were: (1) more contexts lead to better retrieval accuracy; and (2) adding concept-based search to the other searches would improve upon their baseline performances.
DESIGN: Use our Vaidurya architecture, for search and retrieval evaluation, of structured documents classified by a conceptual hierarchy, on a clinical guidelines test collection. MEASUREMENTS: Precision computed at different levels of recall to assess the contribution of the retrieval methods. Comparisons of precisions done with recall set at 0.5, using t-tests.
RESULTS: Performance increased monotonically with the number of query context elements. Adding context-sensitive elements, mean improvement was 11.1% at recall 0.5. With three contexts, mean query precision was 42% +/- 17% (95% confidence interval [CI], 31% to 53%); with two contexts, 32% +/- 13% (95% CI, 27% to 38%); and one context, 20% +/- 9% (95% CI, 15% to 24%). Adding context-based queries to full-text queries monotonically improved precision beyond the 0.4 level of recall. Mean improvement was 4.5% at recall 0.5. Adding concept-based search to full-text search improved precision to 19.4% at recall 0.5.
CONCLUSIONS: The study demonstrated usefulness of concept-based and context-sensitive queries for enhancing the precision of retrieval from a digital library of semi-structured clinical guideline documents. Concept-based searches outperformed free-text queries, especially when baseline precision was low. In general, the more ontological elements used in the query, the greater the resulting precision.

Mesh:

Year:  2007        PMID: 17213502      PMCID: PMC2213470          DOI: 10.1197/jamia.M1953

Source DB:  PubMed          Journal:  J Am Med Inform Assoc        ISSN: 1067-5027            Impact factor:   4.497


  10 in total

1.  Assessing thesaurus-based query expansion using the UMLS Metathesaurus.

Authors:  W Hersh; S Price; L Donohoe
Journal:  Proc AMIA Symp       Date:  2000

2.  GEM: a proposal for a more comprehensive guideline document model using XML.

Authors:  R N Shiffman; B T Karras; A Agrawal; R Chen; L Marenco; S Nath
Journal:  J Am Med Inform Assoc       Date:  2000 Sep-Oct       Impact factor: 4.497

3.  Vaidurya--a concept-based, context-sensitive search engine for clinical guidelines.

Authors:  Robert Moskovitch; Alon Hessing; Yval Shahar
Journal:  Stud Health Technol Inform       Date:  2004

4.  SAPHIRE--an information retrieval system featuring concept matching, automatic indexing, probabilistic retrieval, and hierarchical relationships.

Authors:  W R Hersh; R A Greenes
Journal:  Comput Biomed Res       Date:  1990-10

5.  A framework for a distributed, hybrid, multiple-ontology clinical-guideline library, and automated guideline-support tools.

Authors:  Yuval Shahar; Ohad Young; Erez Shalom; Maya Galperin; Alon Mayaffit; Robert Moskovitch; Alon Hessing
Journal:  J Biomed Inform       Date:  2004-10       Impact factor: 6.317

6.  The Asgaard project: a task-specific framework for the application and critiquing of time-oriented clinical guidelines.

Authors:  Y Shahar; S Miksch; P Johnson
Journal:  Artif Intell Med       Date:  1998 Sep-Oct       Impact factor: 5.326

7.  A comparison of retrieval effectiveness for three methods of indexing medical literature.

Authors:  W R Hersh; D H Hickam
Journal:  Am J Med Sci       Date:  1992-05       Impact factor: 2.378

8.  Sharable representation of clinical guidelines in GLIF: relationship to the Arden Syntax.

Authors:  M Peleg; A A Boxwala; E Bernstam; S Tu; R A Greenes; E H Shortliffe
Journal:  J Biomed Inform       Date:  2001-06       Impact factor: 6.317

9.  The UMLS project: making the conceptual connection between users and the information they need.

Authors:  B L Humphreys; D A Lindberg
Journal:  Bull Med Libr Assoc       Date:  1993-04

10.  A comparison of two methods for indexing and retrieval from a full-text medical database.

Authors:  W R Hersh; D H Hickam
Journal:  Med Decis Making       Date:  1993 Jul-Sep       Impact factor: 2.583

  10 in total
  10 in total

1.  Comparison of ontology-based semantic-similarity measures.

Authors:  Wei-Nchih Lee; Nigam Shah; Karanjot Sundlass; Mark Musen
Journal:  AMIA Annu Symp Proc       Date:  2008-11-06

2.  UMLS-Query: a perl module for querying the UMLS.

Authors:  Nigam H Shah; Nigam Shah; Mark A Muse; Mark Musen
Journal:  AMIA Annu Symp Proc       Date:  2008-11-06

3.  Improving condition severity classification with an efficient active learning based framework.

Authors:  Nir Nissim; Mary Regina Boland; Nicholas P Tatonetti; Yuval Elovici; George Hripcsak; Yuval Shahar; Robert Moskovitch
Journal:  J Biomed Inform       Date:  2016-03-22       Impact factor: 6.317

4.  NCBO Resource Index: Ontology-Based Search and Mining of Biomedical Resources.

Authors:  Clement Jonquet; Paea Lependu; Sean Falconer; Adrien Coulet; Natalya F Noy; Mark A Musen; Nigam H Shah
Journal:  Web Semant       Date:  2011-09-01       Impact factor: 1.897

5.  Inter-labeler and intra-labeler variability of condition severity classification models using active and passive learning methods.

Authors:  Nir Nissim; Yuval Shahar; Yuval Elovici; George Hripcsak; Robert Moskovitch
Journal:  Artif Intell Med       Date:  2017-04-27       Impact factor: 5.326

6.  A scalable architecture for incremental specification and maintenance of procedural and declarative clinical decision-support knowledge.

Authors:  Avner Hatsek; Yuval Shahar; Meirav Taieb-Maimon; Erez Shalom; Denis Klimov; Eitan Lunenfeld
Journal:  Open Med Inform J       Date:  2010-12-14

7.  The open biomedical annotator.

Authors:  Clement Jonquet; Nigam H Shah; Mark A Musen
Journal:  Summit Transl Bioinform       Date:  2009-03-01

8.  Understanding contexts: how explanatory theories can help.

Authors:  Frank Davidoff
Journal:  Implement Sci       Date:  2019-03-06       Impact factor: 7.327

9.  Comparison of concept recognizers for building the Open Biomedical Annotator.

Authors:  Nigam H Shah; Nipun Bhatia; Clement Jonquet; Daniel Rubin; Annie P Chiang; Mark A Musen
Journal:  BMC Bioinformatics       Date:  2009-09-17       Impact factor: 3.169

10.  Ontology-driven indexing of public datasets for translational bioinformatics.

Authors:  Nigam H Shah; Clement Jonquet; Annie P Chiang; Atul J Butte; Rong Chen; Mark A Musen
Journal:  BMC Bioinformatics       Date:  2009-02-05       Impact factor: 3.169

  10 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.