Literature DB >> 33954287

The Future of Computational Linguistics: On Beyond Alchemy.

Kenneth Church1, Mark Liberman2.   

Abstract

Over the decades, fashions in Computational Linguistics have changed again and again, with major shifts in motivations, methods and applications. When digital computers first appeared, linguistic analysis adopted the new methods of information theory, which accorded well with the ideas that dominated psychology and philosophy. Then came formal language theory and the idea of AI as applied logic, in sync with the development of cognitive science. That was followed by a revival of 1950s-style empiricism-AI as applied statistics-which in turn was followed by the age of deep nets. There are signs that the climate is changing again, and we offer some thoughts about paths forward, especially for younger researchers who will soon be the leaders.
Copyright © 2021 Church and Liberman.

Entities:  

Keywords:  alchemy; computational linguistics; connectionism; deep nets; empiricism; logic; probability; rationalism

Year:  2021        PMID: 33954287      PMCID: PMC8089371          DOI: 10.3389/frai.2021.625341

Source DB:  PubMed          Journal:  Front Artif Intell        ISSN: 2624-8212


  9 in total

1.  The perceptron: a probabilistic model for information storage and organization in the brain.

Authors:  F ROSENBLATT
Journal:  Psychol Rev       Date:  1958-11       Impact factor: 8.934

2.  A fast learning algorithm for deep belief nets.

Authors:  Geoffrey E Hinton; Simon Osindero; Yee-Whye Teh
Journal:  Neural Comput       Date:  2006-07       Impact factor: 2.026

3.  SUMMARY OF THE REPORT TO THE PRESIDENT ON A PROGRAM FOR POSTWAR SCIENTIFIC RESEARCH BY VANNEVAR BUSH, DIRECTOR OF OSRD.

Authors: 
Journal:  Science       Date:  1945-07-27       Impact factor: 47.728

4.  A logical calculus of the ideas immanent in nervous activity. 1943.

Authors:  W S McCulloch; W Pitts
Journal:  Bull Math Biol       Date:  1990       Impact factor: 1.758

Review 5.  Deep learning.

Authors:  Yann LeCun; Yoshua Bengio; Geoffrey Hinton
Journal:  Nature       Date:  2015-05-28       Impact factor: 49.962

6.  The National Science Foundation and the debate over postwar research policy, 1942-1945. A political interpretation of Science-the Endless Frontier.

Authors:  D J Kevles
Journal:  Isis       Date:  1977-03       Impact factor: 0.688

7.  Human-level concept learning through probabilistic program induction.

Authors:  Brenden M Lake; Ruslan Salakhutdinov; Joshua B Tenenbaum
Journal:  Science       Date:  2015-12-11       Impact factor: 47.728

8.  Pareto-Optimal Data Compression for Binary Classification Tasks.

Authors:  Max Tegmark; Tailin Wu
Journal:  Entropy (Basel)       Date:  2019-12-19       Impact factor: 2.524

9.  BioBERT: a pre-trained biomedical language representation model for biomedical text mining.

Authors:  Jinhyuk Lee; Wonjin Yoon; Sungdong Kim; Donghyeon Kim; Sunkyu Kim; Chan Ho So; Jaewoo Kang
Journal:  Bioinformatics       Date:  2020-02-15       Impact factor: 6.937

  9 in total
  1 in total

Review 1.  Beyond the Benchmarks: Toward Human-Like Lexical Representations.

Authors:  Suzanne Stevenson; Paola Merlo
Journal:  Front Artif Intell       Date:  2022-05-24
  1 in total

北京卡尤迪生物科技股份有限公司 © 2022-2023.