Research Hub
Papers with a full citation graph - what each paper draws on, and who cites it.
2 papers
Efficient Estimation of Word Representations in Vector Space
Kai Chen, Greg Corrado, Jeffrey Dean, Tomas Mikolov
Finding: The models learned high-quality word vectors from 1.6 billion words in under a day, orders of magnitude faster than earlier neural approaches. Strikingly, the resulting vector space encoded semantic and syntactic relationships as directions: vector arithmetic such as king − man + woman produced a vector closest to queen, showing that regularities in language were captured as consistent geometric offsets.
Learning representations by back-propagating errors
Ronald J. Williams, Geoffrey E. Hinton, David E. Rumelhart
Finding: Hidden units learn to represent important task features on their own (e.g. 'person', 'generation', 'nationality' in a family-tree problem) — deep networks learn abstract representations, not just memorize.