Research Hub
Papers with a full citation graph - what each paper draws on, and who cites it.
5 papers
Attention Is All You Need
Aidan N. Gomez, Łukasz Kaiser, Noam Shazeer, Illia Polosukhin, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Llion Jones
Finding: The Transformer achieved state-of-the-art translation quality while being significantly faster to train due to parallelization.
You Only Look Once: Unified, Real-Time Object Detection
Ross Girshick, Ali Farhadi, Santosh Divvala, Joseph Redmon
Finding: YOLO achieved state-of-the-art performance at incredibly high speeds (up to 45 frames per second on standard hardware, and 155 fps for smaller versions), proving that a single end-to-end network could achieve both high accuracy and real-time processing.
ImageNet Classification with Deep Convolutional Neural Networks
Geoffrey E. Hinton, Alex Krizhevsky, Ilya Sutskever
Finding: AlexNet won the ImageNet 2012 competition by a large margin (15.3% top-5 error vs 26.2% for the second best), proving that deep CNNs are highly effective on large-scale data.
Long Short-Term Memory
Sepp Hochreiter, Jürgen Schmidhuber
Finding: LSTM outperformed vanilla RNNs on tasks like speech recognition, machine translation, and text generation, successfully modeling long-term dependencies.
Learning representations by back-propagating errors
Ronald J. Williams, David E. Rumelhart, Geoffrey E. Hinton
Finding: Backpropagation effectively trains multi-layer networks for nonlinear tasks like pattern recognition and representation learning.