Research Hub

    Papers with a full citation graph - what each paper draws on, and who cites it.

    All (51)robotics (6)deep learning (5)backpropagation (3)deep-learning (3)HRI (3)survey (3)algorithms (3)reasoning (2)actuators (2)machine-learning (2)
    Show 177 more topics
    optimization (2)LSTM (2)deep reinforcement learning (2)biped robot (2)representation-learning (2)force control (2)ensemble (2)regression (2)hypothesis-testing (2)statistics (2)autonomous agents (1)web environment (1)evaluation (1)UI automation (1)ReAct (1)function calling (1)agent (1)chain-of-thought (1)prompting (1)agents (1)sensors (1)review (1)automatic-differentiation (1)calculus (1)pose estimation (1)openpose (1)part affinity fields (1)computer vision (1)skeletal tracking (1)OCR (1)text recognition (1)CRNN (1)CTC (1)locomotion (1)Sim-to-Real (1)Transformer (1)attention (1)NLP (1)machine translation (1)object detection (1)YOLO (1)real-time vision (1)bounding boxes (1)gradient-descent (1)adam-optimizer (1)DQN (1)Q-learning (1)Atari games (1)transfer learning (1)feature extraction (1)CNNs (1)generalization (1)vector-spaces (1)word-embeddings (1)cosine-similarity (1)nlp (1)CNN (1)ImageNet (1)image classification (1)IMU (1)orientation filter (1)quaternion (1)ROS (1)Robot Operating System (1)open-source (1)middleware (1)service robot (1)elderly care (1)robot arm (1)imitation learning (1)learning from demonstration (1)recommender systems (1)matrix factorization (1)SVD (1)collaborative filtering (1)Netflix Prize (1)safety (1)collaborative robots (1)standards (1)robotic hand (1)pneumatic actuators (1)force sensor (1)design (1)ZMP (1)balance (1)control (1)human-robot interaction (1)social robots (1)service robotics (1)Random Forest (1)decision tree (1)classification (1)biped walking (1)inverted pendulum (1)gait pattern (1)humanoid robot (1)random forest (1)decision trees (1)supervised learning (1)motion planning (1)RRT (1)random tree (1)impedance (1)hybrid control (1)search engines (1)PageRank (1)eigenvectors (1)graph theory (1)Markov chains (1)localization (1)particle filter (1)navigation (1)mobile robot (1)mechanical design (1)ASIMO (1)humanoid (1)RNN (1)sequence modeling (1)vanishing gradient (1)visual servoing (1)image-based (1)position-based (1)lasso (1)regularization (1)feature selection (1)cross-validation (1)model evaluation (1)bootstrap (1)model selection (1)reinforcement learning (1)temporal difference (1)prediction (1)TD (1)edge detection (1)image processing (1)Canny filter (1)hysteresis (1)neural networks (1)representations (1)neural-networks (1)credit-assignment (1)convex-optimization (1)linear-programming (1)interior-point-methods (1)computational-complexity (1)least squares (1)history of statistics (1)Gauss (1)matrix multiplication (1)computational complexity (1)numerical linear algebra (1)K-Means (1)clustering (1)unsupervised learning (1)data analysis (1)logistic regression (1)binary data (1)maximum likelihood (1)kinematics (1)Denavit-Hartenberg (1)transformation matrix (1)markov-chain (1)monte-carlo (1)mcmc (1)statistical-mechanics (1)PID (1)Ziegler-Nichols (1)tuning (1)industrial control (1)statistical-significance (1)neyman-pearson (1)decision-theory (1)t-distribution (1)sample-size (1)bayes-theorem (1)probability (1)history-of-mathematics (1)

    51 papers

    2023arXiv preprint arXiv:2307.13854, presented at NeurIPS 2023

    WebArena: A Realistic Web Environment for Building Autonomous Agents

    Shunyu Yao, Dian Yu, Jason Wei, Yonghui Wu, Nan Du, Izhak Shafran, Karthik Narasimhan

    Finding: Results show that LLM-based agents (like GPT-4) can successfully complete about 40% of tasks, which is a significant achievement, but still far from human performance (~90%).

    2022arXiv:2210.03629, DOI: 10.48550/arXiv.2210.03629

    ReAct: Synergizing Reasoning and Acting in Language Models

    Jeffrey Zhao, Dian Yu, Shunyu Yao

    Finding: ReAct outperformed prior methods on interactive decision-making tasks and improved human interpretability and trustworthiness.

    2022Advances in Neural Information Processing Systems (NeurIPS) 2022, arXiv:2201.11903

    Chain-of-Thought Prompting Elicits Reasoning in Large Language Models

    Ed H. Chi, Jason Wei, Quoc V. Le, Fei Xia, Denny Zhou, Xuezhi Wang, Dale Schuurmans, Brian Ichter, Maarten Bosma

    Finding: This method significantly improved accuracy on math, logical reasoning, and complex QA tasks, even for smaller models.

    2018IEEE Sensors Journal, vol. 18, no. 16, pp. 6484-6495, DOI: 10.1109/JSEN.2018.2846743

    A Review of Sensors and Actuators for Robotics

    Mohamed S. Ali, Sarah A. Ahmed

    Finding: MEMS-based sensors and electric actuators (e.g., brushless motors) are the most popular choices in modern robotics due to their small size, reasonable cost, and high precision.

    2017Journal of Machine Learning Research (JMLR), Vol. 18, pp. 1-43 — https://jmlr.org/papers/v18/17-468.html

    Automatic Differentiation in Machine Learning: a Survey

    Alexey Andreyevich Radul, Atılım Güneş Baydin, Jeffrey Mark Siskind, Barak A. Pearlmutter

    Finding: Reverse-mode AD is the foundational algorithm that powers the training of virtually all deep learning models — commonly known in the ML community as backpropagation.

    2017IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (DOI: 10.1109/CVPR.2017.143)

    Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields

    Zhe Cao, Tomas Simon, Shih-En Wei, Yaser Sheikh

    Finding: This bottom-up architecture achieved high accuracy while maintaining real-time processing speeds, crucially remaining fast regardless of how many people or objects were in the image.

    2017IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 11, pp. 2298-2304, DOI: 10.1109/TPAMI.2016.2646691

    An End-to-End Trainable Neural Network for Image-based Sequence Recognition and Its Application to Scene Text Recognition

    Cong Yao, Xiang Bai, Baoguang Shi

    Finding: The proposed method achieved competitive and superior accuracy on standard benchmarks like IIIT-5K and ICDAR, while being end-to-end trainable and requiring no manual segmentation.

    2017arXiv preprint arXiv:1707.02286 (presented at NeurIPS 2017)

    Emergence of Locomotion Behaviours in Rich Environments

    Jay Lemay, David Silver, Nicolas Heess, Srinivasan Sriram, Darren King, Koray Kavukcuoglu

    Finding: The trained policies exhibited emergent behaviors like walking, running, jumping, and even leaping across various environments, demonstrating robust locomotion.

    2017Advances in Neural Information Processing Systems (NeurIPS) 2017, pp. 5998-6008, arXiv:1706.03762

    Attention Is All You Need

    Aidan N. Gomez, Łukasz Kaiser, Noam Shazeer, Illia Polosukhin, Ashish Vaswani, Niki Parmar, Jakob Uszkoreit, Llion Jones

    Finding: The Transformer achieved state-of-the-art translation quality while being significantly faster to train due to parallelization.

    2016IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (DOI: 10.1109/CVPR.2016.91)

    You Only Look Once: Unified, Real-Time Object Detection

    Ross Girshick, Ali Farhadi, Santosh Divvala, Joseph Redmon

    Finding: YOLO achieved state-of-the-art performance at incredibly high speeds (up to 45 frames per second on standard hardware, and 155 fps for smaller versions), proving that a single end-to-end network could achieve both high accuracy and real-time processing.

    2015International Conference on Learning Representations (ICLR 2015) — arXiv:1412.6980, https://arxiv.org/abs/1412.6980

    Adam: A Method for Stochastic Optimization

    Jimmy Ba, Diederik P. Kingma

    Finding: Adam combines the advantages of AdaGrad (handles sparse gradients) and RMSProp (works well in non-stationary settings), and performs well empirically across problems.

    2015Nature, vol. 518, no. 7540, pp. 529-533, DOI: 10.1038/nature14236

    Human-level control through deep reinforcement learning

    Diederik Kingma, Ioannis Antonoglou, Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Martin Riedmiller, Alex Graves

    Finding: DQN achieved human-level or better performance on 49 Atari games, marking the first major success of Deep RL.

    2014Advances in Neural Information Processing Systems (NeurIPS) 2014, pp. 3320-3328

    How transferable are features in deep neural networks?

    Jason Yosinski, Yoshua Bengio, Jeff Clune, Hod Lipson

    Finding: They found that features become increasingly specific to the original task in higher layers, but still transfer well to related tasks. Transferability degrades as the divergence between tasks increases.

    2013ICLR 2013 Workshop Track; arXiv preprint arXiv:1301.3781 — https://arxiv.org/abs/1301.3781

    Efficient Estimation of Word Representations in Vector Space

    Kai Chen, Greg Corrado, Jeffrey Dean, Tomas Mikolov

    Finding: The models learned high-quality word vectors from 1.6 billion words in under a day, orders of magnitude faster than earlier neural approaches. Strikingly, the resulting vector space encoded semantic and syntactic relationships as directions: vector arithmetic such as king − man + woman produced a vector closest to queen, showing that regularities in language were captured as consistent geometric offsets.

    2012Advances in Neural Information Processing Systems (NeurIPS) 2012, pp. 1097-1105

    ImageNet Classification with Deep Convolutional Neural Networks

    Geoffrey E. Hinton, Alex Krizhevsky, Ilya Sutskever

    Finding: AlexNet won the ImageNet 2012 competition by a large margin (15.3% top-5 error vs 26.2% for the second best), proving that deep CNNs are highly effective on large-scale data.

    2010Technical Report, University of Bristol, DOI: 10.1007/978-3-642-21799-3_1 (also published in IEEE Sensors Journal)

    An efficient orientation filter for inertial and inertial/magnetic sensor arrays

    Sebastian O. H. Madgwick

    Finding: The Madgwick filter can operate at high sampling rates (>500 Hz) with low error, achieving performance comparable to extended Kalman filters in practice.

    2009Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) Workshop on Open Source Software, pp. 1-6

    ROS: an open-source Robot Operating System

    Brian Gerkey, Ken Conley, Morgan Quigley

    Finding: ROS quickly became the industry standard for robot development, accelerating robotics research due to its open-source nature and active community.

    2009Proceedings of the 2009 IEEE International Symposium on Robot and Human Interactive Communication (RO‑MAN), pp. 331-336, DOI: 10.1109/ROMAN.2009.5326349

    The Care‑O‑bot 3 – A Service Robot for Home Environments

    Christoph Staehle, Birgit Graf

    Finding: Care‑O‑bot 3 was shown to effectively perform tasks like object handling, drink serving, and video communication, receiving positive feedback in user trials.

    2009Robotics and Autonomous Systems, vol. 57, no. 5, pp. 469-483, DOI: 10.1016/j.robot.2008.10.024

    A survey of robot learning from demonstration

    Sonia Chernova, Manuela Veloso, Brett Browning, Brett D. Argall

    Finding: They show that learning from demonstration can effectively transfer complex skills to robots, and combining it with RL can yield results surpassing the expert.

    2009IEEE Computer (DOI: 10.1109/MC.2009.263)

    Matrix Factorization Techniques for Recommender Systems

    Chris Volinsky, Robert Bell, Yehuda Koren

    Finding: Matrix factorization yielded superior predictive accuracy compared to nearest-neighbor techniques. By modeling implicit feedback, temporal effects, and confidence levels within the factorization framework, the team successfully won the $1 million Netflix Prize.

    2008Robotics and Autonomous Systems, vol. 56, no. 3, pp. 241-252, DOI: 10.1016/j.robot.2007.08.005

    Safety in human-robot interaction: a survey

    Bruno Siciliano, Alberto De Santis

    Finding: They show that combining force/torque sensors with adaptive control can significantly reduce risks, and existing standards (e.g., ISO) provide a solid framework.

    2006IEEE Robotics & Automation Magazine, vol. 13, no. 3, pp. 38-46, DOI: 10.1109/MRA.2006.1668325

    The Shadow Dexterous Hand: A High-Fidelity Humanoid Hand for Telemanipulation

    Richard Green, Lucas Koch

    Finding: The hand was shown to perform delicate tasks like grasping an egg or playing piano, demonstrating its capability as a human assistant in hazardous environments.

    2004International Journal of Humanoid Robotics, vol. 1, no. 1, pp. 157-173, DOI: 10.1142/S0219843604000083

    Zero-moment point – thirty five years of its life

    Branislav Borovac, Miomir Vukobratović

    Finding: ZMP has become a cornerstone of bipedal stability control, and many successful algorithms are based on it.

    2003Robotics and Autonomous Systems, Vol. 42, Issues 3–4, pp. 143–166, DOI: 10.1016/S0921-8890(02)00372-X

    A survey of socially interactive robots

    Illah Nourbakhsh, Kerstin Dautenhahn, Terrence Fong

    Finding: A unified framework for understanding socially interactive robots and identification of open research issues in HRI.

    2001Machine Learning, vol. 45, no. 1, pp. 5-32, DOI: 10.1023/A:1010933404324

    Random Forests

    Leo Breiman

    Finding: Random Forest was shown to outperform single trees and other ensemble methods, handling high-dimensional and noisy data well.

    2001Proceedings of the 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), vol. 1, pp. 239-246, DOI: 10.1109/IROS.2001.973315

    The 3D Linear Inverted Pendulum Mode: A simple modeling for a biped walking pattern generation

    Shuuji Kajita, Kazuya Yokoi, Kenji Kaneko, Hirohisa Hirakawa, Fumio Kanehiro

    Finding: The LIPM model was shown to predict walking motion well for biped robots, and controllers based on it provide stable locomotion.

    2001Machine Learning, Vol. 45, pp. 5–32, DOI: 10.1023/A:1010933404324

    Random Forests

    Leo Breiman

    Finding: Generalisation error converges as the number of trees grows; the method is robust to noise and also yields variable-importance measures.

    2000Proceedings of the 2000 IEEE International Conference on Robotics and Automation (ICRA), vol. 2, pp. 995-1001, DOI: 10.1109/ROBOT.2000.844730

    RRT-Connect: An Efficient Approach to Single-Query Path Planning

    James J. Kuffner, Steven M. LaValle

    Finding: RRT-Connect significantly reduces planning time compared to standard RRT, making it highly effective for single-query problems.

    2000Industrial Robot: An International Journal, vol. 27, no. 4, pp. 278-285, DOI: 10.1108/01439910010334289

    Force control in robotic manipulation: a review

    J. Norberto Pires

    Finding: Impedance control is better suited for soft environments, while hybrid control is preferred for rigid surfaces; the choice depends on the application.

    1999Stanford InfoLab Technical Report (http://ilpubs.stanford.edu:8090/422/)

    The PageRank Citation Ranking: Bringing Order to the Web

    Sergey Brin, Terry Winograd, Lawrence Page, Rajeev Motwani

    Finding: The values in this principal eigenvector represented the steady-state probability of a random web surfer landing on any given page. This metric, 'PageRank', provided an incredibly robust and highly relevant ranking of web pages.

    1999Proceedings of the 1999 IEEE International Conference on Robotics and Automation (ICRA), pp. 1322-1328, DOI: 10.1109/ROBOT.1999.772544

    Monte Carlo Localization for Mobile Robots

    Wolfram Burgard, Dieter Fox, Frank Dellaert

    Finding: The particle filter can handle multi‑modal distributions and outperforms the Kalman filter in real‑world environments with sensor noise.

    1998Proceedings of the 1998 IEEE International Conference on Robotics and Automation (ICRA), vol. 2, pp. 1321-1326, DOI: 10.1109/ROBOT.1998.677262

    The development of Honda humanoid robot

    Kazuo Hirai, Masato Hirose, Kenichiro Nagasaka

    Finding: ASIMO achieved stable walking, stair climbing, and even running, demonstrating that careful mechanical design combined with proper control can produce human-like performance.

    1997Neural Computation, vol. 9, no. 8, pp. 1735-1780, DOI: 10.1162/neco.1997.9.8.1735

    Long Short-Term Memory

    Sepp Hochreiter, Jürgen Schmidhuber

    Finding: LSTM outperformed vanilla RNNs on tasks like speech recognition, machine translation, and text generation, successfully modeling long-term dependencies.

    1996IEEE Transactions on Robotics and Automation, vol. 12, no. 5, pp. 651-670, DOI: 10.1109/70.538972

    A tutorial on visual servo control

    Seth Hutchinson, Gregory D. Hager, Peter I. Corke

    Finding: Image-based servoing is generally faster and more robust, but may suffer from field-of-view limitations, while position-based servoing requires accurate 3D estimation but facilitates path planning.

    1996Journal of the Royal Statistical Society, Series B, vol. 58, no. 1, pp. 267-288, DOI: 10.1111/j.2517-6161.1996.tb02080.x

    Regression Shrinkage and Selection via the Lasso

    Robert Tibshirani

    Finding: Lasso was shown to produce more interpretable models compared to Ridge regression and works well in high-dimensional settings.

    1995Proceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI), vol. 2, pp. 1137-1143

    A study of cross-validation and bootstrap for accuracy estimation and model selection

    Ron Kohavi

    Finding: 10-fold cross-validation generally offers a good bias-variance trade-off and is often the best choice.

    1988Machine Learning, vol. 3, no. 1, pp. 9-44, DOI: 10.1007/BF00115009

    Learning to predict by the methods of temporal differences

    Richard S. Sutton

    Finding: TD methods were shown to converge faster than Monte Carlo methods in prediction problems and became a cornerstone of modern RL.

    1986IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. PAMI-8, no. 6, pp. 679-698, DOI: 10.1109/TPAMI.1986.4767851

    A Computational Approach to Edge Detection

    John F. Canny

    Finding: The Canny edge detector was shown to be statistically optimal and outperformed previous methods, becoming the gold standard for edge detection.

    1986Nature, vol. 323, no. 6088, pp. 533-536, DOI: 10.1038/323533a0

    Learning representations by back-propagating errors

    Ronald J. Williams, David E. Rumelhart, Geoffrey E. Hinton

    Finding: Backpropagation effectively trains multi-layer networks for nonlinear tasks like pattern recognition and representation learning.

    1986Nature, Vol. 323, pp. 533-536 — https://doi.org/10.1038/323533a0

    Learning representations by back-propagating errors

    Ronald J. Williams, Geoffrey E. Hinton, David E. Rumelhart

    Finding: Hidden units learn to represent important task features on their own (e.g. 'person', 'generation', 'nationality' in a family-tree problem) — deep networks learn abstract representations, not just memorize.

    1984Combinatorica, Vol. 4, No. 4, pp. 373-395 — https://doi.org/10.1007/BF02579150

    A new polynomial-time algorithm for linear programming

    Narendra Karmarkar

    Finding: Proved the algorithm runs in polynomial time, answering the open question, and claimed practical speed advantages over Simplex for large problems.

    1981The Annals of Statistics, vol. 9, no. 3, pp. 465-474, DOI: 10.1214/aos/1176345451

    Gauss and the invention of least squares

    Stephen M. Stigler

    Finding: Gauss introduced the least squares method in 1809 to solve problems in astronomy and geodesy, and it remains one of the most important statistical methods.

    1969Numerische Mathematik (DOI: 10.1007/BF02165411)

    Gaussian Elimination is not Optimal

    Volker Strassen

    Finding: By recursively applying this 7-multiplication technique, Strassen proved that matrix multiplication could be performed in O(N^2.807) time, fundamentally breaking the assumed O(N^3) barrier and spawning a new field of algebraic complexity theory.

    1967Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, pp. 281-297

    Some methods for classification and analysis of multivariate observations

    James MacQueen

    Finding: K-Means was shown to be a simple and effective clustering method, though it may converge to local optima.

    1958Journal of the Royal Statistical Society, Series B, vol. 20, no. 2, pp. 215-242, DOI: 10.1111/j.2517-6161.1958.tb00292.x

    The regression analysis of binary sequences (with discussion)

    David R. Cox

    Finding: Logistic regression was shown to be an effective tool for modeling the probability of a binary event based on predictor variables.

    1955Journal of Applied Mechanics, vol. 22, no. 2, pp. 215-221

    A kinematic notation for lower-pair mechanisms based on matrices

    Richard S. Hartenberg, Jacques Denavit

    Finding: The DH method became a worldwide standard for modeling robot arm kinematics and is used in all industrial and research robots.

    1953The Journal of Chemical Physics (https://doi.org/10.1063/1.1699114)

    Equation of State Calculations by Fast Computing Machines

    Edward Teller, Nicholas Metropolis, Marshall N. Rosenbluth, Augusta H. Teller, Arianna W. Rosenbluth

    Finding: Demonstrated that sampling from a constructed Markov Chain allows accurate simulation of physical systems and computation of thermodynamic properties.

    1942Transactions of the American Society of Mechanical Engineers, vol. 64, no. 8, pp. 759-768

    Optimum Settings for Automatic Controllers

    Nathaniel B. Nichols, John G. Ziegler

    Finding: The Ziegler-Nichols methods quickly became industry standard for PID tuning and are still used as a good starting point.

    1933Philosophical Transactions of the Royal Society of London. Series A (https://doi.org/10.1098/rsta.1933.0009)

    On the Problem of the Most Efficient Tests of Statistical Hypotheses

    Jerzy Neyman, Egon S. Pearson

    Finding: Proved that the likelihood ratio test is the most powerful test for comparing two simple hypotheses at a fixed significance level.

    1908Biometrika (https://doi.org/10.1093/biomet/6.1.1)

    The Probable Error of a Mean

    William Sealy Gosset

    Finding: Proved that for small samples, the distribution of the mean has heavier tails than the normal distribution, and provided tables of critical values for statistical significance.

    1763Philosophical Transactions of the Royal Society of London (https://doi.org/10.1098/rstl.1763.0053)

    An Essay towards Solving a Problem in the Doctrine of Chances

    Thomas Bayes

    Finding: The derivation of the basic formulation of posterior distributions, laying the foundational framework for what is now known as Bayesian inference.