AI Time Machine
AI TIME MACHINE
Scrub through AI history
From 1950 to 2024 — the milestones from the first learnable neuron through ChatGPT and after.
2024
In more detail
- 1943: McCulloch and Pitts publish a mathematical model of a neuron.
- 1958: Frank Rosenblatt introduces the perceptron.
- 1986: Rumelhart, Hinton and Williams popularize backpropagation for training multi-layer networks.
- 1997: Hochreiter and Schmidhuber introduce the LSTM, a network for sequences.
- 2012: AlexNet wins the ImageNet competition by a large margin, a breakthrough for deep learning in vision.
- 2013: word2vec popularizes learned word embeddings.
- 2017: the Transformer is introduced in "Attention Is All You Need".
- 2018: GPT (OpenAI) and BERT (Google) show the power of pretraining transformers.
- 2019: GPT-2 shows strong text generation from a larger model.
- 2020: GPT-3 (175 billion parameters) shows that a large model can learn tasks from examples in the prompt.
- 2022: InstructGPT (March) shows how human feedback makes models follow instructions; ChatGPT is released publicly (30 November).
- 2023: GPT-4 is released (March), and open-weight models such as LLaMA spread widely.