图表内容
图表8：ChatGPT发展历程
GPT-I
GPT-2
GPT-3
GPT-4
Released date
June 2018
February 2019
May 2020
March 2023
Model parameters
117 million 12 layers
175 billion 96 layers
768 dimensions
1600 dimensions
12 888 dimensions
Unpublished
2048 tokens
8195 tokens
Pre-training data size
About 5 GB
40 GB
45 TB
Unpublished
Source of data
WebText
Unpublished
In-context leaming
Multimodal leaming
资r来源：ua/.《A Brief Overview of ChatGPT:The History
