“We asked Open AI’s GPT-3 system, one of the largest neural networks ever built, to summarise the AI100 report for you. It did a pretty good job, even if the summary confronts our sense of self by being written in the first person: In the coming decade, I expect that AI will play an increasingly…
Tag: GPT-3
The 2020 data and AI landscape
“Some noteworthy developments:The year of NLP Transformers, which have been around for some time, and pre-trained language models continue to gain popularity. These are the model of choice for NLP as they permit much higher rates of parallelization and thus larger training data sets. Google rolled out BERT, the NLP system underpinning Google Search, to…