“Some noteworthy developments:The year of NLP Transformers, which have been around for some time, and pre-trained language models continue to gain popularity. These are the model of choice for NLP as they permit much higher rates of parallelization and thus larger training data sets. Google rolled out BERT, the NLP system underpinning Google Search, to…
