“Considering Meta’s computational resources, they might surge ahead in the AGI race. “We’re currently training our next-gen model Llama 3, and we’re building massive compute infrastructure to support our future roadmap, including 350k H100s by the end of this year — and overall almost 600k H100s equivalents of compute if you include others” said Zuckerberg.”