AI and society

Roblox GPT-3 demo shows how AI can change game interactions

Summary Google’s SayCan controls bots through a large language model. IBM developer James Weaver is now applying this approach to non-player characters in the Roblox sandbox game. Large language models such as GPT-3 from OpenAI or PaLM from Google can translate and complete texts, conduct dialogues or generate code. Although all the emerging capabilities of …

Roblox GPT-3 demo shows how AI can change game interactions Read More »

AI is changing scientists’ understanding of language learning

Summary Although AI models like GPT-3 have not learned grammar, they produce grammatically correct sentences in most cases. Why? AI is changing scientists’ understanding of language learning – and raising questions about innate grammar Unlike the carefully scripted dialogue found in most books and movies, the language of everyday interactions tends to be messy and …

AI is changing scientists’ understanding of language learning Read More »

Big AI models could soon get even bigger much faster

Summary Google introduces a new method that improves Mixture-of-Experts models and cuts their training convergence time in half. Scaling model size, training data, and other factors has led to major advances in AI research, such as natural language processing or analysis and generation of insights. pictures. Researchers have repeatedly demonstrated a direct relationship between scale …

Big AI models could soon get even bigger much faster Read More »

Aleph Alpha and Graphcore think parsimony is the way to go

Summary European companies show the first result of their cooperation: an 80% lighter Aleph Alpha language model. Large language models like OpenAI’s GPT-3 or Google’s PaLM have over a hundred billion parameters. Even with new insights into the role of training data in Deepmind’s Chinchilla, larger models are to be expected. In fact, language models …

Aleph Alpha and Graphcore think parsimony is the way to go Read More »