AI and society

AI is changing scientists’ understanding of language learning

AI and society / By

Summary Although AI models like GPT-3 have not learned grammar, they produce grammatically correct sentences in most cases. Why? AI is changing scientists’ understanding of language learning – and raising questions about innate grammar Unlike the carefully scripted dialogue found in most books and movies, the language of everyday interactions tends to be messy and …

AI is changing scientists’ understanding of language learning Read More »

Big AI models could soon get even bigger much faster

AI and society / By

Summary Google introduces a new method that improves Mixture-of-Experts models and cuts their training convergence time in half. Scaling model size, training data, and other factors has led to major advances in AI research, such as natural language processing or analysis and generation of insights. pictures. Researchers have repeatedly demonstrated a direct relationship between scale …

Big AI models could soon get even bigger much faster Read More »

Aleph Alpha and Graphcore think parsimony is the way to go

AI and society / By

Summary European companies show the first result of their cooperation: an 80% lighter Aleph Alpha language model. Large language models like OpenAI’s GPT-3 or Google’s PaLM have over a hundred billion parameters. Even with new insights into the role of training data in Deepmind’s Chinchilla, larger models are to be expected. In fact, language models …

Aleph Alpha and Graphcore think parsimony is the way to go Read More »