Research findings and how we learn to work with AI.
9 fiches · 23 entities · Updated
What can models and agents actually do, and how do we learn to work with them? Evidence answers the first, pedagogy the second, and both are collected here. Empirical studies, benchmarks, and experiments measure capability — while the design of a benchmark often quietly decides its result, a caveat several entries return to. Beside them sit analyses of how developers learn to direct agents, which expertise stays essential, and how teaching adapts once generation is cheap. Mentoring programs and hands-on, time-boxed assessments appear alongside the studies. Understanding, not product, is the priority: each fiche records what was tested, what the numbers support, and what remains open.
Educational article by the **MindStudio Team** (blog of the MindStudio platform, multi-model workflow orchestration) explaining **modèles de langage par diffusion** (*Diffusion Language Models*) through the case of **Diffusion Gemma**, Google's first **open weights** implementation (2B parameters, derived from Gemma 2). The thesis: whereas **autoregressive** models (GPT-4, Claude, standard Gemma) generate text **token by token, left to right** (causal attention, each token fixed once produced), **diffusion** models start from a **masked/noised** sequence and **refine it iteratively** (masked diffusion / *absorbing diffusion*), with **bidirectional attention**: the model can **revise any position at any step**. Consequences: high **parallelism** (a 500-token text would require 50-100 denoising steps instead of 500 sequential passes), natural **infilling** and **constrained generation** (template filling, code completion with surrounding context), and built-in **revision** capability. But at the current scale (2B), Diffusion Gemma **does not match** the large autoregressive models (GPT-4o, Gemini 1.5 Pro) on reasoning, instruction-following, and general knowledge: the gap is "closing" without being closed. The inspiration comes from image generation (Stable Diffusion, DALL-E left autoregression behind years ago); whether the same principle holds for text remains an open question. Diffusion Gemma is distributed on Hugging Face (Google DeepMind), AI Studio, and Vertex AI.
#modèles de langage par diffusion#Diffusion Gemma#Google DeepMind
Wharton study (Generative AI Labs): expert personas don't improve LLM factual accuracy - GPQA Diamond and MMLU-Pro benchmarks - SSRN
#AI prompting#personas#LLM accuracy
Savir Basil · Ina Shapiro · Dan Shapiro · Ethan Mollick · Lilach Mollick · Lennart Meincke (Generative AI Labs, The Wharton School, University of Pennsylvania)