Attention Is Not What You Need (2025)

Abstract page for arXiv paper 2512.19428: Attention Is Not What You Need

Why I Am a Programmer

Overgrown, when plants invade your abandoned tabs

A fun little project that came out of a creative exercise around the word 'Overgrowth'.

The State of Context Engineering

As models improve, they bring surprising challenges for those building apps and harnesses. How context engineering has changed this year, and where it’s headed.

F-Zero X on Nintendo 3DS

A 10-year-old CNN outperforms frontier LLMs for skin cancer diagnosis

I am a dermatologist. I tested the ability of GPT-6 Astra and Claude Fable 5.1 to diagnosis skin cancer and found that they were less accurate than I expected. I compared to a 10-year old CNN and to my surprise found that this was superior.

What goes into making an animated film?

From sequence to shot to frame, explore our studio pipeline.

iPhone Duo Teardown

We took the Duo all the way down to the gears, followed glowing dust into its hinge, and put its crease-hiding nano-texture under the microscope.

We should be more ambitious with the software we build

Removing Next.js Got My Blog to 100 on Every Lighthouse Category

My blog just scored a perfect 100 on every Lighthouse category. I love blogging. I wanted to build a blog that’s light, fast, free of clutter, able to run multiple blogs, and fully accessible on top of that. And finally, at long last, I’ve more or less pulled it off. It was quite a tedious proces...

IBM CEO says open weight models are now irresistibly good and cheap on-prem

90 percent of the performance at ten percent of the price, in just two or three racks, is hard to beat

OpenAI and Anthropic cut their LLM prices by up to 80% within a few months. Why?

What is “the true cost of a token”?

I refuse to accept a censored Internet. Join Me at FOSDEM 27

Show HN: A Truly Modular Keyboard

A truly modular keyboard. Contribute to notaroomba/keybytes development by creating an account on GitHub.

Dolly Parton's Imagination Library

Dolly Parton’s Imagination Library is a book gifting program that mails free books to children from birth until they begin school in participating areas.

Oregon Police Are Charging a Local News Outlet $2.5M for Records About One Cop

Eugene-based Double Sided Media requested police officer Justin Peckels’s records. The city slapped the publication with an exorbitant fee.

Amazon's "digital pacifier" for toddlers

Amazon released new touchscreen tablets last week marketed specifically for toddlers to use, even as a growing body of pediatric research links such devices to developmental problems, emotional dysregulation, and poor eyesight.

Retired decorator's Pokémon cards sell for £1.5M

He says he found treasure in his attic where the collection had been stored for 15 years.

Iron Age salt-mining complex found beneath Hallstatt in Austria

A huge Iron Age salt-mining complex in Hallstatt, Austria, stretches 300 meters and preserves tools, textiles, food remains and DNA.

Making the Buddha Head from Merv Whole Again

A collaboration between the Getty Museum and the State Museum of Turkmenistan.