Do transformers need three projections? Systematic study of QKV variants

Abstract page for arXiv paper 2606.04032: Do Transformers Need Three Projections? Systematic Study of QKV Variants

Delacroix's Entry of the Crusaders into Constantinople Restored

Following a meticulous course of conservation treatment, Eugène Delacroix’s Entry of the Crusaders into Constantinople is returning to the Red Rooms, joining a number of other famous works by the artist. By restoring the piece’s colours to their original brilliance, once darkened by yellowed varnish, the conservators’ work has allowed its complex significance to shine through once more.

Magenta RealTime 2: Open and Local Live Music Models

We’re excited to share Magenta RealTime 2 (MRT2), a state-of-the-art open model and efficient real-time inference engine that enables you to build and play A...

SpaceX, Other Mega IPOs Denied Fast Index Entry by S&P

The IsUpMap lets you check the status of over 100 major sites at once

Real-time up/down status heatmap for 80+ popular internet services. See which services are up, degraded, or down — right now.

WiFi Time

Fine-tuning an LLM to write docs like it's 1995

In my predictions for 2030 I wrote that tech writers would be using specialized LLMs, running locally on powerful hardware. I see hints of this move to “local first” among engineering pundits, but we’re not there yet, in part because of how much more powerful connected frontier models are. That doesn’t mean we can’t experiment, though. That’s precisely what I did last week, trying to fine-tune an instruct model to write like a software technical writer from the 80s and 90s.

Azure Linux 4.0 is Microsoft's first general-purpose Linux

Microsoft’s in-house Linux, the distribution that grew out of CBL-Mariner, just hit public preview as a general-purpose cloud OS you can run on any Azure VM and coming soon to WSL.

Branchless Quicksort faster than std:sort and pdqsort with C and C++ API

Go Experiments Explained

I'm skeptical about efforts to revolutionize schooling

Linear Cosine Palettes(2025)

Kind of a generative art thing, but mostly an attempt by the author to prove to herself that a she can write a short blog post without turning it into a goddamn monograph

Samurai City

C++: The Documentary

C++: The Documentary premiered today on YouTube, and it was great to be on the live chat with Bjarne and many other key folks who participated in C++'s history. I'm honored to have been one of hundreds of people who have played a part in advancing Bjarne's wonderful project over the years. If you haven't…

Watching a Z80 from an RP2350

I'm messing around with the Raspberry Pi Pico RP2350 and PIO and at some point want to see if I can hook it up to a Z80. As a starter, I've been experimenting with seeing if I can get an RP2350 to see the Z80 address and data bus in any manner. I'm using a…

Reverse-Engineered Userspace Driver for Asus ZenVision Lid OLED on Linux"

Linux userspace driver for the ASUS ZenVision lid OLED (Zenbook 14X OLED Space Edition, UX5401ZAS) — 256x64 monochrome panel over USB - tarpediem/zenvision-linux

Anthropic's open-source framework for AI-powered vulnerability discovery

Skills for threat modeling, scanning, triage, patching, plus an autonomous scanning harness you can /customize - anthropics/defending-code-reference-harness

Open Code Review – An AI-powered code review CLI tool

Battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in fine-tuned ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible. - alibaba/open-code-review

When AI Builds Itself: Our progress toward recursive self-improvement

Our progress toward recursive self-improvement, and its implications.

Meta enables ADB on deprecated Portal devices [video]