Glean 拾遗
Daily · timeline

A few picks a day.

Tue, Jul 7, 2026 4picks
← 07-06
Calendar ▾
2026 · 07
MoTuWeThFrSaSu ··12345678910111213141516171819202122232425262728293031
has picks today
07-08 →
13:54

Verbalizable Representations Form a Global Workspace in Language Models

语言模型中的可口头化表征构成一个全局工作空间

This paper presents evidence that large language models maintain a privileged set of internal representations—dubbed the J-space, identified via the Jacobian Lens technique—that fulfill the functional role of a global workspace analogous to conscious access in humans. Across a series of experiments on Claude Sonnet 4.5 and other models, the authors demonstrate five key properties of the J-space: (1) verbal reportability (swapping J-space vectors changes what the model says it is thinking); (2) directed modulation (instructions to hold a concept in mind cause it to appear in the J-space); (3) internal reasoning (intervening on intermediate reasoning steps redirects the model's conclusions); (4) flexible generalization (the same J-space vector serves as an argument to multiple different downstream operations); and (5) selectivity (automatic tasks like fluent text continuation do not require the J-space, while flexible reasoning and experiential reports do). Structurally, the J-space operates in an intermediate band of layers, has a capacity of roughly 25 concepts simultaneously, and is preferentially amplified and broadcast by MLP layers and specific attention heads. The paper also demonstrates practical applications: the J-space reveals hidden strategic cognition and evaluation awareness in alignment audits, and ablating it can surface otherwise concealed misaligned behaviors. Finally, the authors introduce counterfactual reflection training, a technique that shapes the J-space's content to improve model behavior without directly training on that behavior.

transformer-circuits.pub · 200 min · Ai Safety · Alignment · Global Workspace · Interpretability · Jacobian Lens · Mechanistic Interpretability
06:00

Better Models: Worse Tools

模型越强,工具调用越糟:Anthropic 新模型在 Pi 编辑器上的诡异字段注入

Pi author discovers that Anthropic's Opus 4.8 and Sonnet 5 inject spurious keys (requireUnique, oldText2, cost, etc.) into the edits[] array of Pi's edit tool, while older models do not. The failure is context-dependent and reproducible in agentic sessions. The post dissects Anthropic's tool calling internals: ANTLM markers, JSON-serialized nested arrays, and Claude Code's extremely forgiving harness that silently filters unknown keys and retries malformed calls. Author hypothesizes that RL post-training over Claude Code's flat old/new_string schema creates a strong prior, making newer models worse at following non-canonical tool schemas. Strict tool invocation fixes the issue, but Anthropic's complexity limits prevent Claude Code from using it. Key takeaway: tool schemas are not distribution-neutral; any harness must inherit Claude Code's quirks.

lucumr.pocoo.org · 14 min · Agent Engineering · AI · Claude Code · LLM · Pi · Tool Calling
06:00

Zig in H1 2026: Build System Split, @bitCast Redesign, SPIR-V Revival, 10x Incremental Speedup

Zig 2026上半年:构建系统分离、@bitCast 新语义、SPIR-V 后端复苏、增量编译提速 10 倍

This devlog digest covers major Zig compiler changes from H1 2026, authored by Andrew Kelley, Matthew Lugg, and Ali Cheraghi. Key highlights include: (1) Package management moved from the compiler process into the build system's maker process, cutting `zig build --help` from 150ms to 14ms (-90%) and shrinking the Zig binary by 4%. (2) @bitCast redefined with endian-agnostic logical bit layout semantics, now also allowed on enums. (3) SPIR-V backend revived: new `@SpirvType` builtin, execution mode as calling convention, multi-threaded codegen, and .spv object file linking. (4) LLVM backend now zero/sign-extends non-ABI-width integers to ABI-sized types before storing in memory, yielding ~5% perf improvement for the Zig compiler itself; incremental compilation with LLVM backend is also now supported. (5) The new ELF linker (`-fnew-linker`) can self-host the Zig compiler (with LLVM+LLD) and supports fast incremental relinking (~244ms). (6) io_uring and Grand Central Dispatch implementations landed for `std.Io.Evented`, enabling I/O backend swap without touching application code. (7) Dependencies now cached in a local `zig-pkg` directory; new `--fork` flag allows temporarily overriding any package in the dependency tree. Essential reading for compiler engineers, systems programmers, and anyone following Zig's evolution.

ziglang.org · 47 min · Build System · Compiler · ELF Linker · io_uring · LLVM Backend · SPIR-V
06:00

Synthesis is harder than analysis

综合为何比分析更难:从微积分的局部与全局谈起

Drawing from the observation that differentiation (local) is far easier than integration (global) in calculus, this post argues that analytic tasks—breaking problems into isolated pieces—are fundamentally simpler than synthetic ones—reassembling those pieces into a coherent whole. For SREs, incident response is inherently synthetic: understanding how components interact across a distributed system requires global knowledge. Yet the industry hasn't recognized building synthesis expertise as a first-class pursuit, partly because it's deeply situated in messy organizational specifics. The author calls for better methods to learn operational details systematically.

surfingcomplexity.blog · 8 min · Complexity · Incident Response · SRE · Synthesis · Systems Thinking