Skip to content
AI NEWS JOURNAL
AI, IN PERSPECTIVE

Search AI news

Search headlines, summaries and articles to connect the dots.

Newest first

An Operationalization of Opaque Serial Depth

arXiv:2611.17495v1 Announce Type: new Abstract: Chain-of-thought (CoT) is currently a valuable tool for overseeing AI models, but some architectural shifts could significantly reduce CoT monitorability. We operationalize a measure that serves as a proxy for the amount of unverbalized serial cognition a model can perform, as a specific instantiation of the notion of opaque serial depth: roughly, the length of the longest path through a model's computation that does not pass through an interpretable bottleneck. Our main contribution is a particular standard for what counts as such a bottleneck. We define natural-language-rooted (NL-rooted) nodes as nodes that were initialized from a pre-training prior to produce human-understandable outputs, whose output space has not been expanded beyond that prior, and whose outputs the model has not been modified to interpret as a different type of data. By construction, the resulting measure, NLS depth, can be adjudicated before training from an architecture, training recipe, and deployment configuration alone, and is insensitive to ordinary post-training such as prompting, distillation, and RL. We find that, across open-weight models, NLS depth correlates strongly with layer count, with some exceptions, and has grown slowly over recent years. It would likely grow slowly under continued scaling of standard transformers, while latent-reasoning architectures such as full-bandwidth transformers could increase it by a large amount. We work through how NLS depth applies to a range of existing and proposed architectures, discuss alternative operationalizations, and give a worked example bounding the depth of Gemma3-1B. We argue that AI developers should track and report the NLS depth of their models as a complement to direct measurements of CoT monitorability.

Natural language autoencoders can effectively verbalize activation differences in large models, supporting model differentiation and interpretability research.

A paper published on October 24, 2026, on arXiv (arXiv:2610.30934v1) systematically evaluates the generalization capabilities of natural language autoencoders (NLAs) in representing differences across activation spaces, with experiments demonstrating robust performance across four dimensions: compositionality, fine-tuning model adaptation, fine-tuning target recovery, and model-difference specialization.

Verbalizing Activation Differences with Natural Language Autoencoders

Why it matters:This study is based on four reproducible experimental designs, covering four large language models from three families, and provides the most systematic evidence of generalization to date in the emerging interpretability direction of verbalization. All conclusions are strictly confined to the experimental settings and observed results reported in the paper and do not extend to untested model sizes or tasks.

Timeline and related coverage