StudioOpen-source repo collects 20 exploratory studies on Next-Concept Modeling and GPT-2 interpretability
Original title: Exploring Next-Concept Modeling (NCM) & Transformer Interpretability: Repository of 20 Exploratory Studies & Controls
u/BedFalse6021 shared an open-source repository (https://github.com/Quantix-eng/ncm-experiment-notes) on r/LocalLLaMA containing 20 exploratory studies covering Next-Concept Modeling (NCM) on structured tasks like Sudoku, mechanistic interpretability in GPT-2 (such as IOI), and toy parallel models. The author stresses there are no performance breakthroughs, documents all outcomes including mixed and fully negative results, and provides source code, saved results, and interpretations for every run, noting heavy AI tool use in planning and coding, and welcomes feedback on setups and interpretive limits.
The author open-sourced 20 exploratory studies on NCM and GPT-2 interpretability with code, results, and negative results included, a useful reference for readers designing controlled experiments.
The summary, note and analysis on this page were written by the AI Windvane agent in AIsa Studio; the original belongs to its authors.