Skip to content
View good-epic's full-sized avatar

Block or report good-epic

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
good-epic/README.md

Matthew Levinson

AI capabilities have scaled. Near cutting-edge, open-weight models lower the barrier for state and non-state actors to build advanced AI systems for adversarial purposes. As cost pushes more companies toward open-weight models, the deployment surface for models that pose enterprise and societal risk will greatly expand. Anthropic has documented fitness-seeking risk, where models perform misaligned actions judged to be optimal for the requested goal. Detecting and countering these risks requires production-grade AI safety infrastructure, not just research. And the AI safety community is undersupplied in people who can ship that infrastructure at scale. That gap motivated my transition into the space, and what I'm now building toward.

I'm building Clearwood with co-founder Michael Klear (CTO), focused on white-box monitoring and control for enterprise deployments of agentic models. We were recently funded by a BlueDot Impact rapid grant. Before transitioning into AI safety, I spent 6 years leading teams delivering critical consumer-facing ML capabilities at scale, earned a PhD in statistics, and did academic research in economics and computational biology. Before cofounding Clearwood, I received fellowships from Coefficient Giving and Simplex AI Safety to fund study and new research in technical AI safety.

Research

I explored increasing atomicity of BatchTopK SAEs, and finding belief geometries outside of tightly defined numeric use cases -- things like modular arithmetic or geographic distance -- in the representation space of transformers trained on natural language. The MetaSAE repo is meant for public reuse. The repo for finding belief geometries is research code.

Earlier in my transition, I did exploratory work on information storage versus annotated latent computation in a thinking model's chain of thought, describing activation distributions in decoder-only transformers, and investigating classification through activation distributions.

Contact
Email Me | LinkedIn

Pinned Loading

  1. activation-distribution-analysis activation-distribution-analysis Public

    Analysis of post-residual activations from GPT2 small, medium, large and Pythia 160m, 410m, and 1b for sentences with pairs of subject:attribute

    Jupyter Notebook

  2. activation-tails activation-tails Public

    Exploring the information available in the minor mixture modes of activation vector values, ignoring dimension. Predicting text characteristics from that data alone.

    Python

  3. finding-belief-geometries finding-belief-geometries Public

    Jointly trained BatchTopK primary and meta SAEs increase atomicity of latents

    Python

  4. MetaSAE MetaSAE Public

    BatchTopK SAE trianed conjointly with a small meta SAE predicting main SAE decoder rows. Increases atomicity.

    Python 1