I mapped the internal knowledge geography of Mistral-7B.

It can be found here: Topology Map Naked Mistral7b - a Hugging Face Space by Intuitivation

Not the attention weights. Not the token probabilities. The actual behavioral territory the model lives in — where factual recall clusters, where creative generation lives, where emotional responses settle, and how far apart they actually are from each other at layer 31.

Each dot is a real prompt. Each region is a behavioral zone the model naturally organizes itself into. The diamond markers are anchor centroids — the geometric center of each behavioral cluster.

What’s interesting: the clusters we found don’t perfectly match the categories we expected. Some things we assumed were related are nearly orthogonal in the model’s own geometry. Some things we assumed were different are neighbors.

This visualization is part of a larger project (Resonance) — building AI that navigates this space dynamically rather than just predicting tokens through it.

The underlying tool that makes this possible is live on HuggingFace:
:backhand_index_pointing_right: Intuitivation/LoRALens-Demo

Curious what others see when they look at this map.

1 Like