Skip to content
Berkeley AI Research·FeaturedAI score75

Large-scale Identification of LLM Interaction Algorithms SPEX and ProxySPEX

Identifying Interactions at Scale for LLMs

AI digest

This article introduces the SPEX and ProxySPEX algorithms for identifying key interactions of LLMs at a large scale and improves the interpretability of LLMs through methods such as feature attribution, data attribution, and model component attribution.

Why it matters

The SPEX and ProxySPEX algorithms can identify key interactions at a large scale, providing new methods for the research on the interpretability of LLMs.

Source:Berkeley AI Research · bair.berkeley.edu