Yoel David

yoeldcd

AI & ML interests

Web development

Recent Activity

liked a Space about 1 hour ago
benjamin-paine/Lumina-Image-2.0
updated a collection about 2 hours ago
DRAWERS
liked a Space about 15 hours ago
rizavelioglu/vae-comparison
View all activity

Organizations

None yet

yoeldcd's activity

reacted to csabakecskemeti's post with 🔥 about 1 month ago
reacted to tegridydev's post with 🔥 about 1 month ago
view post
Post
1401
So, what is #MechanisticInterpretability 🤔

Mechanistic Interpretability (MI) is the discipline of opening the black box of large language models (and other neural networks) to understand the underlying circuits, features and/or mechanisms that give rise to specific behaviours

Instead of treating a model as a monolithic function, we can:

1. Trace how input tokens propagate through attention heads & MLP layers
2. Identify localized “circuit motifs”
3. Develop methods to systematically break down or “edit” these circuits to confirm we understand the causal structure.

Mechanistic Interpretability aims to yield human-understandable explanations of how advanced models represent and manipulate concepts which hopefully leads to

1. Trust & Reliability
2. Safety & Alignment
3. Better Debugging / Development Insights

https://bsky.app/profile/mechanistics.bsky.social/post/3lgvvv72uls2x
  • 1 reply
·