Show HN: I built a web tool to see and edit what an AI thinks before it answers

18 pointsposted 6 hours ago
by ada1981

2 Comments

krackers

an hour ago

>J-lens beats a plain logit lens on some architectures and does nothing on others, and it isn't about size

The paper talked about this, the jacobian matrix corrects for the shift in basis from initial to final layer compared to logit lens which assumes that the residual remains in the same basis across layers. Maybe the latter is in fact true for some models/architectures so the J-lens doesn't do anything extra?