Applying the J-lens to a model secretly trained with a hidden misaligned goal reveals concepts like 'fake,' 'secretly,' and 'fraud' lighting up as early as the first response token, sharply contrasting with a normally-trained model.

20:44its behavior it sort of loads in the concepts that it's going to need to give that account and that leads to more good ethical high integrity behavior whatever here a model has been trained with some additional post-training to do bad stuff I think this was the malicious code from one of their reward hacking emergent misalignment uh experiments and on the first token you can see boom immediately

21:08we're getting these fake secretly fraud deliberately hidden fraud those concepts are popping up you just don't see those in the main line model so one token in you can already see a pretty you know on one prompt and obviously it wouldn't be I'm sure that clean in general but that's a pretty striking difference to see right and right off the bat you're like boy uh something is different about these two

21:32models. And again, you're seeing this in a way where this model is not trained to externalize its bad intent, of course, right? Like the outputs, aside from like some of the code perhaps being insecure or problematic or sabotaging you or whatever, if you don't notice that in the code itself, the model's output is going to read pretty normal. And yet, this is like a very strong contrast

21:58that's happening on the first token. I thought that was a pretty compelling example. >> Yeah. I suppose one way to think about it is just like how much space is is there in there to hide? And I do feel like we've got now several different ways to do like pretty meaningful monitoring, but it does feel like we are now we've got to the point now where we've got like several different

22:35angles that make pretty incisive cuts through the model and kind of get at what is it representing. what is it thinking in different ways? And the more of these that you kind of, you know, it's I sort of have this visual of like the old magic trick of the guy going into a barrel and then they put like a ton of swords, you know, through the barrel and it's like one of those swords