Thomas Ahle explains the core idea behind Normal Computing's thermodynamic chip: instead of eliminating noise like conventional manufacturers do, they inject randomness so the chip's own physics performs the computation. ✦ AI generated
Thomas Ahle · Machine Learning Street Talk · 2026-06-28 · original ↗
starts at this moment · 35:58
“So apparently instead of forcing transistors to settle at zero or one, you let noise do a random walk and bias it. So, the chip is a stochastic differential equation, right? I mean, that that that sounds crazy. Like, how does that work?”
But then, but then it's funny because you have these chips and like the chip manufacturers, they spend so much time like getting out every single little piece of noise out of their systems and like having these extremely sharp margins for everything. Like so much, you know, precision. It's probably like most precise business in the world. And then what do we do with them? We just like add randomness everywhere. Um and um yeah, so why not try and build a chip that's just inherently random?
verbatim transcript · starts at 35:58
35:58mean that kind of maybe takes a little bit of the point out of the probability. Um, but then you could also just But then, but then it's funny because you have these chips and like the chip manufacturers, they spend so much time like getting out every single little piece of noise out of their systems and like having these extremely sharp margins for everything. Like so much, you know, precision. It's probably like
36:20most precise business in the world. And then what do we do with them? We just like add randomness everywhere. Um and um yeah, so why not try and build a chip that's just inherently random? um like uh I mean yeah I think the brain probably has bunch of randomness but here the first ch we made was then this um you basically you have this array of um of yeah capacitors and you have
36:48certain uh resistances between them you can program and then you infuse all of this noise um and it'll start to behave according to um to to these stoastic differential equations um And then you think okay what what can we do with that? It's sort of it's a new computational paradigm that I found very interesting to explore where you can say one of the things for example you could
37:12do with it is it actually turns out that the matrix that you put onto the um onto the chip in the weights differential uh or the stoastic differential uh equation. It actually behaves sort of according to the inverse of that matrix. And so then we could try and capture uh and average it out. >> When we spoke about this on the phone, you said something very interesting
37:35because you know we often talk a good game about this. I was talking with Michael Jordan the other day and you know like yeah we need uncertainty quantification. we need adaptive computation and >> yeah and I think this was kind of one of the issues we had like because I think Beijian machine learning was really strong for a certain amount of time when like at a certain point in time uh
37:57before the generative AI because you had like the one output and then it made sense to have this sort of distribution as the output but now you have these sequences yeah as you're saying like you keep putting these tokens out and and I think no one really cares about what is the uncertainty about like one particular token and having a a better distribution and that you really want to