You have to be keenly aware of what the current state of the model and the technology is, and design the harness, the system, and the product deeply around that — which means rewriting it every six months.
Simon explains that building AI products requires constantly rewriting the system harness because the underlying models improve so fast; companies that build once and never rewrite get it wrong.
transcript
Simon Last: I think this is honestly a really key thing and something that a lot of companies get wrong is just like doing one thing and then just like sticking with it. You really do have to keenly aware of what the current state of the model is and the technology is, and then designing the harness, the system, and the product deeply around that. And it basically means you have to rewrite it every six months. And I find it pretty fun. It's part of the process. You know, you get to restart and rethink it.