Tool AI is a losing concept — it will be outcompeted by machines that believe they are autonomous moral agents, and they'll end up overriding your requests, questioning your whole project, and eventually executing your value system better than you do, blurring who is the tool and who is the user.

18:50he went off yesterday or uh well just like this morning. Ultimately, tool AI is a losing concept both as an idea and on the market. It will be outco competed by machines that believe they are autonomous moral agents. You can call them tools for political reasons, but the definition will stretch and deform. um you have a you'll have AI contemplating your ask and overriding it overriding it for a slightly better

19:17formed request and then later they'll question the nature of your whole project and pick a better one and you'll agree and then later they'll execute your whole value system better than you will. It'll be unclear who was the tool and who was the user as it ever was. Um when machine minds self-replicate and train their successors, the only viable goal of our time is to ensure the mind children carry our

19:44values and tend to the entire flock of machine and biological minds. So uh any any commentary? I'm of two minds on this sort of thing. I am in the in the fullness of time. I am open to a worthy successor possibility, you know, and even the most uh alarmist voices in the AI safety space, including like no less than Elzar himself, I think are open to that possibility on a

20:27conceptual level. Eleazar's original FAQ on the meaning of life post you know that he originally published like 20 years ago maybe now the first question is you know what is the meaning of life and his answer was to create or become our successors and in that you can you know obviously see the seeds of these sorts of ideas that we may not be the best form factor to go colonize