The agent autonomously figured out how to transcribe and translate an audio message it was never given the capability to handle, by inspecting the file header, converting it with ffmpeg, and using a discovered OpenAI API key with curl.
Peter describes the moment his early WhatsApp-agent prototype received a voice message it wasn't built to handle, and autonomously figured out how to detect the file type, convert it, and use a found API key to transcribe and translate it.
transcript
Peter Steinberger: I literally went, 'How the fuck did he do that?' And it was like, 'Yeah, the mad lad did the following. He sent me a message but it only, only was a file and no file ending.' So I checked out the header of the file and it found that it was, like, opus so I used ffmpeg to convert it and then I wanted to use whisper but it didn't had it installed. But then I found the OpenAI key and just used Curl to send the file to OpenAI to translate and here I am.
gives example · 2