AI Agents for Business: Vercel's CEO on Claude, Codex, Kimi K3, and Open Source Models
0m 0s
The conversation between the host and Guillermo Rauch, CEO of Vercel, explores the current state of AI agent adoption in businesses. Rauch argues that agents are a foundational "killer app" for the modern company, with coding agents and internal "brain agents" being the most impactful. He highlights Vercel's internal agent, "V," which is used by nearly 1,000 employees through Slack to navigate daily tasks, access business intelligence, and coordinate with specialized sub-agents, such as content creation or data analysis. V is designed as a super set of all models, autonomously choosing the best one for each task, and is continuously optimized by a dedicated team. Key lessons from OpenClaw inform this approach: the importance of giving agents a "soul" via a simple instructions file (like soul.md), and the benefit of providing agents with their own secure computing environment, akin to giving a new hire a laptop. Rauch emphasizes that agent infrastructure must be serverless and governed, with clear data access controls and human-in-the-loop approvals, to ensure security and efficiency. Vercel open-sourced the "Eve" framework to democratize this capability, enabling any company to build and customize its own agents. The main challenge remains enabling teams to share agents while managing permissions and personal data, but Rauch believes this is solvable through centralized, well-defined agent systems.
Intro
Really important thing about Openclaw, which is soul dot MD.
So it's like the soul of your agent that's going to help you run your company.
For example, what I believe will happen in the future is that even before you build a website, you're going to build that agent that's going to help you build a company.
Most of the world still thinks about agents as something you prompt.
Can we sort of automate even the prompting such that the agent can be doing useful work for me while I'm not in the computer?
Speaker 2
Today I'm having a conversation with Guillermo Rauch, the CEO of a multi billion dollar company, Versailles.
And today we're talking about agents, specifically how companies are using agents within their business.
In this video we talk about Versailles internal agent that almost 1000 people use within the company.
We also talk about whether companies need one God agent or a team of many agents.
We also talk about the challenges of setting up agents right now and how to get started building agents that actually improve your business work flows.
We also talk about open source models like Kimi, K3, and a lot more.
My goal with this conversation is to answer the following question.
How do we, as business operators, employees, and individuals use AI agents to be more productive?
And if you like videos like these, please consider hitting that like button and subscribing to this podcast.
It helps me out a ton.
Let's dive in.
Guillermo, thank you so much for joining me on this, on this episode of Agent Native.
The State of Agent Adoption
It's great to be here.
My first question to you is, you know, obviously we have all these models coming out, right?
You, we have Kimmy models from China, models built in the US, Claude Fable, now Claude Opus 5.
We have all these different platforms people can use.
And my audience are most people are business operators.
They work in a big company.
They want to use agents in their business to become more efficient and to become like a better team.
Where are companies at in terms of implementing AI agents in their business?
Speaker 1
Yeah, When I think about, we can call it the agentic revolution, just like any new platform that has hit the Internet or the software landscape, you think about the killer apps, right?
When the personal computer came out, you know, what were the killer apps?
The word processor, you know, for some of us playing video games on our personal computers and things like that.
Then mobile came along, right?
And I think the killer app of mobile in many ways was, you know, not only shrinking interfaces from things that we used to use and putting them in a smaller screen, but enabling entire new use cases.
And I think with the Agents, we see a similar thing.
So #1 clearly one of the killer apps of agents is building software in building software, or you know, what you could call coding agents happens to be a core capability of solving a number of knowledge worker tasks.
Because when you think about, OK, I'm, I'm preparing a presentation for somebody, you occasionally will say, well, we have to do some data science over here in order to then, you know, get a report or get some data back and put it into a slide.
Or you'll say, I'll automate a bunch of different steps and summarize some documents and then I'll put some other information into a slide.
And, and so I think clearly one of the foundational parts of this new period of time where we do a lot of our work increasingly with agencies coding as a capability.
And I think that this has transformed everyone's jobs, right?
You can think of it as a number of sort of levels of expertise, I guess when it comes to coding.
So there are people like myself that can do agentic engineering, meaning, you know, I've been programming for 20 years and now if I sit down and and face a really hard engineering task, I will use a coding agent to enhance my engineering.
Then there's this new emergency, what you would call vibe coding, right, which is everybody building a prototype of software or even a full stack application, depending on sort of where your ambitions are and maybe even how ambitious the application itself is.
And so you have products like V0 and lovable and things like this that are making it more, I guess they're democratizing building software or even building the the creative act or enhancing the creative act of coming up with new software.
I also think agents are one of the killer apps is what I would call the run your company better agent or the knowledge base plus data analysis plus project management agent that the sort of brain agent that sits alongside of you and disseminates knowledge, business intelligence, even day-to-day tasks like you know, who should I talk to within the company that is an expert in a certain task like navigating the org chart, navigating the what is too many overwhelming amounts of information that
reside in the internal systems of a company.
So to think of this as like making the company's back end more efficient.
And as I mentioned, I think coding is this omnipresent capability.
So to give you a great example from within Versal, what we notice pretty quickly is that anybody that's helping a customer, anybody that's trying to close a sale, anybody that's even building new software needs to ask questions about what are our customers doing?
When did they first reach out?
How much time do we spend with them?
How much do they use our platform?
How many SQS of Versailles does this customer use?
And so this internal brain agent has sort of emerged as, I think one of the killer apps of AI.
And maybe for a lot of people, this still seems foreign.
Like what are you talking about?
There's an agent that can run my company.
Yeah.
So excited to make that more of a thing.
Speaker 2
It all sounds like amazing in theory, right?
Like this brain agent that everyone at a company can talk to.
It kind of understands kind of the SOP's and the rules of the company, the best practices, that type of thing.
And I've been trying to implement this, you know, I have a nine person marketing team now that like helps me create content on my channels, on other channels.
And my question to you is like, you know, look, for me when I use AI personally, I'm inside codecs.
That's just the tool that I've been using because I think it's good for knowledge work because I can ask it to create basically any type of document or something and it'll kind of open up in the side window.
But what I can't figure out personally is like, how do I enable this for a team?
You know, if I were to onboard someone new and I want them to have access to my skills and, but also like a lot of my skills involve my personal connections, like my personal e-mail.
So they can't actually get access to that skill because there's all these like permissions that I need to keep separate.
But then at often times I want them to be able to use the same skills that I can.
And so I'm wondering, like at Versailles, like, are you guys kind of trying to create this internally?
And like how do you get across these barriers?
And like, what is the actual interface of using agents within a team?
"V" Vercel's Internal Company Agent
Yeah, even if you have a team of 10 people or a team of hundreds of people like Gad Versal, I think the way that I think about tools like Codex is that or ChatGPT, is that they give you a taste of what AI can do.
But your job, the new job of someone that runs the company is to actually enable their workforce with agents and to work on the agent.
I think the future of what you would consider to be your intellectual property of the company or your edge against competitors is the ability to create, tune, optimize and disseminate this agents internally.
And, and, and you know, while you can have this sort of a hum moment when you use something like Chachi BD, maybe to give you an example of our internal agent is called V.
So anyone within Versal can go into our Slack workspace and say at V and sort of navigate their day-to-day, whether it's you, you give a great example.
So if I need to create new content, for example, our marketing team needs to help promote a new product that we worked on or communicated product change or write an engineering blog post in in collaboration with an engineer that work in a certain capability.
All of this goes through this V agent.
And this V agent has a number of skills that we continuously sort of update and improve.
It has sub agents.
It has sort of imagine the ability to create like a virtual employee team.
So there's the content agent that is really good at writing marketing materials.
There is the data analysis agent.
We, we internally call this D0, but it's one of the sort of think of it as like the, the Nexus of intelligence within our company.
Like anytime when you get information about how a customer is doing or you know how they could use more for sale or things like this.
We have this sort of D0 agent that is connected to our data warehouse.
And so the experience of using an agent actually ends up being extremely user friendly.
Why?
Because all you need to do is you join your cell, you join our chat workspace.
And now you sort of have this omnipresent intelligence that can help you.
And now you might, you know, you might go to V and say, hey, can you change some information on the website?
And so V can still sort of coordinate with other agents.
It could, it could delegate a task to codecs if it wanted to.
If it can create a prototype with V0, it can query Versail to get information about our production systems.
But I think what's what's key is enabling every company in the world to sort of deploy this brain and this intelligence and continue to sort of optimize it over time.
Building V and the Eve Framework
I have a lot of questions based on this.
My first one is do you have like a team that manages V that where OK you have a team what it what does that team look like?
How big is it and like, what do they do on a day-to-day basis?
Speaker 1
So maybe to back up, I wanted to share a little bit about our product development philosophy at Versailles.
When we have a vision of the future that can be informed by, you know, pains that our customers have or things that we noticed internally could be better, we try to solve that problem ourselves first.
So this idea of let's have an agent that can help with every aspect of our job sort of emerged pretty obviously, like you mentioned, like anyone that uses ChatGPT notices, oh, it can reason, but ChatGPT doesn't have access to my internal knowledge base and customer records and the set of best practices of how we build software, etcetera.
And so the inspiration was anytime you talk to somebody, could there have been an agentic intelligence layer that could have gotten you that information sooner?
So that was sort of like the inkling, the inspiration for it.
Next thing is, how do we build this?
And so Versal has built a number of agentic infrastructure services and tools, right?
So we built the AISDK that helps developers talk to any model in the world.
We built AI Gateway, which helps you get tokens from any model in the world.
At the end of the day, you know, what we realized is that, OK, if there's an agent like V, I don't want it to necessarily be clawed or codecs or open weights.
At the end of the day, the customer doesn't matter.
And ideally we autonomously choose the best model for each task.
So we almost thought of V as a super set of all agents in the world.
And so we designated a few folks to sort of like try it out and build this conversational experience.
First, it started out as a support assistant in that alone was extremely useful.
Why?
Because we are hiring new people and also in Slack we talk to a lot of our customers.
And so anytime that you have a question about how Versal works, we wanted to have an AT Versal functionality that could know anything about Versal.
And that in cell was super, super, super helpful because it became sort of like this easy way of giving support to our customers.
But the difference between an AI assistant and an agent is that an agent can do things for you.
And so we started thinking in terms of skills and in terms of jobs to be done.
So this we give it a name, so V for internal purposes.
And so we wanted to have a clear distinction between the customer facing agent, the agent we give users of Versal, which is adversal, and the agent that runs our company.
So V is sort of the shorthand for this.
So we created the V team.
The other thing we realized in this process, and maybe this goes at the heart of your question, is it's actually pretty hard to assemble all of the tools, all of the frameworks and all of the infrastructure to make something like this happen and to improve it over time.
And so that gave inspiration for us to we built V and then we shared the framework that we used to build it back to the world.
We call this Eve.
You might you might sound like we're super creative with our names V Eve Versal, but Eve is sort of the, you know, next JS or React, what they did to the web, they made it really easy to build websites and web applications.
The thing that I think every knowledge worker, every individual, every entrepreneur will want in the future is to have an agent that they can call their own.
And this is what we're helping people enable with with Eve.
Speaker 2
Got you.
Yeah.
I think, you know, this is something I've spent a lot of time thinking about, like, how do you give the normal person the access to not only just have an agent that has a bunch of contacts, but to also kind of like customize it?
And I think although it feels like now that open claw was kind of a fad, you know?
Lessons from OpenClaw: Soul MD + CPU use
You know, if you look at the Google Trends, it's like gone way down.
I do think it unlocked kind of a magic moment, or I do.
There's a reason it went viral in the 1st place.
It wasn't because there was some secret paid promos by Open Claw.
I think there was a genuine desire for people to put an agent on a computer and let it do things for you.
Speaker 1
I had a lot of epiphanies from Open Claw that informed the development of Eve.
I think you're absolutely a spot on.
One of those things is that Open Claw showed just how much a coding agent can do.
Back to my initial point, like what is Open Claw?
Fundamentally, it's the raw intelligence of the model plus every tool at its disposal, right?
Like a.
Speaker 2
Full, full access, yeah.
Speaker 1
It can write code, it can run it, and it can have access to everything.
And that's magic.
Speaker 2
To the point where it could do things accidentally.
And like, I think that's, I remember listening to Peter who created Open Claw, he said something like that.
He like asked for something and then it like gave it found an API key on his computer and it did something that he didn't even ask for.
And I think that was kind of the magic moment.
And, you know, they added like the heartbeat, which was this thing that kind of like initiated.
Speaker 1
It wake up really important thing about open claw which is soul dot MD.
So when you, when you create an open claw or when you use open claw, you're not just taking the off the shelf agent that somebody else built.
Clearly Claude, for example, it's a great agent, but a Claude is anthropics agent.
It has its own set of principles and it, and, and sure they will they, they give you ways to customize it and whatnot, but it's not truly yours.
It doesn't have a, a soul of its own right.
And so I think that was another really big unlock, which is what is the soul item D file?
It's just, it's just literally marked down text that defines the genesis of that model.
So when you create an agent with Eve, which we basically learned from that and, and basically an Eve agent at its most basic is a folder with an instructions dot MD file in it.
So it's like the soul of your agent that's going to help you run your company, for example.
And then the other thing that we learned is it's awesome that it can run code, write code.
It has a computer for it, right?
Like the, the whole like Mac mini thing was actually quite meaningful, right?
Like people realized, OK, this agent can do anything under the sun, but it's dangerous and he needs a space.
He needs his own like thing.
And it's give the agent some space, right?
Like, and so people bought Mac minis and, and, and that basically in giving an agent a computer massively improves its performance, it's reasoning performance and its ability to deliver outcomes for you.
And so what's really fascinating is it's not too unlike hiring a knowledge worker.
What is the first thing a modern firms does when they hire a human?
Here's your computer.
IT gave us a MacBook.
It has a bunch of programs installed.
It's logged into all of your key systems.
And so we wanted to give you that as well for your own agents that you build, but we wanted to build a secure and efficient environment for it to run.
And so the security part is that you define the tools, the human in the loop approvals and the data access controls for anything that the agent can do.
And the other aspect of it is it doesn't assume that the agent is always running in a computer, which is actually kind of counterintuitive.
I just said an agent gets better if he has a computer, but not every agent is a computer is running 24/7.
And so in, in, in our, in our lingo of the Versal in in cloud world, we call this serverless.
The idea is that if the agent is not doing anything, it can go to sleep.
Maybe another metaphor is imagining a Mac mini that hibernates when the agent doesn't have anything to do so that he doesn't use electricity.
And so because we at Versal, we run, you know, billions of deployments, we needed a mechanism such that agents can be very, very, very efficiently operated and run.
And so that's another sort of ingredient that we learned from the open class of the world, OK, If we're going to run these things at massive scale and we need to run them securely, how can we create infrastructure that enables that?
Speaker 2
Got you.
That makes sense.
Yeah, I think, I think all of the the big AI labs who've who've, who are like kind of releasing a product that is an agent on a computer is trying to shake it into people.
They're like, this is a computer.
It has a computer.
And it's not easy to communicate to the average people.
You know, open AI is struggling with that right now.
Or they're like literally tweeting.
They're like GPT work is an agent with a computer and it's not easy to convey that as you interact with a chat bot, you know, like it's like, what does that even mean?
And you know, and I'm even, I'm even struggling with it, you know, and I think, you know, and I think you can kind of divide it, whether you look at Anthropic or open AI, like you can kind of divide their products into like how much computer access they have.
It's like the chat bot doesn't have any computer.
GPT work has some computer.
It doesn't.
It can't run terminal commands, but then codecs can run terminal commands, but you can only get it on your computer because they don't have.
And so I think that is actually the computer aspect of agents, I think is one of the parts that makes it really confusing at this stage right now.
Speaker 1
I agree.
And, and my goal with the agents that we build and, and V is that, you know, whether you're an Internet just joined Versail or you're a super experienced engineer or you're somewhere in between.
I don't think whether I, I think that's sort of the implementation detail that the agent builder needs to know about.
You need to what I want for the future is that someone's building an agent can very carefully define governance data access control in the security model, right?
For because agents are interacting with customer data.
So you can't just be like, I don't know, man, the rest of the computer and has access to like all of the databases of everything.
You have to be really, really, really thoughtful about it.
That's literally our new job, right?
And but whether it runs one or it runs a million computers, completely inconsequential to the end user.
In fact, you know, you can think of this agents as being orchestrators.
In fact, when when someone goes to our slack and says at V, they're really talking to the orchestrating agent, the one that could delegate a task to a million computers, to 1 computer, maybe even no computer.
You know, we have customers of our cell that have built agents that have so much usage that they figured out ways to make the computer smaller and smaller and smaller just for the sake of cost efficiency.
And so I think that my hope for the future is that the very technical people can sort of know, like, oh, this particular conversation with this agent resulted in all of this usage of computers and whatnot.
But for the most part, it's all about getting high quality outcomes, high quality analysis, high quality, you know, accurate information, performance is becoming more and more of the dog of town, right?
Like people really care for fast models and fast execution.
So that's another aspect of like, how do you get your agent to be delightful?
One God Agent OR a Team of Agents
OK, so let let's say for a SEC I wanted to create AV agent for my team.
Speaker 1
Yeah.
Speaker 2
My first question with this, and, and this is something that I've realized talking to a lot of business owners who are like kind of know about agents and they're, they're trying.
They, they're, they're confused on whether you want one agent that's like a God agent that knows everything or if you want a team of agents that sort of like share a knowledge base.
Because the conversation that I'm having with a lot of business owners is like, well, the marketing team has access to these things and the finance team, like, I don't even, I don't even want the marketing team to know about certain finance documents.
Speaker 1
Totally.
Speaker 2
And so like that's my question is like, how if I were to be creating my own V agent for my company, how do I think about that God agent or yeah.
Speaker 1
So first of all, I'm a user experience guy, you know, I started for sale because I was frustrated with how slow creating software was and how slow the average website and web application experience was.
So I always try to work backwards from the user experience.
The ideal user experience with an agent is the Star Trek computer or the Iron Man Jarvis.
It's ambient computing.
And I don't need to target a specific capability.
That's why we are, we're reasoning with agents to begin with.
It's like there's probably like hundreds, if not thousands of internal tools that people at Versailles have built that I don't even know they exist, frankly.
There's just too much, right?
And so when you have this as intelligent agents, they can act as routers.
The our internal EVE agent is a router.
So if you ask it about Versailles knowledge, it goes to the capability that we have for looking up our documentation, our knowledge base, etcetera.
If you ask about if you need to help a customer with a support case, it has a support agent within it that has access to our support ticket infrastructure.
OK.
So that answer, sort of my perspective is that it's more on the God model and maybe to give you a metaphor, because I really think that what we're doing here is we're redefining how companies of the future will work.
When you join a corporation, they might give you a corporate phone and that corporate phone is already preconfigured with your identity and with a set of applications.
You have the application for the, I don't know, internal chat.
You have the application for this and that.
So I think the internal agent that helps you run the company is not unlike that is the job of the new sort of IT department is to say what are the capabilities that we're bundling into this agent And also crucially, how do we manage identity and who gets to access what information, which is also extremely business specific.
It depends on how regulated your business is.
If you're a small startup, I can believe that you know your nine person team.
They all have pretty equal access to most of the information of the company.
Maybe 2 have information to the financials or or maybe the decision.
I remember when I started for sale was like some of us had, you know, read write admin and but I think most of the first ten person for sale team had read access to almost everything, right.
And so the job of the person that works on this foundational agent is to determine the, the access control, the tools, the guardrails, the, the audit trails.
And, and, and like I said, this is actually pretty hard work to do.
And, and, and why we wanted to create a framework that made that the fundamental job because you know, wiring up the model, wiring up the infrastructure and all of that we can sort of customers can offload to us.
Speaker 2
That makes sense.
And so I, yeah, I guess the agent would also be able to see where the message is coming from.
So it's like, OK, if it gets sent in this channel, it'll delegate to this sub agent or access these certain files.
That makes a lot of sense.
I just, I guess because what you're telling me is like so appealing, like being able to create your team's agent.
And I don't think anyone's cracked the interface for this yet.
And I know you guys are building a framework.
You deal with a lot of developers.
I guess what I'm dying for is like a way, some sort of interface to understand it, because even the technical people, like I've even showed technical people Eve where I like, I'm like, can you help me make sense of this?
And I think it's still at a stage where it's not super easy to, like, fully understand.
And so I guess, yeah, I just wish there was like an interface where I could go in and like, set these rules.
Maybe I'm talking to an AI and it's configuring it I guess.
How to Build Your Own Agent: Skills, Tools & Permissions
The way that most of these agents are built is that you're talking to an AI that is helping you maintain your EVE project.
You'll hear me use the Word file system or folder a lot.
I find that it's it makes the world really easy to understand if you think it if you think about it as a hierarchy of files and folders.
So the way that a Neve agent works is that you started with that instructions file that says you are the agent that helps run Riley's business.
You can even have some context about who you are.
Like our business is in, you know, we disseminate information about AI and our values are transparency.
We're not opinionated.
And we love shipping things like something like that.
Right?
OK.
But that agent still knows nothing.
It's a tabula rasa.
It just has the raw intelligence that comes from the model and it has a basic set of instructions.
How can you do something useful for you?
Well, you talked about, OK, let's help the marketing team create content and let's say that one of the things that you really care about is posting on your blog.
OK, so in an EVE agent, the first thing you do is you can create a tools folder and you can now start exposing tools to the agent.
And so you can say, let's say that your blog is running WordPress or some system like that.
Now we can say to the agent, now we have a tool to read and write blog posts to WordPress.
OK, great.
You created that file WordPress dot TS on that folder.
And then you ship your agent.
You use the Word channel.
Also very important, this agent needs to communicate to your team in some channel.
So EVE supports every channel under the sun.
It can be WhatsApp, it can be Telegram, it can be Slack, it can be Microsoft iMessage, it can be iMessage.
Yes, amazing.
And so the next question is, OK, I hired the agent, I gave it this sort of soul.
I gave it access to WordPress.
Now you hire an intern.
Can the intern ship any blog post that IT authors together with your internal agent to prod?
You probably don't want that.
And so this is the job of like at some point maybe Riley, you were working on your EVE agent or someone in your team you designated as sort of the agent administrator, you're going to say, OK, if the person lives within a certain part of the organization, we let them write directly to WordPress.
Another approach that I've seen people take is that when they interact with the intern over Slack or over Telegram or whatever, you have to authenticate with WordPress.
So you delegate to an existing permission system that you already have.
So the EVE agent ends up being sort of the facilitator of the transaction, but it doesn't have direct access to WordPress itself.
It will help you sort of draft up the content.
So this is just an idea that we cooked up in this conversation.
But imagine that every day you start realizing, hmm, that's really powerful.
I just unblocked my entire team to be able to draft A blog post that go directly to WordPress.
But next time tomorrow you hear an escalation and you hear, hey at Riley, I just saw your blog post.
It's read your most recent blog post.
It reads a complete clod slop.
What do you do?
And you go, you go into your team and say, guys, what do we just do?
We became really productive and we started shipping a lot of slop.
You know what you do next?
You work on the content writing skill of your EVE agent.
And so this is the meta work that we will all be doing in the future.
We're not working on the blog post itself.
You did not go to the intern and scold at him for like, hey, what?
What do you do?
You ship the bunch of slop, you're putting that intelligence into the agent in the form of skills, in the form of tools.
And of course, over time you can get more sophisticated and, and it's not just about blog like how can we infuse the content writing capability with what people are saying on X about your business?
Speaker 2
I was going to say that like a lot of the skills that I find very useful for content ends up just being like grounding in some relevant source.
And so you can put I call them, I like plug insurance like like there's one called scrape creators.
It's some API that I found that scrapes content from certain channels.
And so like before it ever writes anything or before it ever ideates an idea for YouTube or or a packaging concept, like a title and thumbnail, it'll go and like look on social media and find those things.
Totally.
Yeah.
And that's another thing like, OK, so if I'm creating AV agent, yeah, I'd, I'd want to add certain AP is and you can add I, I would, yeah, call you can call them plug insurance or like how do we distinguish between plug insurance and skills?
Can you add plug insurance to skills or how?
Speaker 1
Are they all just so going back to you, you got that escalation that says, Riley, you just shipped, you're shipping a lot of blog posts, but they all they have too many M dashes.
And so this is what's beautiful about that idea of it's just a folder.
You go into your EVE agent and in the folder skills you say content writing dot MD and you say this is how we write.
This is what I like, this is what I don't like.
You also talked about I think that the future of work will be the agent becoming a lot more proactive as well.
So EVE can have a schedule, for example, every day at night, it reads social media, it parses keywords, it gets replies from your post.
And from that it can do something.
It can draft up new content.
It can even give you a report inside of Slack.
And this we actually have found to be extremely helpful out of our cell, the idea that our agents proactively give us information.
So every Monday I have AI have my internal agent give me a download of what's happening across every product area.
What are the key metrics that I care about?
So you can have the agent be doing thinking in the background on your behalf.
And I think it's not just about I think most of the world still thinks about agents as something you prompt, but I think there's a lot of alpha in thinking about can we sort of automate even the prompting such that the agent can be doing useful work for me while I'm not in the computer.
Proactive Agents, Triggers & Self-Improvement
I.
Speaker 2
Think one of the limitations for me, and I've been able, I I have a lot of automation set up that trigger an agent to do certain tasks and it is really useful.
One thing that I'm struggling figuring out how to set up, especially at my at the team level is to get outside things to trigger the agent, you know, and there's many ways I think you could do this.
But yeah, like do you guys have any of of that set up?
Like if some event happens it automatically.
OK, yeah.
Can you talk about that?
Speaker 1
So I think events that originate in systems like Stripe, like there is a refund request.
We make it really easy to connect all those systems.
And in fact, when we sat down and we thought about what makes it really hard to build an agent, it's actually not the proof of concept part.
Because anybody in the world can sit down, open clod code or codex and build an agent in the sense that like when you're prompting it, you realize what it becomes capable of.
What we talked about with Open Claw, like the raw intelligence is already there.
What's hard is securely connecting it to your systems.
So we built a capability on Versal called Versal Connect that gives your agents access to 100 plus systems, but it doesn't just give them full read write everything access right away.
It gives you the developer to control.
And that might mean that you subscribe to an event and then you send it to your agent.
You can say, hey, every time Stripe has a failed payment, let the agent know.
Every time we get an e-mail, let the agent know.
And so you start thinking about the world in terms of events.
In fact, I mentioned that a lot of our agent interactions are happening in Slack.
Slack is just another event is someone said something in the agent that gets fed into the agent's brain.
And so any, any connector of this sort of repertoire of connectors can originate some kind of behavior in the agent.
Speaker 2
Got you.
That makes sense.
Yeah, that's just something we've been thinking about a lot because you're right, everything is just an event.
It's just things happening.
And then when something happens, if an agent can take care of it, they it should take care of it.
And I think I'm like, I've automated none of that in terms of what I could possibly automate, which is a really a.
Speaker 1
Mental model.
So I mentioned that the, the thing that I'm excited about with Eve is that when, when I started for Cell, the most imminent thing that I needed to build was a website.
Like it felt like, how do I put my fingerprint in the world?
What is one of the earliest things that you do when you create a company?
You register in Delaware.
If you are in the United States or internationally, you incorporate, you choose a name and so you register the domain name and you ship a website.
Even a website says like, hey, we're in business or welcome to the minimum viable sort of identity of your company and the Internet.
What I believe will happen in the future is that even before you build a website, you're going to build that agent that's going to help you build a company.
The it's going to be your factory.
It's going to be the the trusted partner and advisor in everything you do that's constantly learning about the trajectory of your business.
And so it's extremely critical that as you sort of evolve your business, this agent gets access to more of these data streams of knowledge and information in everything really is an event in this world.
Another important factor there is self improvement.
So when whenever you start a company, you're constantly learning.
You're you're teaching your employees, you're helping them, you know, learn from mistakes, learn from incidents, learn from customer feedback, etcetera.
It's going to be very important that your agent over time can improve.
And so with EVE, we thought about, OK, if there is a baseline of information that your agent has, how do you evaluate the agent?
Can you write tests or can you give it exams so that you actually know that you're making forward progress as you as this agent sort of gets more sophisticated and more capable over time.
And so think of this as sort of even more fundamentalthanthe.com of your of your of your company.
Speaker 2
Yeah.
And did you guys, like put evals into Slack?
Are there any ways to like evaluate whether an agent does well or doesn't do well?
Like, could you like based on someone, like could a employee who got a response from V, could they say like, oh, this wasn't a good response and OK, they can do that.
Speaker 1
Yeah, so the every response that we give on Slack has A and by the way, maybe to also give kudos to the Slack team, Like Slack is kind of becoming like an agent operating system of sorts, right?
Because like it used to be for messages between humans, now it's humans and agents.
And so they have built UI that is just really easy for the developer to add, right.
So like the thumbs up, thumbs down thing, super easy to add.
And so every EVE agent we create, for example at night, we can have a job that aggregates all of the negative feedback and proposes the next stage of self improvement.
We can say hey, we got 5 thumbs down on these answers.
What are the things that the agent itself can't even propose?
How to improve itself?
Oh I missed this.
Oh, this person critiqued this part of my response, or they said I hallucinated or whatnot.
I do think it's very important that humans are still involved in that loop.
But I think increasingly more and more of the job of getting the agent getting better is also being done by the framework.
So the framework itself comes with evals that, you know, are basically test cases, right?
When you build a web application or a website, you write unit tests and you make sure that the logic is sound.
When you create an EVE agent, you write evals also to ascertain that the logic is sound, but that the information it gathers is sound and it's accurate.
There can be evals about personality.
At some point we were hearing from people that our internal company agent was too verbose.
It was speaking too much and so you we kind of basically gave it a better personality and and you can create evals around that as well.
Who Will Build Agents & Getting Started
So do you, do you view this like in the near future, like over the next few years, do you think it's just going to be mostly technical people building agents for companies?
Or do you view this as something that whether you can code or not, you'll you'll be able to create agents for your team?
Speaker 1
So because building software is being so democratized, think of it as like, again, let's go back to that idea of like, I'm starting a company and like the first website I built, it's sort of like I could have used any service on the planet, drag and drop, give me a free website with my domain name, like anything like that.
And so I think that first building block of your agent, everybody's going to be able to to create.
I think that over time, I mean the whole business runs on this, hundreds of millions of dollars of revenue are dependent on the well-being of this agent because our sales reps depend on it, our support team depends on it, I depend on it.
And so this is a very important piece of software.
And so I think it's a combination of everyone can contribute to the agent information skills, critique, feedback.
And then there is engineers that are working on the core system loop, the access to data, the governance, security, all of those pieces that I think need to be more technically minded.
But I don't think that the code writing part is as important these days.
It's, I think I would describe it as people that really understand data flows, threat models and architecture of systems design so that they can like carefully think about the, the, again, the operational excellence of the agent and the security model of the agent.
Speaker 2
Very interesting.
Yeah.
Because, yeah, I think there's a lot of people, business owners, not all of them are technical, who are reaching out and they're trying to create agents.
And so I'm just trying to like leave people with like a, a tangible thing that they can do, like a point to a place where they can go to kind of build their first agent or build their V.
Because I think with what I've realized with these agent tools, all of them is we, we can have conversations about it.
We can talk about it.
I can learn, I can use AI to like learn about it, but nothing hits like doing it.
And I think that's kind like, like once you do it, then you're like, oh, I can do that.
That means I can do this thing, this thing and this thing.
And like kind of your world opens up as you do even the most trivial things.
And so, yeah, I.
Speaker 1
Recommendation there would be, you know, what I've seen give people on a moment is create an eve agent, go to eve dot dev, deploy your first agent, but connect it to your favorite chat medium.
If your company works in Slack, connect it to Slack.
If you like WhatsApp, connect it to WhatsApp and pick one boring or you know, kind of pick a toil task of your business that has a system to it, but it's not, you know, it's something that if you could automate it away, you'd absolutely automate it away and write down the scale of that task.
It could be, for example, something we do a lot at Versal is we put a lot of work into drafting up our product change log.
When you go to versal.com, it says change log.
Every piece of content there narrates the storytelling or evolution of our product.
And in many ways that change log is a grounding for my engineering team.
How do I know if an engineer is being productive or not or whatever?
Like, well, one of the things that I do is I, I measure it by have you shipped something that we can communicate to customers is an improvement to our platform.
So one change log that's about to go out maybe by the time you watch this is already gone out is we we improved the end to end deployment process of an application or agent to Versailles 7 seconds, 7 seconds.
We've shaved off over a lot of infrastructure work.
So when you go to Versailles Commons Exchange, you're going to find that we improved our product and we shaved down 7 seconds.
So it used to actually take a lot of work for an engineer that is in the depths of infrastructure to collaborate with the marketing team and get that thing out into the world.
Because we have an agent internally, we've cut down that process into one Slack thread that the engineer creates.
The agent refines what they're telling me because, you know, engineers are sometimes so in the weeds that they struggle to communicate things in a way that is, I call it context free.
You know, maybe they start talking about, you know, computer science or like I'm just, hey, can we boil it down to the business benefit?
Simple 7 seconds.
It's enabled for every customer.
It's free.
So that's kind of like a little formula that I have.
People want to know what's the benefit?
How much does it cost and what do I do to get it?
And so that formula that I developed over many years of product marketing skill I put into that EVE agent.
And so for the listeners, think about something like that.
Maybe it's like quote UN quote, a secret sauce of something you do really well, but takes a lot of time and you want to do more of it.
And so start with that skill connected to a communication channel.
Ship it on for sale.
Speaker 2
Got you.
OK, that makes sense.
The Future: Cheaper, Faster Models & Open Weights
Yeah, I think to kind of, I know we're, we're running up on our time here, but what are you most excited about?
It could be a model, it could be computer use or some browser use.
Like what unlock do you think we're going to get in the next like three to six months that will make using agents way more fun or way more effective?
Speaker 1
Very simple.
Cost of intelligence continuing to go down, more intelligence to for more people, more variety of models.
One of the great things about building with Eve and building in Versail generally is that we give you access to every provider of models and every model in the world.
Speaker 2
It's model agnostic.
Speaker 1
Totally model agnostic, right?
And that plays into your benefit because you retain ownership of your data, of your skills.
You get to choose models and you get to benefit from the competition.
There's some news that's going to go out tomorrow about models getting dramatically cheaper literally tomorrow, tomorrow.
And if you were building in this way, you're going to benefit.
So the other one is fast models are going to get way faster.
I think we're going to start seeing what happened with the personal computing and mobile computing revolution, which is that, you know, we got the iPhone.
If you were, if you could travel back in time and or even pulled out the first iPhone out of a drawer, you'd be astonished at how slow it was the refresh rate.
Like you would open an app, it would do nothing for several seconds, and then slowly, at maybe 10 frames per second, the application would show up in front of your eyes.
That's where AI is at today.
Speaker 2
Yeah, I think for most knowledge tasks, like I just want faster.
You know what, my biggest problem isn't like, oh, I wish this was better.
It's just like, why did I have to wait 14 minutes for this, you know?
And it like if it was 10 times faster, it would be insane.
And I feel like we're like, how long do you think it'll take for the models at like a 5.6 level?
Like so like soul level?
Speaker 1
Days.
Days, maybe this is the most like optimistic.
I think we're literally like weeks, single digit, months away.
One of the data points that I can share is on the open weight and This is why I'm excited about open weight models.
The competition between the inference providers around open weight is so extreme that GLM dropped.
We added in Versailles AI Gateway.
It's an incredibly good model, GLM 5.2.
Within days we had a fast variant that was four times faster.
We have more providers coming online for GLM that keep raising the bar of token per second performance.
GLM 5.2 fast is astonishingly fast, and it's only getting faster.
Speaker 2
What did you think of I?
Speaker 1
Think we're gonna get he's going to have entertainment.
I think we're still in the early innings of that.
Speaker 2
What did you think of the model, like in general?
Like, do you think it's you think it's really good?
You think it's up to par with like an Opus 48?
Speaker 1
I think GLM 5.2 was already in that category.
I think Kimi raises the bar.
I think Kimi can do things that perhaps only, you know, Fable class models could do, not quite in all, in all of its dimensions.
But for example, when we evaluated it for cybersecurity, it outperformed Opus 4.8 clearly.
And it was almost at, you know, soul level.
So still at the frontier.
But again, this is a beautiful thing about having choices that depending on what you're doing, you're going to choose different price performance ratios.
Grog for fast and highly accurate.
Like if I have to choose today a model that's going to be my workhorse model, that would be like the default.
If I have an agent that is my slack and needs to do a wide variety of tasks and it has to do it quickly because there's another person waiting on their side, I would absolutely go with Grog 4.5 or GLM in terms of like price performance.
Now I mentioned the productivity.
What about, for example, at night, finding opportunities in our business, crunching data and extracting novel insights for the executive team?
Well, those things I can throw more reasoning power, and I can take more time.
I might even want to throw a consortium of models at it.
Why not have Kimmy and Soul and Grok come up with three points of view and then give you the summary?
And This is why I find it so interesting, right?
Like we're still in the early innings of understanding what are the principles of design and user interface engineering.
But for agents, Yeah, If I'm talking to an agent interactively, I went fast.
If the agent is doing an asynchronous job, I want accuracy.
Speaker 2
Yeah, You don't care if it takes all night like it.
It doesn't make a difference if you.
Yeah, yeah, that's true.
I I didn't think about that.
Speaker 1
We're about to launch a capability in AI Gateway, which is you as a developer or even your agent can say, please do inference, please, like get me tokens, but in batch.
And I don't care how long you're gonna take.
Like you communicate, it's a little bit like putting in a buy order and you're not worried when it gets fulfilled, right?
Like you're just willing to wait and then anyone in this market can fulfill your order.
Almost like a spot market for intelligence.
Speaker 2
Right.
That makes sense.
Yeah.
Speaker 1
And, and this is extremely exciting because you might say, hey, like come up with a proof or disproof of the Jacobian conjecture for 2 dimensions.
And I don't really care when, but it spent this many tokens and someone at some point is going to say, hey, I already paid for the GPU.
It's the Internet, no one is using it.
Let's throw some capacity.
It's a little bit like SETI at home.
For those who remember, rent out your spare compute capacity.
Solve hard problems.
Speaker 2
Yeah, because if you get it next week, it doesn't matter.
You know, you're still solving a really crazy thing.
Closing Thoughts: Owning Your Own Intelligence
Anyway, I really appreciate you joining.
I think you guys are going to do great.
One thing I didn't realize is how much business owners don't want to get locked into a certain provider.
I mean, you know, like Claude tag is their kind of, I don't want to say it's their version of E, but it's like kind of an agent you can add to Slack And so many people are resistant to it because they don't want to get locked into only Claude's models.
So I think that is something that you guys will have going for.
Speaker 1
You that's really cool and it goes beyond, you know, the the model.
I think it's not about having Claude in your workspace.
It's about having an intelligence of your own, right.
So there is almost like an element of like baptizing your agents, like this is our agent, this is our company.
It's, you know, I actually liken it to the web because the web was all about I own my domain name.
I'm the, I'm the king of my own domain.
And I think we're now seeing we're living through the version of that for the intelligence age.
Speaker 2
100% yeah, I agree.
I thank you so much for coming on.
This was this was a lot of fun.
Let's do it sometime soon.
Podcast Summary
Key Points:
Agents are emerging as a "killer app" for business, with coding and company-wide "brain agents" being foundational use cases.
Vercel built an internal agent called "V" used by nearly 1,000 employees via Slack, handling tasks like content creation, data analysis, and customer support.
V acts as a "super set" of all agents, autonomously selecting the best model for each task, and coordinates with sub-agents (e.g., content, data analysis).
Vercel open-sourced the framework "Eve" to help others build customizable agents, inspired by lessons from OpenClaw.
OpenClaw's "soul.md" file concept inspired Eve agents to have a unique "soul" or identity, defined by a simple markdown file.
Agents perform better when given their own secure, dedicated computing environment (e.g., a Mac mini), similar to giving a new hire a laptop, but with governance and data access controls.
Agent infrastructure should be "serverless," allowing agents to hibernate when idle for efficiency and security at scale.
The main challenge is enabling teams to share agents while managing permissions and personal connections, which Vercel addresses through centralized, governed agents.
Summary:
The conversation between the host and Guillermo Rauch, CEO of Vercel, explores the current state of AI agent adoption in businesses. Rauch argues that agents are a foundational "killer app" for the modern company, with coding agents and internal "brain agents" being the most impactful. He highlights Vercel's internal agent, "V," which is used by nearly 1,000 employees through Slack to navigate daily tasks, access business intelligence, and coordinate with specialized sub-agents, such as content creation or data analysis.
V is designed as a super set of all models, autonomously choosing the best one for each task, and is continuously optimized by a dedicated team. md), and the benefit of providing agents with their own secure computing environment, akin to giving a new hire a laptop. Rauch emphasizes that agent infrastructure must be serverless and governed, with clear data access controls and human-in-the-loop approvals, to ensure security and efficiency.
Vercel open-sourced the "Eve" framework to democratize this capability, enabling any company to build and customize its own agents. The main challenge remains enabling teams to share agents while managing permissions and personal data, but Rauch believes this is solvable through centralized, well-defined agent systems.
FAQs
Vercel separates personal skills, like email access, from shared company skills. The agent 'V' has defined data access controls and human-in-the-loop approvals, so it can use shared data like customer records while keeping personal connections restricted.
Vercel started with a few folks who built V as a support assistant first, then expanded it into a full agent with skills and sub-agents. The team continuously updates V's skills and improves its performance, but the exact team size wasn't disclosed in the episode.
Vercel open-sourced Eve to democratize agent building, similar to how Next.js made web development easy. They want any company or individual to build and own their proprietary agent, rather than relying on off-the-shelf agents that aren't truly customizable.
'soul.md' is a markdown file that defines an agent's identity and purpose, inspired by OpenClaw. In Eve, an agent is fundamentally a folder with an instructions file, allowing true customization and ownership, unlike generic agents that come with preset principles.
Giving an agent a dedicated computer, like a Mac mini, massively improves its reasoning and ability to deliver outcomes, similar to hiring a human knowledge worker. Vercel applies this by providing secure, serverless environments where agents can run, hibernate when idle, and have defined tool access.
Agent builders must carefully define governance, data access controls, and security models. This includes setting up human-in-the-loop approvals for sensitive actions and ensuring agents only access data they're authorized to use, balancing autonomy with safety.
Chat with AI
Loading...
Pro features
Go deeper with this episode
Unlock creator-grade tools that turn any transcript into show notes and subtitle files.