And I think Wes, you make a really good point
about the multi-modality of it.
Not everybody's gonna be using the web the same way.
Like we've known this forever.
I think some people are like,
"Oh, the web will go away.
"It'll just be people using it ahead this way."
And then people go, "No, nothing's gonna change."
And I think the truth is like,
these experiences are gonna be done all sorts of ways.
Like even a shopping,
I'm shopping as like a leisurely activity.
Then I'm gonna be a human in the loop in that activity
because that's part of the point.
But if I'm just trying to get some shirts for my son
that he knows the size of and he knows what he wants,
then that, you know, I'm okay with an agent
doing that for me.
(upbeat music)
Welcome to Syntax.
Today we're talking about Web MCP.
We got two folks from Google here to talk about Web MCP.
And I personally am really excited about this.
It's starting to make its way into clients.
And I don't think a lot of people
really understand what it is or as a developer,
how you should be integrating this into your site
if this becomes a thing that everybody implements.
So I'm stoked to talk about it.
With me, we have Dominic Ferlino and Sarah Drazner.
They are both from Google working on Chrome.
Most people listening to this,
I would say everybody listening to this episode
knows what an MCP and MCP server is.
Everyone's slapping them into their agents.
Can you just give us a rundown of like,
what is Web MCP and how is that different?
- Yeah, I mean, I think people get confused a little bit
because of the name.
Web MCP is on the client, not the server.
And a lot of the kind of similarities
are when we are thinking about the principles,
like exposing tools to agents, things like that.
But they're actually pretty dissimilar.
The governing bodies are dissimilar.
One is the AgenteGai Foundation in Linux.
That's the MCP for Web MCP.
It's the W3C like other standards bodies.
For Web MCP, you are really only working on it
on the client.
But that doesn't mean that it can't negotiate
or create some reactions like kick off a rest
or GraphQL API interaction.
And then also the way that people are using it
agentically, you do have headless scenarios
that you can use Web MCP.
But we're also thinking about a new surface area
of cobras and cobras is where we're spending a lot of time,
which is when you have like a human and agent
on the loop collaborating on a web experience together.
Domicide.
Yeah, no, I think that was perfect.
I think the way I try to describe it to people
is when you give MCP tools, traditional MCP tools
to your agent, it allows you to just enable the agent
to do better capabilities inside the chat.
But we don't have a really like an MCP for UI
for like using the site.
I'm on Google Sheets.
I want to do this complicated thing in the UI.
I can't remember where all the 10 clicks that the functionality
is hidden behind.
Sorry, my cat's on the background here.
And so I want to be able to talk to my agent and say like,
OK, I really want to add conditional formatting
to this column.
And can you do that for me?
If we've ever seen agents interact with websites like Dom
and UI right now, it's like really, really slow.
They're like screenshoting.
It sucks, it's awful.
It's such a terrible experience.
And it's expensive, actually, too, right?
It reenters the inference loop every time
you got to click a button and do anything.
But the agent is thinking in terms of sort of atomic tasks.
I want to add a video track to this YouTube editor.
I want to do something in this column at Google Sheets.
And all that code actually exists in the client.
And WebAppCP is sort of like finally
a way to let the agent get access to it
and actually get to that code and translate
its atomic tasks that it's thinking of into actual tasks
that the platform or site that the client app
is capable of handling.
Yeah, it's like, if you look at like where we're at right now,
like you said, if you have an MCP server for something
and you want to interact with it,
you're typically just getting like chat back and forth.
And in a lot of cases, that's awful.
So now we have like MCP UI where like you can like
have these little widgets that make their way
into the chat and that's okay in some cases.
But in some cases, like you know what the best UI is?
The existing app is the best UI for that, you know?
So in that case, or if there's not, then you're like,
okay, well, like, hey agent, use this browser
or like the site owner will strap some crappy little chat box
onto the side, I don't want that either, you know?
And like, I've been like beating my drum saying like,
this is like clicks and clankers.
Meaning that like, I just want to use the UI myself,
like I'm normally doing.
But then I also want to just be able to do
agentic stuff with that application, with that website,
with my own-- - With that same functionality, yeah.
- With the same functionality, I want to see it.
I want to say, like another example is like,
if I have like six expenses in my bookkeeping software,
I don't want to click them all and edit them all
and select the taxes for every single one.
And in some cases, I do want to click things
and drag them into wherever they want.
But if it's like a batch job, I just want to say like,
find all the expenses from my cell phone carrier
and mark them as having Canadian taxes.
And then we'll just go off and do that for me.
And then I can visually see what is happening in the UI.
- Yeah.
Well, and I think like one thing that people don't often
compare it to, which they should, is DOM actuation.
Like if you don't have something like WebMCP tools
exposed, the agent is inferring what it should be doing
from the DOM, from the accessibility tree,
from screenshots and things.
This actually gives tools to developers to be able to say,
hey, this is what I want an agent to be doing with my site
instead of it just happening to them.
- It definitely lets the developer kind of express
the capabilities that it knows an agent
is going to want to get at from its app directly to it
so that it doesn't have to constantly do this
like inference thrashing and the DOM actuation
and the accessibility tree reading
for every repetitive action and check if the button moved
and all it did and then what happens,
it can kind of let it think in atomic actions
and also act in the tool.
- And if you want to see all of the errors in your application,
you'll want to check out
[email protected]/Cintax.
You can sign up today and get two months for free.
Century is just a really incredible tool
for not only tracking your performance,
making sure your application has no bugs,
but even just seeing what goes wrong when something goes wrong
because things go wrong all the time when we're coding
and you don't want a production application out there
that while you have no visibility into in case
something is blowing up and you might not even know it.
So head on over to century.io/Cintax
again, we've been using this tool for a long time
and it totally rules.
All right.
- Yeah, that's such an important thing.
You one thing I, when I've talked to some folks
about WebMCP and it arriving in Chrome,
people say is this a Chrome thing?
Is this another Google thing?
You had mentioned that it's involved with the standards board
so can you touch on the status of all that
and is this just a Google thing?
- No, it's definitely not a Google thing.
We're working with other folks in the community,
other model vendors, we're working with Microsoft on this.
We're developing the API as an open web standard
in the W3C, it's managed in what is currently
the web machine learning community group
where some other agentic kind of APIs are for the web platform.
And we've been in close contact with model providers
and also developers who are gonna have to use the API
and other browsers that we'd love to have implement the API.
So there's been lots of discussions
in the normal standards bodies, gauntlets of consensus
and controversy with other vendors and developers
to get that pushed forward.
And so I think that's, we're still early stages
and all of that sort of thing.
But so far it's going really well
and we've gotten a lot of good developer feedback.
And clearly I think the community has proven
the need for something like this.
Like every time we present this to a model vendor
or like an extension provider that augments Chrome
with some agentic capabilities,
they're always like, this is what we want.
Like we want an actual like clear capability layer
to talk to the site instead of have to like
burn the user's wallet through inference loops
and screenshots and all this stuff
that takes way too long.
- Yeah, and I know you guys work at Google,
but like the idea was is that like whatever client
you're using, right?
Like if you're using, like it's in chat GPT desktop right now.
If you use the built-in chat GPT desktop browser
or I think the Chrome extension or whatever,
it will surface those tools via like,
we'll talk about the API in just a second
of how you as developer can implement it.
But it's any client, right?
This hopefully eventually will work
in like the cloud desktop or Gemini
or like any client that wants to be able to do this.
It should be able to just open up a browser
and say, ah, here are the tools that I have available to me.
- Yeah, if people haven't seen already, chat GPT,
chat GPT and OpenAI came out with a big announcement
that they're supporting WebMCP as a first-class citizen.
There's a big hackathon.
We're involved in that even though, you know,
it's across many different companies like Fursal
and CloudFlair and a few others.
So yeah, it's more an ecosystem thing.
Edge is definitely proponents of the spec.
They're worked on the first versions of it
and things like that.
- And I think that the chat GPT sort of hackathon
that they've announced with WebMCP
is gonna be a really good way along with the origin trial
that we're running in Chrome.
It's a really good way for us to pressure test the API
and understand like how developers are actually using it.
What granularity of tools are they writing?
And then it also puts a lot of importance
on the ability for the ecosystem to adapt
and come up with like real evaluation metrics
and determine like, I made this tool.
Did it help the agentic path on my site or did it hurt it?
And like, I made this change to my tool.
Did that help or did that hurt?
And so we're thinking in terms of like ecosystem activation
to understand what it takes to write a good tool
what the API needs to do to expose tools in the most effective way.
to the agent brain so that it can have a really effective experience on the site and so we've
seen a lot of feedback from our origin trial and this hackathon coming up that's going to help
inform the API shape and all of that stuff. So the API is, and the last time I implemented it,
it was both an HTML API and a declarative and imperative API and like a JavaScript API.
So somebody has a website, they are a JavaScript developer. How do they implement this into their
site so that agents can use their website? Yeah, I mean, I try to think about it a couple different
ways, but this is also why system design is really important. You want kind of task level milestones.
I think a failure mode can here can be that people kind of attach to every little micro interaction
on a DOM element. That's not exactly what's intended here. We're thinking about more like
stateful or potentially effectful kind of tasks that an agent can use. We're actually collaborating
with some large frameworks to investigate how we might infer tools just from your existing
application authoring. So you could just write JSX, TSX, and then there's a separate potentially
like reconciler past that infer some of those tools that you can look at. But if you're working
with frameworks like most of us are, you want to expose tools. Potentially via hook, I made a
web MCP tool hook that's on NPM that us in Chrome will keep up to date with the API.
So don't leverage the existing DOM structure, think in agent actions. I would also want to leverage
existing APIs in your application like REST or GraphQL. If you have those, those can be invoked
with a tool with a really good description. We have a lot of annotation hints and those are
also really important. So one really important part of the spec for me is that you the ability to
keep your site secure. So you kind of also want to go through and look at, are you exposing
user-generated comments somewhere on your site? If so, you want to read only hints. You'd want
like user-generated content hints because the agent can then say, okay, I shouldn't look at any of
those and take action. That can guard against things like prompt injection attacks or agent traps
or things like that. So you might want to think through, if you're a site developer, like,
where are you taking content that you're not sure somebody might be doing some of those harmful
actions? Yeah, the security side of it is pretty vast. Historically, when we work on web platform APIs,
we kind of have two consumers. There's the browser and then there's the developer, which is writing
experiences for the user. WebMCP is unique in that whenever we adjust the API or add new things,
we have to make sure it works well for developers. Does it make sense for you to add this attribute
on your tool or is it okay if it tools unregister at this point? But then we also kind of have to ask
the inverse questions to models where it's like, does your security harness benefit from consuming
this attribute? Is this having a tool market self as read-only or untrusted? Is that useful for
security harness and an agent? And if a tool unregister here, is that too much stashing or do you
guys have a caching mechanism? So there's kind of like two different halves of this API and getting
feedback from both sides has been super important. And like Wes mentioned, there's the imperative
API, which is just ordinary JavaScript allows you to basically pipe in a JavaScript callback as the
implementation of a tool so that the model can sort of call directly into JavaScript that the
developer chooses to expose. And then there's the declarative API, which is like annotations like
like attributes on existing forms. It's probably no surprise we find developers most interested in
the imperative API so far where most of the site code lives. But I think declarative also may have
an important place because it's an easy lift for your like, you know, crappy local like government
car registration website that is like from 1995 and has a bunch of forms on it to just like sprinkle
a couple things on and then kind of become a little more agentified and allow like those kinds of
use cases. So yeah, we're trying to collect feedback from developers on both API shapes and see
what sticks. Yeah, and so many of us thinking in interfaces anyways, right? These are the interfaces
that the users are interacting with. And if we view an agent as another user, you know, just being
able to sprinkle that declaratively on top does feel like a big win. Yeah, I see like they're being
just like a 10 stack query plugin for this type of thing, you know, because like I already write
all my all my mutations, all my queries of like get items, update item, delete item, you know,
all that all that crud that that we're we're used to. And then I I in most cases, I probably want
like 90% of those also to be available to the agent so they can just programmatically call it. So
like I see a place where you maybe aren't doing a whole lot other than just throwing in like a
plugin or a hook or something like that. Yeah, and I mean, it also allows us to, you know, if you do
exactly what Wes is talking about, you can also return structured errors back to the LMS, you know,
you plug in exactly the what success happens and the reason and so that the agent knows what failed.
So you already have existing, you know, mutations, actions, dispatch, kind of logic, you can leverage
that existing logic for some of your tools. What like what kinds of apps are like you see like the
most obvious benefit from this type of thing? I know it probably can be used for anything, but
is there any like specific use cases where yeah, that makes a lot of sense. Well, we're collaborating
with people like Shopify has integrated. So we're seeing a lot of use cases for Shopify as, you know,
obviously e-commerce is a big one. Yeah, right now we're talking with YouTube about their
in-page agent being able to surface like if you ask YouTube all of the things that people might
not normally get exposed to that are on the YouTube page like playback settings. And I mean,
that's one that people usually find, but there's all sorts of settings in YouTube that people don't
necessarily find easily easily. So anything where discovery could be limited and an agent can kind
of surface those discovering mechanisms. Instacard is another one where people probably want to like
identify or make their shopping experiences a little bit easier things like that. We're seeing a lot
of benefit from. So yeah. Yeah, and I'm sure you're going to uncover a lot too with this web
MCP challenge that's going on. So we have this new web MCP challenge. The deadline is September
3rd. So by the time you're hearing this, the deadline will have passed, but it seems like there's a
massive amount of submissions or at least people signing up to be potentially submitting this
already. I would imagine you're going to see some really cool stuff in Sarah. You're a judge
for that, right? That's right. Yeah. And we're looking at like creative uses for web MCP. We're
looking at for the good of humanity. We're looking at do you structure your tools well and make sure
that everything is, you know, kind of copacetic and easily surfaced by an agent. So there's a number
of factors we're taking into consideration with the judging. I am really excited so far. I think
last I checked, it was like 5,000 entries that already gone through. Yes, one of those will be
mine. So hopefully my tools are set up. One of the demos that you gave was like a 3D modeling
software, which 3D modeling software and video editing software, I think are two huge use cases
for this because those are UIs where like I'm not using a chat for that no chance. But like we
all of us on syntax, we use DaVinci Resolve and we all the DaVinci Resolve MCP running because in
some cases, it's way easier to just type in the box what you want it to do than to figure out what
the crazy clicks and whatever that you need to do. And I love I've been calling it you're
calling it co browsing. I'm here to tell you it should be called clicks and clankers. You know,
because we had we had bricks and clicks when the like the web is coming, you know, you have the store,
but you also have the online thing. Now we have the human and the agent clicks and clankers.
Nobody seems to be it's not catching on. So I'm reaching out to you to for that help.
Well, make it happen. But no, I prefer that general use case like I do a lot of like maker space
stuff and like, you know, CAD modeling and like there's there's only so many times I'm going to
like relearn how to do the same thing and like fusion 360 and like I'd really just want the chat
to be able to like, okay, I can describe exactly what I want. I can kind of probably get
through on my own, but it'll be quicker if you could just, you know, take my intent and map it to
actions on the actual site. And so I think that kind of use case where these complicated configuration
you eyes, but I also still need to be involved because I need to like double check the end result or
see the measurements or whatever that that's I think the most, the most like immediately useful.
But like we said, it's also pretty useful for headless scenarios. Like a lot of times if you're
just messaging your, your, you know, codex bot on telegram and telling it to do something,
it's going to open up a headless Chrome in the back and talk to it through CDP. If every site it
uses has web mcp tools or can talk to the service worker tools inside web mcp and do some background
executions, it's going to make even all of the headless scenarios like just as easily if if they're
if it's not talking directly to the server. So I really, I think it's a unlock for a lot of
different use cases, clicks and clankers and headless. That headless one because I was talking to
some people earlier on in web mcp and there wasn't like any headless thing now, but now you're saying
there is. So like you're saying that I could technically just have like a like a box running
somewhere with like or or my just leave my laptop open. And if I have my websites open or they
can open them, then I'll be able to access those sites that have web mcp. I think so. Yeah, like if
if you're if you're messaging your, you know, your bot on on some VM somewhere and and it's really
doesn't present a lot of UI to you unless it really needs your intervention or something like that.
I go tell it to you know register my car or update
my license registration or something like that.
And it navigates to the site,
the state of Massachusetts does not have like an MCP server.
I'm sorry.
And so, but maybe we convince them
to drop a couple attributes on their forms, on their site.
And now, my bot, wherever it's living,
headless or not, behind a hologram VM or not,
if it can actually the site through WebMCP tools
exposed through CDP, it feels headless to me.
And it doesn't really make a difference
from the agent's perspective,
because it's just interacting with the site in any way.
So, I think that's kind of the idea.
- I mean, if you never have to go to a site
or whatever to register your license,
or like, I would love that.
- Yeah, exactly.
Sarah promised me a promotion,
if we can get all the same to registration sites to do that.
So, perfect use case for something I'm working on,
because right now, every single time it does,
popped up in DevTools MCP specifically,
I have a Mac mini right here behind me
that you might be able to see it flashing
occasionally, that's because it's running DevTools MCP
to export a video from this application.
And this is like such a perfect,
that if I would never need to see the interface for this,
the process should just be able to do it headless.
So, that's really exciting to hear.
- Yeah, I mean, the DevTools for agents stuff
is really exciting.
If you're working with WebMCP,
like sometimes people, we get a lot of people asking us,
like, how should I be debugging this?
I think DevTools Chrome DevTools for agents
or DevTools MCP is a really great way to like send an agent
off to do a bunch of things.
It also invokes Lighthouse for agents.
It also can perform audits for you.
And so, if you're not using that already,
it can integrate with a lot of different models,
including the Frontier models.
So, that's a really good debugging journey.
I think some people, maybe not everybody knows
that there's also a Chrome extension that you can use.
So, I also tend to use the Chrome extension with,
if you look pop open DevTools in the application tab,
you can see all of your tools listed,
and then you can invoke the tools on the page
and automatically see right in the page feedback
for how those tools are getting executed
and some observability.
So, like, there's a number of different ways
you can do it, some are like headless,
some are like directly in page, and those are cool.
- And what's that Chrome extension called?
Is that just the Chrome DevTools MCP extension
that's been rolled into that?
Or is that the separate Web MCP extension?
- Yeah, there's one that's right directly
in Chrome DevTools.
That's the one that I was mentioning in the application tab,
and then the one that Scott is talking about
is a more headless model that you can just run
in the background and, you know,
it kind of operates sort of like playwright and puppeteer,
which are also good debugging tools as well.
- Well, that's awesome.
Another question I had, I don't know,
maybe six months ago when we first started talking about this,
was like, what about multi-tab?
And like I assume that you have two tabs open.
Both of them expose Web MCP tools.
Your agent would be able to use both of those, right?
Like one example I had is I built a shopping list application
where you could add stores and you can add items
to each of those stores and you can mark them off,
yadda yadda, right?
And then I had another recipe website open,
and I wanted to get all of the ingredients from that
and put them into my shopping, right?
So that's two totally different websites,
two totally one web MCP, one was simply just scraping,
but like I should be able to do that, right?
- I think yeah, like the, you know,
the agent will be able to use Web MCP tools
where they exist and make use of that site functionality
when it can, but ultimately, yeah,
it's the agent's sort of prerogative to understand
what origins to reach out to,
what tabs it makes sense to interact with
to fulfill kind of the user journey.
And this is actually one thing we've been,
we've seen a lot of confusion about with Web MCP,
when folks are reviewing it from like a traditional web
platform perspective, it looks kind of like a wonky API
'cause it's sort of like the first of its kind,
like really facilitating agentic use
of traditional web content.
And so I think a lot of people mistake it for like,
oh, this is the agents on the web API.
And I think from our perspective, it's really like,
no, this is the like, let's give developers a chance
at presenting something that's sensible for agents
because agents are already on the web API.
Like it's, agents are using the web,
you know, regardless of whether Web MCP exists or not.
And so, so we've been like really trying to understand,
you know, like there's been a lot of confusion,
for example, for security.
It, you know, when people think through
what it means for an agent to use a Web MCP tool,
kind of like, oh, like an agent can use this tool,
but what if it has like some stuff
from another origin like in its brain
and it wants to like share that information
with this tool, that's kind of like violating
the same origin policy, right?
Like that's kind of scary.
And that's that's violating core.
Like what does that mean?
And I think it's a little hard to think about
because we don't mind users violating the same origin policy.
I'm the user.
I can see all my cookies.
I can see all my tabs.
I can see all my origin data.
But that's because the product is kind of serving me.
And so in one sense, the agent is kind of an extension
of the user and sort of punches through
the traditional like web sandbox security model.
At the same time, like users are not comfortable,
just like probably giving the agent its entire identity
and letting it assume it's full persona like on the web
and just browsing to whatever it wants.
And so there's only so much of this
we can control from the platform perspective,
which has like the same origin policy and cores and all that.
And we're starting to think about what it might make,
what it means to produce like an agentic platform
like in the product.
And instead of thinking about like the same origin policy,
what does a safe origin policy look like?
Some agentic model browser so that the agent can know,
like yeah, I should be able to assume the user's identity
on these four sites related to this task,
but I shouldn't be able to do everything.
I can't read all their cookies, I can't.
You can go to their bank and start making transactions.
And so we're starting to think through
what a capable, agentic web harness looks like in a browser
that integrates somewhat with the web platform
and somewhat with the product.
To actually make agents on the web secure
and also facilitate the use of web MCP
through traditional web platform content.
So it's a complicated model, but.
>> Yeah, and like to zoom out for a second.
So there's, as Dom said, there's only so much you can do
on the platform side and for site developers,
but we're also talking to agent developers
and our own agents about what's potential there.
And I think one thing to get people to really understand
is that this won't be solved by one thing.
It has to be a multi-layered defense strategy
because agents can be somewhat non-deterministic
and also you need both the site side and the agent side.
So some things that we're thinking,
we're doing within Google that we're thinking
about open sourcing and making more of a standard
are things like prompt injection classifiers
so they can identify attacker instructions in content
before instructions kind of go out.
Critique LLM's, a lot of people know
about like a secondary judging LLM.
You can imagine that being applied
to like web surface areas.
And then also just like restricting origins
like you may want to have like that LLM,
that's a judge say, okay, you were supposed to go book travel
for me and you can go to Expedia and United,
but why are you going to my bank?
Why are you going to my health site?
Like to make sure that we're not going off
to origins that they shouldn't.
And finally, there's like this kind of
special agent containment layer
that we're thinking about exposing to the community
so that agents can have like more of an identity
that's separate from the user.
Like so far, the agent is you.
But you could imagine that you also,
you might want to have an agent identity that's separate
from you that like can only spend $20 a week,
only has access to some information about you,
only has some passwords, things like that.
- Here's $20.
- Yeah.
- I gave my Shopify 20 bucks.
(laughing)
- The Shopify has like, if you go to any Shopify website,
they have like a forward slash agents.md
with all the information about how to communicate with it.
And I, you have to like explicitly give it a little bit
of money and let her rip.
I thought that was funny.
(laughing)
That's great. - Oh, my God.
(laughing)
- Can we talk about something that makes me sad
about the web is the performance
where we went in like the process of like a year and a half,
we went from, it really matters how quickly your key ups
happen and you should not block the thread
and that we have all of these web vitals
about making everything super fast.
We cared so much about all of that stuff.
And then these agents came around
and it takes like four dollars and three minutes
to click a link to do something.
And I was like, like this, the experience sucks.
If you're out somewhere and you don't really care,
but when you're waiting on it to do work,
that experience is absolutely awful.
Is that obviously web and see people get that better,
but will we bring vitals to agents?
- Yeah, I am actually kicking off a,
like what would core web vitals look like
for an agentic web thing?
So, there's things like, you know,
if you're using, you know, Claude or Gemini or Chachikipi,
that time to first token is a new metric
that everybody's kind of looking at.
And that kind of, those kind of streaming deltas
because you don't have just like the second it goes,
but you also have the second that it like
streams all of the possible input.
But in co-brows or wait, what was it?
I clicked and clankers.
- Clicks and clankers?
- Clicks and clankers, okay, I got it.
And clicks and clankers approaches.
You, the thing that's fascinating about it
is that some of the old Nielsen things still are,
like are still some things that we're seeing here.
So like one second per tool call, five seconds
before you wanna see an entire action go through.
If you're not familiar with that,
those are some of the earliest human computer interaction things,
like people don't wait longer than five seconds
for a web page.
That actually has worked in like,
Click, click, click, click.
is approaches as well. But the thing that we didn't have in there is that when you're watching
co-brows, you're not just judging the agent and the time. You're seeing how fast it is compared
to you. Because you don't want to be doing an experience on the web where you're like watching
it and you're like, "I could be clicking that faster. I could be doing this whole flow faster."
And so that's the first time we're seeing metrics that might be comparative to a human.
And the real trick is exposing that to developers. In the past, we could let developers do things
on their site and we have performance observer and that kind of thing that lets the developer get
access to how long that navigation took and how long that animation transition took. And
they can understand when they make changes on their site if it affects the user experience through
real user metrics. But the agentex side of things is a little trickier because a lot of times the
the success metrics are kind of locked up in the agent's brain. It knows how many model turns it
took to fulfill a user journey. And how many user journeys were completed with a web
MCP tool and how many tools were involved and how many tools confused the agent. And so we're
also trying to think through super early on this, but we're trying to think through some ways to
expose some of those metrics to developers as well, whether it looks like some agent performance
observer or some reporter API or something like that, where we can let developers actually measure
the effects of the agentex targeted things that they're doing on their site. So they can know if
they're actually having a positive or negative impact. Because right now, it's slow for a lot of
reasons. And web MCP tool calls make that a lot faster, but some of them are still slow. But
one of the really big challenges here is the whole thing is opaque. We kind of really have a hard
time measuring how changes I make to a tool impact the success rate and how they impact the latency
and what's confusing the model or not. And we need the developer to transparently understand that
kind of stuff on their site or else they're flying blind and it's going to be impossible to make
changes and measure against them. I also have a way to like measure just for like regular people
using it as well of like like success rates and whatnot. Like I think back I was booking a hotel
on Expedia a couple of weeks ago. And like I wanted to buy I wanted to book like a suite that
a separate room and that wasn't like a filter on Expedia. And I was trying to do it entirely
agentically. And I was like this is awful. I need a map. I need photos of it. I need like all of I
need the UI. It's not a very good experience, right? And like all these tech bros are just like oh
yeah, booked a flight for me and I bought red shoes online. And like that that's not how regular
people do do their work, right? So like is there some sort of like measurement that you're doing
with like regular people as to like whether this is something they use in a sticky enough?
I do think that for some of the like crux things that we're working on for agents. We are
invoking like we have a bunch of UX researchers who are looking into this so that we do these types
of studies both with like real users and then also by doing analysis of the web and like we have
a lot of data because of Chromium being used by so many people that we can kind of leverage here.
I would say that we're pretty early in like full stop. This is the way that everything works.
We do have some targets. And like Dom said, I don't think that anybody's at those targets yet
because these experiences are so new. People aren't even used to building out a product experience
that might incorporate something like this flow. Like that it even just like for PMs of a site
to like think through. Okay, what does that look like if somebody is going through a cobras flow?
Sometimes we've had these like deeper partnerships, but we do need like site developers and product
managers and everything to incorporate that kind of thinking as these you know new agentic
surfaces evolve. And I think West you make a really good point about the multimodality of it.
Not everybody's going to be using the web the same way. I think
some people are like, oh, the web will go away. Just be people using it in a headless way and then
people go, no, nothing's going to change. And I think the truth is like these experiences are
going to be done all sorts of ways like even a shopping experience. If I'm shopping to like,
you know, as like a leisurely activity, then I'm going to be a human in the loop in that activity
because that's part of the point. And I think a lot of these things are going to evolve as we, you know, XR,
whatever experiences involve with it. Like, oh, computer, show me what I look like in this shirt.
Okay, now this shirt, you know, I mean like who knows? Well, that's it. It's going to evolve
as we go. Yeah, totally. It's definitely one of the challenges of API design and this kind of
initial era. Like all of this agentic web space is super nascent. And so it's hard to tease out
some of the patterns, you know, we're seeing and, you know, derive what experiences we can from
from actual MCP and see what makes sense over in web MCP and, you know, everything's new and moving
so fast from the developer side and from the model side. So it's kind of hard to pin this down
and understand exactly what, what makes sense. Which is why the origin trial and the hackathon and
that kind of stuff is a really good way for us to collect experience. Have you heard from any
site owners who are like resistant to this type of thing? Because like, that's like another weird
spot is like, if I'm an airline, I don't necessarily know. And this is more like the MCP server
way. If I'm an airline, if you ever tried book a flight, they try to hard upsell you on absolutely
everything, they, well, what if you get sick? $20 for the insurance and all of like these like,
like, black tactics, um, GPT about to be defensive about that, right? Oh, we thought you might need
this. So therefore we added this. Yeah. So like, I'm wondering like, the airlines doesn't just want
to be like a, like a straight up utility for just vending out the cheapest flight for this type of
thing because they want to be able to make, make more money as well. So have you heard any like,
pushback from people who own sites are like, nah, we don't want this. Yeah, there are a couple
of cases that I probably can't disclose on a podcast. Um, I do think that there's, um, you know,
when I look at the interest, it's far more people wanting to expose Web MCP and tools because they
want the agents to be able to discover and not fail. And like, I think what they're really worried
about is like, oh, okay, if it's just DOM, DOM actuation and things like that, then we can't guarantee
that they're going to have a good experience. They might go to some other place or something like that.
So mainly it's interest, but there have been a couple of outliers of people wanting to be like,
maybe we just say everybody go away and like abuse in that kind of direction. Um, I think in cases
like that, we're still like Dom said, we're so early on in trying to figure out what those loops
and experiences might be. Do you empower the user? Do you listen to the site owner? Like,
if the user really wants to be using an agent, are you going to flat out tell them no? Like,
I don't think that the industry has a collective answer for that yet. Um, but typically we try to like
put the user first. Um, and so that, you know, is a little bit of attention. Thankfully, it's not
that common. That's good. And of those ones that are common, I wonder how many of them are just
trying to protect their business of like like like either like come along for the ride on the agent
world or or like be left behind a lot of people are saying. So I don't think that's all of them.
I think there's certainly a lot of people who can like, like I guarantee Amazon could say, nope,
none of this and and that would be a big problem. Same with like Apple Pay at Walmart. Walmart
just says, nope, you know, and like, that's a big deal. They're big enough to do that. But for a lot
of people, they're not big enough to actually to push people around like that. I did not know that
Walmart does not take Apple Pay. That's, that's just to me. They haven't Canada for years,
but Canada is a great country. Apparently, US is just getting it now. Yeah, just getting it. Yeah,
end of 2026. Wow. It's hard space though, right? Like should my agent be like watching ads for me
if that's like what the site wants, like, you know, probably probably not or like should it be
clicking on ads that I think I'm useful. Like there's a whole monetization model that's like
totally nascent here about like what what does agents on the web even look like for the
traditional funding and attribution and refer and all that kind of stuff model like that is
that's like a whole new space. It's it's beyond web MCP. I mean, it's web MCP laid plays a role in it.
But I think, you know, we see we see a lot of different corners of the industry rallying to
answer similar questions. Like this is kind of, you know, also related to the UCP, the commerce
protocol spec, you know, like there's a lot of upselling there. Like how does that integrate?
You know, there's got to be answers with that. Um, I don't know, maybe maybe someday there'll be
like an ad viewing spec where you can view your ad through MCP. No, I'm just kidding. But like, you
know, it's there's a lot of a lot of new things here. And then and then obviously the the natural
thing is for like large kind of like business conservative enterprises to to maybe resist it and
keep their traditional model. But I think ultimately most most vendors of that sort will end up
figuring out a way to integrate industry solutions to, to, you know, enable new ways of monetization
and new ways for agents to interact with their sites. But exactly how is it's unclear yet? But
yeah, it's it's going to be an interesting future for sure. We are working on some things internally,
but I don't think that they're totally ready for prime time. Maybe we, you know, send you all links
in the future or something. All right. Send it a sorry way. I didn't realize this. So like for
people listening, that's uscp.dev universal commerce protocol. Um, and then I've also big
keeping my eyes on the x402 project, which is like, agentic payments. I know Cloudflare
is rolling out wallets soon. I know Stripe is has their wallets in the US.
US, which your agent can spend money on, so it's, that's obviously not part of Web
MCP, but it is kind of related as to how the agents use the web without bankrupting
everybody.
I mean, we do examine this as part of health of the web because in order for people to
keep the web healthy, they need a way to make money off of it.
So if you have like, beyond commerce, if you have a content site that makes money off
of ads in order to show and display content, then you're kind of going toward more towards
a subscription.
Why can't I say subscription?
A subscription model for those things.
Yeah, totally.
Yeah.
I mean, because the AI agents are just slurping all that stuff up now and there goes your
income.
So yeah, yeah.
It's a different world, I think, for a lot of sites that are trying to work on that
model right now.
Yeah.
And I think it's definitely, I think it's important that the web evolves to try and meet
the moment.
Like, I think there is a lot of, you know, understandable and natural pushback in general
about the web evolving too fast or adding too many AI's that are tailored to agentic
experiences.
And you know, these things have a necessary long tail of controversy that we have like
the Web MCP and the Prompt API and so forth.
But like, I think it's ultimately a good thing that we're focused on trying to figure out
what the web's real place is in this kind of agentic world because like, I'd certainly
rather us all argue about a healthy web that is still relevant than a dead one that died
because we didn't keep up with any technologies that are coming down the pipeline.
I think that's like a really important thing to worry about if the web doesn't really
meet the AI moment and figure out what it means to present kind of kind of two platforms
now, right?
Like traditionally, it's always presented the web platform to developers and to the user.
This is things like readable streams and module scripts and anchor positioning, but like
now, we probably need some like agent platform side of sort of things where, you know, I
kind of envision a future where you can plug any agent brain into your browser and then
that agent brain can sort of get like whatever containerized access of, you know, to your site
data or things that are useful to you as the user and be constrained by the guardrails
that the browser's agent harness kind of is able to provide and then whether that is partition
credentials or read-only views of certain, you know, parts of the user's personas that
they can actuate on their behalf.
And so on, like all of these kinds of things, like, they are going to have to, you know,
we're currently working on them and we're currently trying to figure out what they're
going to look like in the future and understand what it means for the agent to kind of have
a sort of the browser to play a role in sort of like this agent platform, like space because
that's kind of, that's very new, like we've only had platform and product and now like product
is kind of containing like a bunch of agent primitives and we're actually thinking about
this from the extensions point of view on Chrome as well, like it's really widely known
that like a lot of agents that are living in extensions on Chrome, like they need like
full access to the page and so they get like accessibility tree and screenshots and all
those kind of stuff.
But to do that, they kind of end up tripping over the debugger API and then it kind of flashes
this like scary banner and enterprise clients don't don't like it because the agent has so
much direct control over the page through an API that was never really designed for agent
usage.
And so we're kind of stepping back and being like, what does it mean to like re factor
and redesign all of these things to provide like an actual agent platform for agents to
plug and play straight into your browser, but, but meet the safety standard that the
browser is known for through whatever say forage and policy or harness or tool, tool set
or read only view of the user's state or data that makes sense.
And I think that that's like one really big thing, I think is important for browser vendors
to focus on.
And it's actually it's the reason why we see a lot of these new, agentic browsers sort
of come and go from other companies, like they're spinning up their own, their own binaries
and trying to encourage users to use them as their browser, not because they're differentiated
themselves on the web platforms perspective, but it's because they bring with them a bunch
of agent tools that traditional browsers might not have thought about from day one.
And so I think it's important for all browsers to understand like what it means to kind
of be an agent platform and a harness and I imagine like a large suite of plug and play
configurable tools and security policies and any kind of browser that manages an agent.
I mean, it's a Dom's point.
If you don't think about it, then you can't secure it, then you can't make it private.
Like whether or not you want agents to be on the web or any individual browser wants
agents to be on the web, they are on the web.
What security has been talking about is this fourth actor, right?
Like you have the platform, the user and the site.
And then all of a sudden you have the fourth actor, which is AI agents and they call that,
you know, insecurity, we call it a trust diamond.
And that you can't think through those pathways and actually make them safe and secure unless
you're actually paying attention like the you're not here.
Me.
I can't see you.
It's not necessarily the approach that's going to allow us to make things safe for users.
So WebNCP supported by OpenAI, Chrome, Shopify, Versel, Cloudflare.
Have you heard any peeps up or down from the two boogie monsters, Anthropic and Safari
or Apple?
Firefox and Safari or Anthropic.
Well, Anthropic, because this would have to be in Claude in order for it to be like
everybody to use it, right?
There's such a big player at least right now.
And then like Apple and Mozilla as well, I guess, yes.
Yeah.
We have heard from all of them, like we've been talking a lot with Mozilla about
the imperative API.
They're pretty interested in it and they've expressed some public support to the imperative
side of things from WebUpsDB, which is awesome.
We've been in discussion with other model providers like Anthropic and browsers like Safari.
I think probably we can comment on some of the stuff that's already public.
I think there's a lot of enterprise interest from both parties because this is where a lot
of knowledge work happens.
It's making sure that there's widespread adoption among developers that can help
and enable WebUpsDB in these products, makes a lot of sense.
And yeah.
Sarah, do you have anything to add to that?
Yeah.
So we are talking to all of the people mentioned.
They are investigating what it means for them.
And so as part of that investigation are doing due diligence on what they want to be supporting,
what they don't want to be supporting and formulating thoughts.
And so I would say we're still in the kind of like meeting with people and talking through
things, stage of things and not in the like, here's what we can formally announce, stage
of things, but it is covered territory.
That's cool.
I had used a WebMCPB extension, which basically turned my WebMCP websites into like a proper
MCP server.
And that was really cool because then I could just, I could take that MCP server and put
it into anything that supported MCP and then I could just chat with it.
Right?
That was cool because I did, I slapped it into Claude.
I typed into Claude, but I could see it controlling my browser.
So I thought maybe that will be an experience at one point as well, even if they don't end
up supporting it.
Yeah.
I just talked to him last week.
He's really like, I don't know if you've talked to the creator of WebMCPB.
I think he does a really good job of like thinking through what people might need because
he used to be a consultant for all of these kind of like sales force and other companies.
So he's kind of good at those like glue layers.
We are incorporating a polyfill that, you know, he worked on previously and things like
that.
So he's a really good community member and I like the work that he's been doing.
This is Alex Neha, so yeah, he's been great.
He's been an awesome partner.
He was one of the original folks that came up with kind of the original shape and idea
of what WebMCP might look like and he's pretty active in the community group.
It's been great working with him and you know, building poly fills alongside of him and
so on.
Yeah.
But you can definitely imagine that any model vendor that has a Chrome extension or really
wants to be able to perform knowledge work tasks for users really wants something like
this.
It's amazing.
I mean, every time we bring it up to people and their eyes light up and they see all the
benchmarks go green and they're kind of like, oh, my gosh, yes, this is this is saving
time, dollars, latency, everything.
And there's already been a bunch of public like benchmarks about this that actually integrate
to kind of build their own harness sort of like MCP that sits in between WebMCP tools and
the cloud code harness or the open AI extension and so on.
And so you can actually get a feel for like what it would, what it would look like for
these extensions and model providers that don't support WebMCP today.
Like what it would look like for them to actually do so from a performance and a usability
perspective and so far, it's been it's been really good feedback.
Yeah.
Is there anything else that we haven't hit that you all want to make sure we cover?
I think I think the one thing I'd love to to encourage is the community to keep tabs
on the W3C spec, you know, every every day we get new issues filed bugs or proposals or
additions and so on, straight to the repository, it's a really good way of getting real world
developer feedback and real world model vendor feedback like we have extensions, you know,
folks that build kind of like community, DOM actuating extensions, they love to chime
in on the repository and help us understand what parts of the API makes sense for their
harness and what doesn't.
And so we would love people to just stay, stay in touch and keep in the loop with the
API and also provide their feedback to us because it's all super useful.
Like we mentioned a few times, this stuff, it's a really, really early space and we're
We're figuring it all out.
out and we're trying to make sure what ways we can impact the security and the usability of the
API. And so I would encourage people to sustain the loop and start experimenting. There's been some
really, really great tools being built. There's ORA.ai, which is a tool that has been built by one
of the MCPUI co-creators. And this kind of helps you measure how agentic journeys are actually
happening on your site and how WebMCP tool calls are being used by real-world agents. And it's a good
benchmarking kind of framework that we've been looking at and thinking through as a way to understand
how useful tools like really are. And so the more feedback like that we get from the community,
tools being built to measure how good WebMCP tools and agentic experiences are, all of that really
helps the industry create something measurable and effective from the use of not just WebMCP,
but anything agentic on their sites. So we would encourage developers to get as involved
in that sort of space as possible. Because I think it's super useful feedback for the browser
engineers and model vendors as well. That's great. Yeah, like seriously, folks, listening to this,
try build something, slap it in your site, try build like a little to-do app or whatever,
and like give your feedback now. Because like one of my first pieces of feedback was like,
I want this to be headless as well. And like, I don't think that was me, but like now it is,
right? And like provide your feedback now so that we can like nail this. Because even if you look
at like the journey of MCP, it's had so many high highs and so many low lows. People have been
said it's over like six times since it's been released. And it's just because we didn't know what
it needed to look like. So like chime in. And then that's super helpful.
That was so funny. I was at the MCP Dev Summit conference in New York City in March. And you know,
the whole, this was like when skills were happening and CLI kind of popping off and everything
was MCP is dead. And so they actually threw an after party on one of the nights at some like kind
of like dark, nice cocktail bar in Manhattan. It was called MCP is dead, the funeral. And they had
like a quartet and they were like singing sad songs. They went so far. And so I'm like, oh my gosh,
but yeah, it's entertaining to see all the community hype and unhype about random things as
they fluctuate. But yeah, otherwise, thanks for giving us the opportunity to chat about Web
MCP and kind of talk through what we think the future of all of this stuff might look like.
You know, we're marching forward as fast as we can, but also a lot of this stuff is pretty early
and speculative. And so, you know, we'd love to stay in touch and keep an idea on what
developers are building with with these tools and how they work in public. Amazing. So now it's
the part of the show where we give you the opportunity to share something that you're really
interested. We call them sick picks. These are things that are just in general that you're enjoying
in life right now could be literally anything from a TV show, a podcast or a what did we sick
pick to I picked some sanding paper. So you can pick whatever you want. So Dominic sir, do you
have sick picks for us today? What grit? Yeah, oh, he's got he's got all the grits. Yeah,
with a wet sander. Oh, it's yes. Oh, I got like nine different grits. So it's for a sanding
3D prints. I had a little 3D printed device that I sanded down and it's so smooth. You can't
even tell it's 3D printed. It's beautiful. I thought yours would be more about like dancing and
break dancing. Oh, we have tons of these. I have sick picking for eight years now. Yeah,
dance competitions. Absolutely. Yes. I'm happy to go. Yeah, go ahead. One thing I was I love
really, really good writing. And so one thing I would love to recommend to people is this book I've
been reading called The Sense of Style by Stephen Pinker. It's a book about writing and it's a kind
of a style guide to the classical sense of writing, which is like its own style on its own.
And it's written really, really really well. I like to write and I try and you know be as good
of a writer as I can. I love reading really persuasive, succinct, concise, impressive prose.
And I think this book is filled with that. So I'd recommend it to people for sure.
Well, I'm gonna feed this into my prompt into my into my clanger.
I think mine is if you all like Minecraft or if your kids like Minecraft, there's a game called
Vintage Story. It's a harder version of Minecraft and it's sandbox, but it's very survival style.
So you're the first human. You have to survive the winter. It has some like lovecraftian horror
vibes and elements. And you can mod it to your liking. But it's really hard and really fun.
So if you're like, you know, into Minecraft and you want like to level up and some
difficulty, me and my kids are just having so much fun playing that.
Is it, can you play multiplayer or are you just taking turns? Oh, okay.
Yeah, yeah. It's actually really fun multiplayer because then everybody can like
help with different tasks and things like that. You can do like a kind of collaborative effort.
My kids are both into Minecraft right now. So perfect, perfect opportunity. Yes.
Nice. 24 bucks, too. I love, I love that. You don't have to pay monthly for this thing.
You just buy it once. That's great. You're so sick of all the subscription things. Yeah,
me too. I'm over it. It's too much. All right. Next thing we have is shameless plug.
This is, it gives you a chance to plug as many and whatever things you would like.
Can you guys bring your plugs today? Yeah, I would say, for me, mine's pretty boring.
Just feel free to follow me on Twitter or X just at Dom Ferralino.
Should be pretty easy to find. I tweet about random web platform API things that I'm working on
and stuff in specs and web mcp. And so I'd love to hear from people over there.
I'm Sarah Edo on X and other platforms. One shameless plug I do is that we're both
speaking at agent con in San Jose. That's run by the Agente AI Foundation of Linux Foundation
in October. So they gave us a discount so you can get 25% discount with community 25.
Wow. Awesome. Thank you for sharing that. We'll make sure that's all linked up to.
Cool. All right. Well, thank you both for coming on. Appreciate this. Let us know down below
in the comments what you think of web mcp and we'll catch you later. Peace. Thank you. Bye.