Go back

Box's Aaron Levie: On Reinventing Yourself in the AI Age and Enterprise Diffusion

1h 5m 21s

Box's Aaron Levie: On Reinventing Yourself in the AI Age and Enterprise Diffusion

The integration of AI into enterprise workflows is not just about improving model performance—it's about bridging the gap between powerful AI models and real-world business processes. As the conversation with Aaron Lovie highlights, enterprises face complex challenges like data governance, legacy systems, and human oversight that make generic AI tools insufficient. The key breakthrough comes in the application layer: building AI agents that understand specific workflows, such as contract review or compliance monitoring, and operate autonomously within existing systems. This requires deep domain expertise, fine-tuned models, and seamless integration with systems of record like CRM or document management platforms. Open-source models are expected to grow rapidly in cost-sensitive, specialized use cases, especially as inference becomes cheaper and more efficient. While skepticism around AI-generated content—such as "work slop"—persists, the future will see a shift toward background, long-running agents that operate silently, delivering results without user intervention. These agents will automate critical processes, like security triage or contract analysis, enabling faster decision-making and reducing human error. Ultimately, the most valuable AI applications will emerge in vertical markets where workflows are well-defined and deeply understood. Founders and startups should avoid competing directly with AI labs and instead focus on solving specific, real-world problems through tailored, workflow-aware tools. This approach not only creates sustainable value but also fosters trust and transparency in enterprise environments, where human judgment and accountability remain essential.

Transcription

13992 Words, 74485 Characters

English
I want to send an emergency alert to like everybody who's like a sophomore or junior in college and just be like Follow these 20 accounts on Twitter. Yeah, and and also join Twitter because like this will just help your career You're either like a year ahead or a year behind. Yeah, simply based on your feed and my feed is like so so wired in I'll still talk to to 20 year olds that are like yeah like um, you know I I see some articles and I'm like what do you mean? How do you see articles like I don't even know what that means like Do you just like get lucky that somebody emailed you an article? You just have to be wired in I I enjoy it It's a lot of fun. I play with everything Today I'm excited to welcome Aaron Lovie founder and CEO of box boxes building a collaboration platform and content management platform for the enterprise That is now taken on really new life with AI and I'm excited to chat with you today about box and AI About your general thoughts on AI. If you are such a thought leader and then about how founders can reinvent themselves for this AI wave. So thanks for joining us. Thanks for having me a big fan of the podcast. Um, I religiously Watch every episode and and so great work. I am wondering though. I know this is a different podcast But when do you talk about root canals and oh my gosh, is that We figured out how to weave that in yet or not. I mean, I'm happy to talk about different kind of pain and suffering that We should just do this pod with a with a live root canal. Let's do it. I see how it goes actually That would be like hot ones, but you get a root canal and you have to talk about your strategy while you're in a dentist chair And dog is just on the other end of it. Amazing. Amazing. Dog is so pleased with himself by the way right now Okay, I was seen every tweet. Oh yeah. Oh, oh yeah, he's very pleased with himself. Okay. Okay, let's start with I'm curious to take on this Application companies are the hottest neolabs agree or disagree? Um, you know two years ago, I think it would have not made that much sense as like what does that mean? But but very clearly I think this is what what's playing out in the market and It's all working out mostly because of open source, but what's what's pretty amazing is right now You know the the whole concept of Being a sort of lm wrapper or model wrappers actually working out because What what what I think people underappreciated Was that in the real world in the enterprise What you need is some bridge from the models capability to the actual workflow that the enterprise has and that bridge You basically like probably a trillion dollars has been bet on On basically one of of two outcomes either that bridge is is very kind of limited or that bridge is actually very vast And and needs to be able to to you know take on you know a lot of depth within organizations Um and that bet basically looks like are you only long you know kind of the model itself in super intelligence or are you long this sort of application tier or you know Maybe previously would have been just pure neolab um, but but I think it's very clearly playing out that that actually There's a lot of gap between the model and the workflow and as you bridge that gap over time You get to a point where you realize oh, I should also do the model and and then you have enough data You have enough sort of domain expertise where that becomes its own you know sort of flywheel So I'm very bullish on this on this idea and what's cool is it's opening up like multiple layers of of you know Sort of opportunity for startups because you could either be the actual applied company itself I even neolab or you could be the infrastructure provider to the neolab And you have like multiple layers of of you know going and and attacking that space But uh, I think a huge update for for the market and everybody's kind of use of it Box labs. Let's go. Oh, we already have it. It's a little bit. It's a little bit secret But uh, we we we pay very close attention right now the main focus is let's make the agent really really good on any model, but over time obviously you would peel off certain use cases Either on a per customer basis or or kind of across the the whole data set. Yeah, I mean it seems like there's two forces that are happening One is people don't want the fox to be guarding the hen house They don't want the seller of the token to be the one that is also metering and gating You know, what is the best token for each use case? Yeah, and then the second is you know There's actually a lot of work to do on that bridge to cross and there's real research involved in it and It's pretty bespoke to the exact uh the exact workflow and exact and customer that you have Yeah, I think I think what would I tend to see happen in the valley is and for very good reason And it's actually why these companies have been so successful is like everybody is so kind of research-pilled Which is again totally awesome big fan. It's it's let leads to all these breakthroughs But the the sort of sense that okay the model and the intelligence and the model is kind of the only form vector that matters And then you go to the real world and you sort of see how intelligence actually gets rolled out in people's workflows and The model could be the most intelligent you know super intelligence in the world But that workflow still requires you to connect up to other data systems Still requires these moments where there's a human and a loop interaction There's delays in the workflow and so the the sort of agent has to sit idle There's change management of the actual business process. There's legacy systems that haven't been modernized So you kind of go through these five or ten things that are way sort of you know much more Operational much more blocking and tackling than just the pure super intelligence of the model And the last thing that I think a classic sort of research organization wants to go do is go attack every single one of those things And this is sort of not a there's like this is not a sort of a one-off in history Like we've always had this relationship between infrastructure and application like you know Obviously AWS or gcp or azure have created you know trillions of dollars in value of of kind of market cap of infrastructure But guess what there's also trillions of dollars of value in software That only exists because of that infrastructure and if you were to go back You know 10 years ago and you were to look at what was happening in the data space and you looked at what what you know GCP your early kind of versions of gcp was building or or 80 boasted building I guarantee you would not have predicted snowflake or data bricks existing You would have been like the infrastructure just already does that Why would you pay another 10 billion dollars of revenue to all these other products that are just making it so you can work with your data The same thing is going to be true for intelligence, which is the models will be insanely valuable But the application of bringing those models into real workflows and banking and life sciences and healthcare and government That's just going to be a lot of software now the sort of challenge for the next let's say two to five years Is how much do the model providers need to move up that stack and also try and you know go and compete at that layer Or do they either leave open intentionally or accidentally that entire space for the application sort of ecosystem and actually to some extent This is like a big question strategically for them because on one hand you want to be closer to the customer on the other hand You also want to be able to have an ecosystem so people trust you so yeah So that's going to be like a really interesting tension over the coming years. How do you think they'll play out? I feel like that's the question we spend every day Yes, you can yeah You know, I don't want to speak for for Sequoia But you can sense some of the existential dread of a VC right now is like should I just put another billion dollars into ontropic? Or you know, should I attempt to sort of see what what the applied layer is gonna is gonna play out? So nobody's you know that envious of of your guys position having to figure that out But but obviously it's even harder for the entrepreneur Um, but you know, I am you know, I'm pretty long obviously the application layer like I'm also equally very biased like I'm I have a very concentrated bet With very limited diversification on on it working out that you still want to buy technology that that sort of understands Your workflow and can get to the the core enterprise data But I don't know that that there's I just don't see a different event happening than the then all of history I mean, you know, we only have like 50 or 60 years of of computer software history But basically when you go to that law firm and you go to that you know, farm a company and you go to that bank They need something that bridges the core technology to their workflow and their business process And AI has not meaningfully sort of changed the need or the shape of what that looks like and the and the best sort of manifestation of this is Um, sort of this chatbot versus kind of agentic workflow, you know, demarcation So the chatbot can be totally universal and can be totally horizontal But you know, all of a sudden you kind of look at that and you say well My workflow kind of needs something to kind of ping me at the right time in the process or it needs access to a certain kind of data That that just, you know, the chatbot can't natively get access to so somebody has to go into that organization Like get it set up and somebody has to go and provide domain expertise to this model So it really understands our particular business process Um, and so then unless you really just underwrite, you know, the big labs that at honestly like I'm not exaggerating like 100,000 employees If you don't underwrite that then then the diffusion kind of economy is going to be massive Because every single one of those companies whether that's a 50 person firm or certainly a multi-hundred thousand person firm Is going to need an army of people to go in and help them with that transformation that change management And so this is, you know, like whether it's the FDE phenomenon or just again understanding that domain expertise that that's going to be a very bit deal And then you you kind of alluded to to this point Fox kind of garden headhouse and um, uh, and that that might actually be singularly the biggest sort of reason this has to happen Yeah, which is even even under all sort of like complete benevolence and like nobody's actually doing something Uh, in any kind of like, you know, sneaky way It just stands to reason that if I'm going to sort of give a task to an to an agentic system I just want that task to be cost-optimized like with accuracy as as kind of holding constant And so who can do that? It's it's the company that doesn't care among, you know, ten different models which model is performing that task So like, definitionally, you would want that to be the company that does not have a sort of a preference And in the force you have going against that that is that the model companies can subsidize their models or offer them at different rates. - I don't know how long that lasts though, because when these companies become public, I think they will be held to basically the same laws of capitalism that everybody else is. So the subsidization is working very well up to a certain threshold of spend. And we might have exceeded that spend when you're at tens of billions of dollars of capital. And in fact, if anything, it might even be worse, because eventually you have to go in and sort of pay for your training runs as well. So like the subsidization of tokens is a, I think it just has to be a temporary phenomenon. - You mean from a gross margin perspective or from like an antitrust perspective? - And entirely gross margin. Like if I-- - But they have such high gross margins and they have friends right now. - But what are they subsidizing? Like then it's actually then they're charging actually like decent rates. - Yeah, but they can afford to price the API higher than their own first-party products, right? - So that part, totally fair. You know, there's an interesting kind of dimension, which is well, like if API is the high margin thing that is sort of paying for the subsidization, but you've moved all your customers over to the applied product and there's no API revenue. So like there's like an equilibrium you have to strike with this. - Yeah, totally. - And so then all the while, if you have some sort of either non-economic actors or people just with a totally different game theory in this meta being one, maybe SpaceX being one, China certainly being a giant one, even Nvidia being one. Like that changes the calculus as well, which is those four kind of cohorts don't necessarily need to make money on inference and sort of at least the same margin structure at like what an anthropographer nobody I need. So they would might be fine to bring down inference to 10% margin because they just want to basically pay for massive compute clusters. And then as long as that happens and as long as like there's not insane proprietary sort of, you know, sort of closely held secrets, then no matter what you're gonna have kind of cost per token go down on a like for like basis, all of which means more value accrues to the application layer, which is I think like a very long window way of saying, I think there's just value in kind of everybody in the stack. I just don't know that the only thing I probably wouldn't bet on is just, okay, one or two labs get 95% of the value creation. I think there's just gonna be a much more dynamic environment. And honestly if I were one of the two or three biggest labs, I think I'd prefer this outcome too because back to your antitrust point, like at some point you'll just be nationalized if you're the only thing that is sort of exists as intelligence. So you kind of want a little bit of healthy competition in this ecosystem anyway. - Yep, totally. Let's transition talking about box. I'm gonna come back to talking about tokens in Jevons Paradox and China and all this stuff. But let's talk about box for a second. - I love that topic. - Get folks, I mean, I'm guessing a lot of people that listen to this podcast use box, but give people like a brief kind of explanation of the history of box and then how you're reinventing yourself to the AI. We started the company as a way to be able to kind of securely store and share data in the cloud and it was a very simple idea, but we kind of just kind of cracked a nut or a struck a nerve and for Doug out there, we were able to sort of scale up quickly. We pivoted rapidly in the enterprise and the idea was enterprises would be moving from on-premises systems to the cloud and they would need a better way to be able to sort of store, share, collaborate, manage their all this unstructured data, their corporate documents, their financial documents, their marketing assets, their research materials in the cloud securely. So that was the kind of company. And we had been sort of flirting with AI kind of products and sort of experiences really since like 2015. If you remember like the first kind of rise of the, maybe the at least in modern times, the AI winter that happened in like the 2015 to 2018 period, which is like, we think it's gonna happen now and it didn't, and that was a period where we were like, okay, these very early AI models were showing us signs that, okay, if you looked at an image and you could classify the image, that's pretty useful if you're in an enterprise because now maybe you take all of your image data and sort of label it or maybe you'd OCR something and you'd be able to kind of pull out, kind of sort of the text in there. That's enormously helpful. The problem was insanely expensive and you had to have a model for every single use case required a kind of a hyper-trained model for each workflow that you wanted to do. So we kind of shelved it. Few years later, sort of paying attention to the GPTs. We had some hackathons where people were like, oh, we could do like type ahead in one of our kind of note-taking products and that was sort of early kind of versions. We did some early work in sort of text detection and classification, which helped with security use cases. And then obviously, Chatsby Team Moment sort of hits. And that was the big sort of head-exploding moment. If for no other reason why, then they kind of figured out a form factor that opened up everybody's mind to, oh, these could be these interactive systems that you just like ask a question, get an answer back of sort of kind of increasing complexity and length. So we looked at that very quickly. We jumped all in. We sort of did the whole company pivot. Everything was kind of exactly academically what you should do. We had a team carved out. We put the best people on the team, we met every day, looked at the updates, and then slowly but surely sort of built out what today is kind of our AI stack and then basically the box agent. And for us, you can imagine the use cases is very straightforward. We sit on hundreds of billions of files. Every single one of those files contains critical information for an enterprise. That could be their contracts, their research files, their marketing assets, their loan documents, like all of this critical information. The problem is they rarely know what's actually inside of it. So they, unless you literally look at the document and kind of search and find it, you just don't know what's inside of it. So now agents can go and basically be farmed out to go and answer questions about that data. They can pre-process it and extract metadata from those documents and turn it into structured data. You can use agents to automate sort of steps and workflows. So we built a platform that basically lets you deploy agents against all of that unstructured data. And that's been the kind of core focus. Are you using agents to create new content? We are. There's a couple of modalities where that shows up. One is we have again an online sort of collaborative product that an agent can just like generate any amount of content in it. And then we've done most of the, I think, probably more exciting work with OpenAI and Thropic on just how do you do like advanced document creation, PowerPoint creation. We've decided that their tech is, you know, at this point can always be frontier. So we have an agent that goes and interacts with those systems to produce, you know, a high quality PowerPoint, et cetera. - Awesome. Your tagline, your business lives in content. Unleash it with AI. - Yes. - So what are the hero home run use cases for how people are unleashing it today? - Yeah. - And then if you had to fast forward a few years, what do you think people will be doing with AI and your products in a few years? - Yeah, so probably the easiest hero for, again, more of a traditional enterprise to think about is just as simple as you have a million contracts. Why don't you find out what's inside them? Or you have a million research documents, be able to go and pull out all the critical structure data, put that into a database, and then be able to query, analyze, automate workflows around that. So that's kind of the thing that just knocks it out of the park every single time, because it's been a longstanding problem that people have never been able to go in and sort of apply human, you know, sort of labor to, because it's just too expensive to read every contract, every research document. You know, maybe you could do it if you had like a loan document process, but most other data just never gets read at that scale. And then I think that the stuff that we're probably, you know, as much if not more excited by is, is really the equivalent of what we see with, let's say, coding agents or other complex agents, which is you have a long-running agents that are just executing your entire kind of workflow process. And this would be in the form of you go to a bank and you're onboarding at a bank, and they've basically like automated every step that is possible to automate, and then sort of jumps out to a person in the steps in the process for extra review or extra verification, but now instead of that sort of one or two week back and forth, it just happens in like an hour. Like that's the dream state of most of these enterprise workflows is what if we can onboard a client faster? What if we could discover kind of critical data inside of our research much more quickly? What if we can alert to a security event much more, much more quickly? So to do that, you need these sort of background agents or workflows that are sort of pre-established for those processes. Totally. It's the year of the long-running agent. - It is, it is. - Yeah, yeah. I'm curious, like you made the analogy to Cloud Code, it seems to me that in the coding domain using AI is like not only accepted, it's embraced. - Yes. - In the content domain, which is I think a lot where a lot of the content and box it's using AI to produce content at least, it's just like there's almost this allergic reaction to it, like all the pan-gram stuff on Twitter. There's the, you know, it's like this concept of work slop. - I'm curious what you think about work slop, and like will this still be a thing in a few years? - I'm gonna sort of separate the box corporate hat and just now kind of maybe riff as a consumer of, gosh, I wish there was a better term, but work slop as, you know, inside of an enterprise context. - I get board decks that are entirely in the AI these days, it kills me. - So here's the difference, I think, on the acceptability. So there's probably like more symbolism to this actually topic than just like the slop element, but like actually like diffusion of AI in general, sort of almost ties to this. Code, like other than, you know, the top engineers that we hang out with are like, they have, you know, deep taste in the code. Like, you know, and the judgment is incredible. And like, it is them, and as much an art as it is, science. So take that group aside. For most of the world code is a utility. It is just trying to accomplish something. You're just trying to automate something. You're just trying to put a sort of interface up there that somebody presses a button and moves to the next step. So for most of the world, the value creation of code has been to automate things and to be able to have it as a utility. So at the end of the day, like we're and we'll probably still use the term slot for a while because because there's tasting kind of front and design and there's tasting in sort of systems and you don't want to have vulnerabilities in your code. So that's going to exist for a while. But at the end of the day, if you can tell an agent like please go and generate my entire back end system or my front end system. Like it's just like it's not only acceptable, it's it's preferable because it's just like that was the thing that was blocking us from moving forward. So we need to go do that. At least the way society functions and the way the world works and our brains work at the moment, maybe this changes, you know, when you when you get a presentation from somebody, there's still this association, which is like I'm trying to decide if I can trust that person to go and execute on that thing or deliver that result or understand that topic. And so if when you see workslot, you're like, I'm losing my ability to sort of know for a fact that like, like how much of the of the thought process was them versus how much was the AI? How much did I even care about that? Because I am myself doing the same thing. So like we have this weird like, so it's this very weird sort of like collective issue that we have, which is like, which is like, I'm doing workslop for some of my, you know, brain storms and decisions. But when I get it from somebody else, I'm like, hmm, should I trust you? And I don't know, I, you know, I mean, it just might be a thing that as a society, we have to kind of keep cranking through over the next kind of three to five years and end up at the other, at the other side, like, like, you know, I hate to use like these like totally busted analogies, but, you know, obviously, you don't care when you see somebody's financial model. You're like, yeah, that was generated clearly by like a macro or, you know, I was like, not you did not personally go and compute all of that. But, but you're showing it to me and we're talking about it. So why can't the same exist for a strategy deck or what not? But I think right now we're going through this evolution of like, what is the person's role? What is the content a proxy for? Is it supposed to be a proxy for how much that person knows? Is it a proxy for what we think they can go and execute on? I think, I think we're just in this very messy period where we have to kind of figure that out. Totally. Um, do you read the stand-druck and Miller Well Street Journal? I read the, uh, I read the discussion about it. Yeah, the, uh, the reaction to it. But actually, I, I didn't, I didn't read it. But was it like very sloppy? I didn't think it was love. I loved it. And so to me, it was just a nice counter example of, I have this like allergic reaction. How many, how many, it's not exits-wise were in there? I don't think they were, okay, okay, okay. But it, but it does show up as a hundred percent AI in pangram. Okay. And that's just, uh, they're, I think they're okay. Yeah. Yeah. But it's like, it, it was a nice counter example to me because normally I read something that's clearly written by AI and I just have this allergic reaction. Whereas with the standpiece, I didn't. Yes. I'm not sure how much of that was just, you know, it's stand, therefore I trust in stand versus. Yeah, I know, but it's, it is psychologically kind of, like weird because I'll read these like, you know, um, X articles. And I'm like now, like doing two X things out of work to read these. Yeah. I'm reading it one for the substance. I'm also reading it two for the calculation of like, did the person write it? Or am I just literally reading like a cloud prompt? And then like, I'm like, I'm literally like, my mental processing is now like, should I now, does that up wait or look or like lower my, my sort of judgment of the person or the post? And I think we're, yeah, we're in for some weird times because of this. I would hate to be a college professor. I would just, I would totally quit because you're just like, I don't, I don't know any more what you did. I like what it does seem like the calculator is the closest analogy though. Yeah, except it's just like that was like more like finite in terms and you still had to piece together so many more things. Yeah. Like we like the, and some of these analogies are breaking down of like, it's just a task because it's like, well, at some point like this thing is doing like at least 10 tasks at once. Yeah. But yeah. Let's talk about harnesses. How does the, how does the box create transition harnesses? Okay. Speaking of calculators, it's time for harnesses. Okay. This is back to the kind of new lab kind of applied, applied layer. There's, there's a bunch of things that that we know about our file system, permission structures, our search, our search engine that, that, you know, certainly, and by all means, we actually would love the, we'd love all of the labs to train on our understanding of this because it would only make external agents, you know, better use box. Yeah. Like like we, we, we always talk to labs like, hey, we'll give you as much data as you want about, about kind of how the system works. But, but let's just say like that aside, we have a lot of depth of understanding of what do people do in box? How do they search box? How do they decide when they look through 10 files, which is the one to go pick? How do, what is the, in their, their internal kind of calculus or heuristic on, on sort of figuring out the most relevant document to look at? So we know all of that. And we basically, you know, have built an agentic harness that, that, you know, attempt to understand that set of domain, understanding about our system. It, it obviously has access to our search system, our file system. It has a bunch of kind of mechanisms for just pulling out just the text of a document, just pulling out chunks from the document at doing embeddings on the document on a fly. So there's a set of kind of tools that it can use. And effectively, it's a harness for asking questions of a large data set. So in my box account, I have, I don't even know the latest number, but on the order of tens of millions of files, just because it's like, it's every, everything that has ever kind of accumulated over, over 20 years. But I can now ask any question of, of all that data set using the box agent. And it, it goes around, it does, it does a multiple searches in one, it re-ranks it, it then very quickly sort of pulls out the most relevant information. Then in some cases, read the full document, you know, does all the steps. And then we compare that against like, well, what if we just gave, you know, clotted our API or gave opening our API? And we see like meaningful, better results on accuracy and latency. Because again, we kind of know exactly how to, how to tune it for our workflows. So that, that's effectively the harness that we built out. And then what evals matter the most to you? So I have a couple, I have a couple like, you know, just funny personal ones that I just keep track of of like my own use cases. But we do, we have hundreds of different tests that we do on every single model. We actually have two evals at the moment. One is, we put out a thing called the complex work eval, which is a, which is a set of domain specific work in life sciences, financial services, public sector, tech, etc. And it's, it's kind of exactly what you think of as a, as a document centric eval. So given these five documents and this set of problems, like what would your answers be? And we test every single model against those with our agent. And then we have a hold back eval, which is, actually, the first one is hold back also, but, but the second one is just like, then our box instance and how box employees use, use their data. And then we value every model again on that. So we're able to kind of roughly keep track of, of all of the incremental progress. Like we see when things move by half a point in terms of model improvement. And then we roll out sort of default models, based on different kind of cost and accuracy thresholds. And then we let customers also choose any model they want from effectively our model garden. What's your current view of the race and like where all the horses are in terms of model performance on your use case? They more or less closely correlate code with one exception, which is actually in some of our use cases, Gemini is disproportionately better than what you would see from coding. And it might be, you know, sort of just better tool use, you know, given given kind of, you know, the Gemini ecosystem and what they need to build for, it solves, you know, kind of a strong set of sort of general knowledge work use cases as well. But I think mostly correlating to kind of code. So Fable 5.1 was clearly kind of, you know, state of the art and the best model that that we've seen. There's obviously rumors about other models. And so we'll see how the kind of race, you know, kind of, you know, continues on this, on this front, but, but basically by and large, like when you look at GDP valve, Merckware has their apex, Eval, these things will all generally follow the coding models. And so I think it's, we're just neck and neck on like GROC, Muse, the Fable class and, you know, GPT 5.6 little slash whatever they're building next. Like these are just like, it's a total race right now. And your customers typically express a preference on which model they want to use, or do they just use your default? So they, they, you know, kind of by volume they use our default because it's just easy and it works extremely well. And it's tuned for, there's a few ways are, are kind of agent manifest. So like the way that you'd most commonly experiencing as an end user is you would just be searching and, and kind of, you know, asking questions of your data. But by volume, the volume of tokens tends to go through more of our workflow agents or data extraction. That's where actually you have customers actually doing eVals. And they're basically saying, okay, I want to really make sure that at this cost profile I can get 98% accuracy on data extraction. And that's a place where like we'll have an FDE that goes in and helps you, you know, helps understand your data environment tests against five different models. Yeah. And then you're just basically at the mercy of the Eval. Yeah. What are you seeing in terms of the adoption of open late models in your customer base? So probably higher than people think lower than what enterprises actually want. And much, much, much, much lower than what it'll be in five years. So, so like some mix of that would be the kind of message. And it's primarily cost that's driving that decision. I, you know, I have to probably attribute 30 plus percent to just kind of the the sexiness of, of like, I want to try GLM. Yeah, I think there's, I think there's that like I've heard, I've heard, you know, CIO's of Fortune 500 companies. say we're playing with open source here, and I look at that and be like, well, I know for a fact, like Geminiermuse would have been just fine at that particular cost profile that you're trying to do, or probably even like, you know, you know, five, six, Luna, or Tara or whatever, whichever, you know, one that had the crazy discounting they just did. Like, it probably would have been totally fine. But you want to be able to be like, okay, I'm a little hedged. Like it's cool. Like where that phase still over time, I think it stands a reason that you'll see meaningful different costs because you'll be able to peel off workloads that that just only makes sense at, at sort of, you know, grinding down to the cost of inference, in which case open, open weights will have this sort of economic advantage. Right now there's, you know, this challenge of like, sometimes it's more token inefficient, you know, sometimes like randomly, like I've heard stories like randomly, it'll just speak Chinese like, like mid chain, so you're like, okay, well, that'll be weird for a bank. So, so like, we need to like, probably work on some of those things. But long term, I think it has to be, you know, the case that you're going to, you're going to peel off those workloads. You know, one of the more interesting posts I think on this that I've totally subscribed to is Jesse at Deckergon, do you probably read that post of like, of like, this paradox of like, we're going to have, like, you're going to see close just, you know, continue, you know, go exponential. But what's going to happen is each use case that kind of matures, you can peel off to open source. And once you have kind of stability in that use case, it starts to make sense to veer it toward an open weights model, assuming one of two things is true, one that that it's actually literally cheaper or two, having some post training gets you X, X percent more performance. And, and so I think you will just be in a reality where we will, we will, and this is going to be very confusing, probably for like the press more than people in the valley, because you'll be like, wait a second, like the revenue of anthropic opening, etc. are like off the charts. But somehow open weights is like, also growing exponentially, you know, like, well, how's this like open? High is growing so fast. Yeah. And it's like, the pie is growing so fast. Yeah. But what's happening is, is actually there's, there's an interesting duality. It's, it's not even just like, like, rising tide lifts all boats. It's like, no, no, like, we either use fable or, or five, six for orchestration. And then we farm out all these long tail tasks to a cheaper model, or the opposite is true. Like, you use, you have some kind of orchestration agent that, like, by default does the cheaper stuff, but occasionally sort of see some, something that is just way too hard, and then it pops it out to, to one of these heavier models. And so you might have blended 50% spend on each, but 10 times the amount of tokens, you know, on the open weights model. And so like, everybody's kind of winning, but there's an, there's an interplay between why they're winning. I'm curious about how you think about memory and customization or personalization and where that's going to go. It seems like today, the dominant architecture is, like, rag-based system still, like, you can get fancy on the rag, but it's still context look up where the weights themselves aren't fundamental changing. Yeah. It seems like, I mean, if I listen to my friends at the labs, like, continual learning, this idea of, like, the model's weight should adapt as it gets to know you. We had N-gram on the podcast, I don't know if you know Dan, like-- I just got introduced, and I listened to podcasts, and I would have loved to be a fourth person in the room. Amazing. Yeah. I think they're working with customers to help basically bake in some of the context into the weights themselves. What direction do you think is going to go? You know, you're catching me to time right before I'm actually doing my call with Dan, so I wish I could have talked to him first, and then I'll have, like, a way more eloquent answer. I'm, like, extremely fascinated by the approach. Like, I have no reason for not wanting to work and exist. We live in a world at box where we see the, sort of, the high degree of complexity on permissions and access controls and data that tends to be, sort of, the rub on a lot of these types of approaches, and I'm going to put N-gram aside because, like, I'm sure they've already thought this through. So I'm going to take more generic philosophically. I think sometimes you will talk to a researcher that, you know, sort of imagines the world working the way they work, which is, like, I'm a researcher. I have access to everything. And so if I had a model that was trained just on my world, this would be amazing. And then you're like, let me introduce you to a lawyer. A lawyer, like, has this tiny little, you know, access point of just, like, the five projects they're working on because somebody right, you know, one door over is working on the competitive project to another company in the space that they can't have any sort of overlap with, with what they see or what they know, and there can't be a single document that passes between those two walls, and they have to be these kind of hard barriers. So, you know, so, like, sure, like, you could still, you could still now train a model just for that one user. But, like, what happens if every single day they get added or removed from something that adds important context to sort of what they need to understand? And, and, and, you know, again, like, I think there's going to be probably breakthroughs in continual learning that sort of all resolve this. But, like, this is why previously it was just like, you know, there was no way you could pull this off five years ago because it would be insanely expensive, impossible to kind of wrap your head around around how those access controls are supposed to work. But, you know, obviously with, like, as the cost curve goes down, as open weights, you know, get, you know, cheaper, smaller, faster, better, I think this becomes super interesting. One thing on the podcast that I found very fascinating, and I just need like a T-chart, honestly, is just like, you know, like, what is the decision point of what goes in context and what goes in the weights? Like, you, you have to be a little bit thoughtful about like, where is the, the massive performance gain that you get by, by baking in the weights, and there's probably some, like, incredible, like, like, calculation of like, like, when the rate of change of the data is not, you know, so far, but the upside of the, of the weights, you know, you know, dramatically change the accuracy of the model, like, you know, you'd have to kind of land on some sort of, you know, rubric like that. I mean, if you could wave a magic wand, it almost seems like, I think Carpathy has said this in some prior interviews, like, if you could almost remove all the memorized information from the models, and just have, have it encapsulate the specific reasoning capabilities, like the ethos of how we do things, for example, at Sequoia, and then you have all the, you know, actual content. Yes. And it looked up system that almost feels like the, if you could wave a magic wand, that's what the system was like. Yeah. And so, so that one's super inching. And the, I think the, the question will be, like, how much our enterprise is different at that level versus it's actually their, their literal IP that is what makes them different. Like, how many different types of styles of execution are there in the world? Yeah. You know, it's just like the depth of knowledge about that particular legal case, and, and how do I apply it to this other project I'm working on? That's where so much of the value sits. So, so, but again, if you can just like, wait till my Zoom call with Dan, and then I'll really know the answer. But like, I'm a fan, because no matter what, there's going to be like, like, I've jumped right into like the individual, you know, but like, no matter what, like, at a firm level, there's probably ways to take this approach, like, I'm a big sort of fan of what trajectory or applied computer doing or prime intellect, because I think there's like, there's, there's no question that if you're Eli Lilly, you want a model for how you do drug discovery. And that probably does need to go like farther or deeper or more sort of specific than what you're getting off the shelf. And there's not a lot of sort of, you know, kind of church and state problems for drug discovery, you know, workflows. They probably want as much of that information available to as many people as possible. So, I think it's going to be like domain specific, and you know, you're just going to have different outcomes based on which vertical or, or, you know, type of use case and where the firewalls need to be in that process. Makes sense. Okay. So, you hinted at the beginning that there's a box labs, what, what type of work is box labs doing? So, it's the equivalent of box labs. I don't know if we've used capital L yet, but, but basically, you know, it's our, it's our applied sort of AI team and what research areas are most interesting to your, your team right now? Yeah. So, so the, the biggest areas that, uh, that the most sort of research kind of, or, you know, of the continuum of engineers, there's, you know, some cluster that is sort of more on the research bent, and, uh, of that cluster, the things that we've spent time on still again is at the kind of applied layer, but, but it's a lot around how do you, how do you take agents and make them, you know, another 10 points of accuracy improvement, given X problem. Uh, so what, what is the, what, you know, how do you build a map of the, of the problem set, you know, with a given set of data to sort of best execute on that task? So we spent a lot of time on, on that style of work. We have a team, for instance, working on how do you do, effectively at the agent level, at the harness level, you know, some form of kind of auto research on, on sort of hill climbing on accuracy of answering questions or sets of problems on, on given a kind of a set of client data. So if you're a bank, you have a bunch of loan documents coming in and these like a hundred page documents, like whether you're getting 70% accuracy with an off the shelf model or like 97% is like basically, obviously a world of difference in, can you actually go and automate that process? So somehow you have to hill climb from the base model to the 97% and there's a lot of work going into the systems to basically pull that off. Maybe zooming out, what do you think of as, and this can be a box question or a non box specific question, the role of systems of record in a world with agents, and I'm sure you saw some of the Twitter discourse on like, you know, every software company is trying to sell me their own agent right now. I don't want another agent from them, I want their system records to work well with my agent. And so like, how do you think about that? Hashtag clawed force. Yeah. Yeah. So I, I, I, I, I, I, I, I, I, I mean, literally it's like one of those things where, where like the first three minutes, you're like, man, that seems funny. And then four minutes later, especially when you see the stock, you're like, ah, really move. Like, like, this is great. We're doing this. And then when you, I think somebody, somebody actually said this the best there. Like when they heard Matthew McConaughey say that loud, that was like really the, that's sealed it. That was the aha moment. And it's like, man, he can sell software. Like, it's actually incredible. Like, his voice is so good for selling systems of record in agents. If you're in like, like, hour. sort of contemporary group of like you built the SaaS platform and you have some set of data and workflow that your customers kind of operate in. There's effectively two things you just have to do. And I think anybody attempting to do one over the other is just going to lose. You have to build an agent that is insanely great at your product. Like that agent has to be, you have to provably be like 10 or 20 points better than an off-the-shelf agent using your system. Not because it's hobbled the other side, it's just like you are so evil maxed and you're like so tuned to your particular workflow that that you can improve your system. You have to have that. And you probably because you understand your domain, unless you're like totally asleep of the wheel, you probably have use cases that no one has sort of thought to build products around because you talk to customers every day and you see what they run into. And you're like, oh, we could just like have our agent go do that for you. Like I've had at least a dozen, I mean, so I've probably talked to a couple hundred customers a year in variety capacities. I've had at least two dozen times where the customer has a use case that is like a breakthrough moment for me of like, shit, that would be actually totally insane. Like what's the example? Unfortunately, since you put me on the spot, I don't know if my example will pay off the level of excitement I just had because it's like the thing I was thinking of is just like I think it's going to be a want-want for the podcast. But there was there was basically a customer had this idea of they wanted an agent in the background trying to sort of figure out when documents sort of met their governance policies. And like does something need to go into some kind of archive or something into some kind of legal hold or whatnot. And and exactly, exactly. That's exactly the voice. That was exactly the voice I was worried about. Yes. Yeah. No, you couldn't even you couldn't even pull it off. Okay. So, but in our world, this is awesome because you're like, oh. Yeah. Like no, because think about it. Every company has a head of governance. I might call sincerely. Okay. I believe you. I mean, listen, you do enterprise. So like I think it was at least half serious. Imagine you're an enterprise. You have a head of compliance and a head of governance. Okay. They can only be like overseeing the whole sort of enterprise. They've never been able to be everywhere at once. Now imagine if they could sit next to the employee and and basically be able to be like, Oh, you're about to go do something that breaks our governance policy. So, so like the idea was like, Oh, what if there was just an ongoing agent that just like automatically was just like, now that's going to break your governance policy instead of the user having to like try and predict or understand the stuff. So anyway, those are the kind of things where if you have an agent within your product, you're going to be able to identify sort of sooner and better than than the rest of the market and or just like do things that maybe would be impossible to do off platform. On the other hand, it's just like, obviously you have to go headless. You literally have to make sure that your APIs are exposed to cloud and chat to BT and in, you know, all the different platforms and you have to make sure that you have a either a direct way into deterministic APIs so that those agents can use your your APIs, make calls via MCP or whatever, or at least make your agent be headless and be exposed in those systems. And then the only reason maybe this is like a, it can even remotely a hard debate is, you have to just make sure as a, as a system of record that you can find a way where commercially, it sort of makes sense on the other side and it's sort of valuable and interesting. And the reason why I think a lot of people got that wrong that that weren't in these companies was just underestimating the amount of sort of new use cases that are just total upside. There are like complete white space opportunities for these systems of record. So like in the Salesforce example, I use Salesforce more today, probably by an order of magnitude than I ever have because I MCP into it via cloud or chat to BT. And so, and so I just am always asking questions about the data inside of our CRM system. And do you think that means the system to record become more TallBoost businesses then to make sure that it captures the opportunity? I don't love that term because like no one's had a good experience at a TallBoost. I love TallBoost. You love it more than governance agents. So, so I would say that because they sort of have a depth of purpose of organizing the workflow, managing the data, securing the data, providing guardrails, then it's really just yeah, you need to have some kind of volume oriented business model on that other side. And I just think there's like if you're solving real problems for customers, it'll just like make money. I've like like this is so cheesy, but like I've told like LinkedIn product managers, I'd probably pay 10x more for LinkedIn if I just could MCP into it. If I just had a way of just like always understanding like like okay, this CIO is doing this thing and I need to reach out or whatever, I'll like take my money. So there's these systems actually have a tremendous amount of value based on the data that they that they have. And customers will absolutely sort of find some way to reward you for that value creation if you're doing a job. Super interesting. Maybe related. Let's talk about product UI. Yeah. Big you know generic chatbot chat box agent. Is that going to be the dominant UI for how people using AI in the future, especially when it comes to the application layer? This is why I think the applied layer, you know, how so much room to run is because probably the sort of universal chat system that you ask the question to you get an answer back or does sort of some work in the background. I think it's going to be obviously like that's going to be a mainstay that UI will always exist. It'll be incredibly powerful. The horizontal products will have it. The vertical products will have it. Everybody will have it. It's just like your product has a search box. Obviously it does. Yeah. So so that that's always going to be here for the sort of one off asks of an agent or go find this thing or answer this question or produce something for me on demand. But most of the enterprise is sort of made up of these processes and workflows that are kind of just happening behind the scenes. Sometimes they're happening with computers and computers are running these things or sometimes they're happening with other people that are doing these things or sometimes they should be happening with people, but you could never afford to have them happen with people so they just didn't happen. And so that's that sort of is a slightly different kind of metaphor than a chat pot where you ask a question and it comes back with an answer. That's like, okay, I kind of want agents in the background to do things for me. Read every contract. Look at every log, triage, every security incident and then instead of me chatting, maybe I'll chat as a as a means of doing kind of a catch up. I want a dashboard. I want a workflow. I want a queue. I want a task list. So then the the challenge becomes well, does the horizontal product kind of take on every one of those those components and and manifest every one of those experiences in one in which case I think you'll start to be like, man, that thing is like really like a that's pretty heavy and like and then we'll start to like be like, oh, this is no longer this simple easy delightful thing anymore. So then the vertical players actually like like they actually sort of understand the process and can manifest all the right buttons and tabs and the names of the things for that particular workflow. So I think it puts I think as you have agents that are doing more work in the background doing more, you know, async work that is just like I've farmed out a bunch of agents to review things as they happen or whatnot, that leans more toward the applied companies that can understand those workflows that can understand those processes. I think you're going to have these in every field. You're going to certainly we already know that, you know, how they're going to look in legal with Harvey Legor, etc. We are seeing them start to emerge in areas like security. We've seen them start to emerge in the long running kind of coding agents with cognition and factory. So I think that that will be, you know, one of the bigger kind of applied AI sort of use cases and ultimately like in five years from now, I would bet like 90% of all tokens in the enterprise are things that a user never kicked off and they just see a result. They just they see a task show up and they have to go review it and it's just like it's just happening. Yeah, yeah, makes sense. Okay, let's talk about AI diffusion. Coding agents, it was like, you know, boom January 1st, 2026 happens and like the fastest diffusion of anything into the economy, we've ever seen this happen. The diffusion of, you know, the rest of the AI magic into the rest of our jobs seems like it's been a lot slower. Yeah. What are your thoughts on that and where are the areas where you think we're going to see faster diffusion and how is that going to happen? Yeah, so you always have to kind of compare and contrast coding versus everything else to really understand the dissimilarity. So encoding essentially and this is back to the kind of utility point on, on, you know, slop, like the utility of code is almost 100% represented by the amount of text that you can generate. Like, like, all obviously an insane amount of value went into the text, but, but like, and like knowledge and expertise and meetings and everything, but like ultimately, like, the text is the thing that produces the program that is actually the thing that you're trying to do. You know, if you could have the world's greatest programmer, like, and it never had to sleep, never had to eat, they, they could intuit what to build and they could just sit on a computer all day long. Your value creation would be 100% correlated with how many hours they could sit at that computer and type code. Like, lines of code, ideally, ideally good code is the most thing that will be correlated to whether you produced software that people wanted. So it's all text. The models are hyper trained on these. Everybody in AI labs treat coding as, as a competitive benchmark to constantly try and exceed. They, they get to do their own e-vals on every single day because they are the ones coding the models themselves. And it's the most technical audience of all time where when they deploy an agentic system and they run into a, either a bug or a problem or like some MCP server comes back with like connection invalid. They know how to triage the problem. They don't call IT. They're just like, oh, yeah, now I didn't open up that port. Sorry, I'll go fix it. So that's like five. things. Oh, and maybe like the sixth, like, it's just like a very, very high-paying vertical that, like, it's just like automatically valuable if you could get 10% or 20% productivity gain, let alone 5x productivity gain. So, so take those five or six things that coding has as sort of beneficial properties to sort of automation, then compare that to, you know, you know, every other form of knowledge work. And you'd probably have like a histogram. And I don't know if anybody's publishes, maybe you can, like, the similarity to coding. And like, like, what, what are the domains that, like, like, start to sort of, sort of, you know, look closer, like, like, less and less, like, coding as you, as you kind of scale out. And it's like, okay, well, lo and behold, legal is kind of interesting because, because, like, there's a lot of value creation to somebody sitting at a computer, reviewing legal documents, writing legal documents, like processing large amounts of information. Okay, so that's kind of blowing up. And then you kind of go down the list. Now let's take something like, like, a sales rep. Okay, so much farther down the list in terms of, of sort of likeness. The sales reps value creation is basically convincing an external customer to buy software or technology or a caterpillar truck, you know, from them. That is the value creation to the, to the economy of the sales rep. And so let's say we brought the world's best automation to them. Like, first of all, again, they'd have to, like, figure out how to technically wire it up, they'd have to make sure they give it all their data, all these kind of things. But no matter what, the, they're, they're still rate limited and constrained by like, did the customer respond to them? Do they want to meet? Can they meet next Tuesday or can they meet today? Like, does the customer have budget? All of these other things. So that, that's maybe the entire continuum right there is, like, one is like, I mean, of knowledge work. Like, obviously, this is not even, you know, touching the, the sort of working with, with Adam. So that's a continuum, which is on one end, you have somebody rate limited by so many external factors. On the other hand, you have somebody who could sit at a computer all day long and just type, type text. And that is your ability to basically automate things is, is that continuum? So for the real world, we have to basically bring intelligence to these workflows in ways that are that sort of somewhat feel like the shape of their workflow, somewhat feel like the shape of their work. And then find a way to deliver the change management, deliver the implementation, get data into a format and into an environment that actually works with these systems like asterisk. Like, one of the other big things is like, if you go to most engineers in 2026, like, maybe like minus two months ago, given the, given the latest phenomenon, but like, like, the codes in GitHub, you just like connected to GitHub, like, like, remember, there's this period where like, you're when you launched a coding agent, like, there was no like sign up or register. It was just like, give us your GitHub. That doesn't exist in knowledge work. There's no like, give us your GitHub for knowledge work. There's like, let's give us your box. Well, box customers have a much easier time with all of this. Unfortunately, like, we're only 1.3 billion revenue run rate. So like, like, that means there's a lot of people not using box. And so what are they using? Their data is in on-premises systems, legacy file shares, legacy infrastructure, you know, enterprise environments that don't talk to agents particularly well. So just think about that sort of distinction between, you know, implementing coding agents versus everything else. Even, even something, again, you'll sort of fall asleep about is like, access controls in the enterprise are totally different. I actually totally forgot that point about coding. In coding, you get access to basically most of the stuff ever relevant for your job. In knowledge work, you're like, you're like, hey, Sally, can you open up that, that sort of file share for me? Can you open up that, that, you know, sort of project? Because I didn't get access to it. How do you make sure the agent has access to those set of things? All of that work has to get done. So the thing I think we have to prepare for is two things. One, Silicon Valley has to prepare for diffusion taking a lot longer than they think. Or the, then I'll say we, but I really think they, because I, like, I know how long it'll take. And then the second thing is, is the good news, is this is sort of all correlated to the applied layer value creation. Like, because the companies that will just have the patience, the sort of, the full sort of domain expertise, the, just the sheer work ethic, because it's not like everybody's just from the floodgates, like you have to go in and just, you know, pound pavement and get out there, that will be the applied layer. So I think this actually represents, you know, a trillion dollars of applied layer AI value is, is actually, how do you go get the technology to the lawyer or to the sales rep or to the life sciences researcher, or to the person that runs the customer support team? That's all sort of opportunity right now that exists. Awesome. I'm enclosed by asking some advice from the founders. Maybe let's start with founder advice and company building advice. On the founder side, it seems like you are in every AI cap table, you know, every cool new company, like, you know, you know, and Graham, you know, how did you kind of get yourself in the middle of the AI conversation? There's probably two, two parts. One was just very well primed for it. Like working with unstructured data for 20 years, you just like can instantly see the benefit of agents on that. So like, it honestly, like, took longer than I would have wanted that we got to have this conversation because we tried to have this conversation, you know, eight, nine, 10 years ago. And now it's finally happy. So, so first of all, just super well primed, our product sort of, you know, shape and what people do with our product already lends itself extremely well to agents. So like, obviously, we had to bet the company on that. And then lo and behold, we had the positive feedback loop of customers actually saying, yeah, that would actually be very powerful if I could go read every document and answer any question. So that's the first and certainly by, you know, biggest by kind of a factor of 10. And then the other is just like, I'm extremely fascinated by the technology. And it's just fun. It's like, where do you learn about it? Your podcast, um, um, uh, your cash is podcast. Um, uh, the, uh, I mean, I'm probably unfortunately for brain cells. Like, it's probably 95% Twitter. Um, I have a routine where like, at the end of each night, I just go through the feed. And it's just like, I like, I, I look like some sad meme, probably. I've just like, I'm just scrolling and scrolling and scrolling and like, attempting to like triangulate all the information. That's amazing. Cause it is, it is the global 10 story. It is. And, um, I want to send an emergency alert to like, everybody who's like a sophomore or junior in college and just be like, follow these 20 accounts on Twitter. And, and also join Twitter. Because like, this will just help your career. You're either like a year ahead or a year behind. Yeah. Simply based on your feed. And my feed is like so, so wired in. This is a number one advice that give to people who are asking how to get current on AI. It's like, follow, follow these 100 accounts. It's like, but then I'm virtually first step, join Twitter. Yeah. Like, you'll still talk to, to 20 year olds that are like, yeah, like, um, you know, I, I, I see some articles and I'm like, what do you mean? How do you see articles? I can't even know what that means. Like, do you just like get lucky that somebody emailed you an article? Like, just join Twitter. Like, what are you talking about? So, so, uh, so I would, you know, you just have to be wired in. I, I enjoy it. It's a lot of fun. I play with everything. What's, what's your favorite new AI products? Please say Instinct. Uh, so, um, okay. Uh, full, full disclaimer. I've not done the Instinct invite code yet. Um, um, simply because I have a backlog of like three other personal assistant products. You guys try and sync it. I know. I know. Everybody's rate. I'm, I'm very excited. I'm on. And I'm not an investor or so. Oh, you're not. Okay. So this is like totally genuine. Okay. So I, I, I had a percent will have what, I don't know when this is going to run, but I'm sure I will have played with it by the time it runs. I, I'm in pre-release in a couple right now that I'm spending some time with. Um, I think the personal assistants have a super exciting, at least in some of my use cases, it's still showing some of the limits of like browser use as an example. Like, man, we still have some work to do there. Like probably the entire internet needs just like a CLI for their product. Um, so we still have like, there's still some blocking and tackling at the infrastructure level for these things to be totally awesome. Um, and then, and then I kind of look like your average probably, you know, AI pill knowledge worker on, you know, every day I'm asking one of five different AI systems, you know, 20 to 30 questions, um, on just like doing research, looking for talent, looking for what is a competitor doing? What's happening in this market? How do you expand there? Um, so to kind of that, what about in the company building side? Yeah. How do you, you know, 20-year-old company at this point, what's your best for other people that are trying to reinvent their companies to make sure they have, you know, max adoption of AI, not just at the individual level, but also at the kind of company level. Yeah. How do you make your business legible for AI? Yeah. Again, some of this we have as a, as a byproduct of how we've always thought about information systems in the company. So like, to know exaggeration, if you have a question that you would like to ask about the business that has ever been documented in a form of unstructured data. So a meeting note, a project plan, a roadmap, a presentation, a financial document, a financial planning session, it's 100% inbox. So like, we benefit from a data architecture that already is insanely sort of tuned for because this is how we've run the company. We didn't let anybody use anything else. And, and so the data is very easy for us to be able to work with at scale. And then, of course, we have Salesforce and, and all the other kind of core canonical systems. We've been able to kind of have, I think, pretty good data hygiene. So agents running on top of that makes it a little bit easier to be kind of AI first in how we operate. Maybe a couple best practices or things that we've seen, you know, first of all, trying to figure out where the highest leverage impact workflows are going to be. And, and, you know, trying to kind of target those. So, you know, our CIOs, very AI-pilled. We have a little bit of like a center of excellence on AI. We've hired some internal AI FDEs to kind of help with these processes. We don't token max. We do actually like, I mean, like, I guess like literally we have a list of people buy a number of tokens. But, but it's usually to like go and inspect like, okay, do we, do we think that's useful? Or is there a learning there that we should take back to some other function? So like, probably our top, you know, in the top three all AI users at box, like, probably one of them is wasting, you know, half the tokens. And then And two of them are like, oh shit, whatever they're doing, we need to go do like an internal training session for everybody else. So we had this thing like two weeks ago where I was like, can you just get everybody in a room on this particular team and just like show them how this one person is using AI? And then like six hours later, they were like in a room and the guy was doing like a full demo of what he was doing, shout out to Mick. And so that's the kind of stuff that we're trying to do, which is just like, how do we show everybody what it looks like to work in this way? But you know, for as fast as we're moving and we are shipping at some parts of the stack two or three times more sort of, you know, actual customer facing products. So like, I don't care about how much code, but like, did we actually deliver more functionality that customers are asking for? Some parts of the stack we're doing that, then you'll go talk to a friend in Anthropic and they're just like, oh my god, we still have ways to go. Like, like, you know, the particular meta kind of constantly changes, which is like, you know, two years ago, you'd be like, you're just using a plugin in your IDE and you're like, man, we're not going to be that. Like, we're not ready to fully, you know, be AI first. And then you're like, okay, everybody roll out cursor and then you're, everybody rolls out cursor. And then you're like, and then that finally happens. And then you're like, you know, you're walking around and you're like, you're not only working from Slack, just at mentioning bots doing your code. Like, what are you doing? Like, it's like, we're constantly just changing what are the, what are the workflow paradigms on this? Do you guys have like a Slack coworker agent for the lack of other term? - We have a few that have that shape. I'm pretty excited about like like CloudTag as like a form factor. You know, you still have to kind of get the, the team construct right and the data right. But we have a variety of ways that people, you know, kind of work with agents and Slack. I don't know if it's as sort of Slack pill that's bending off with like us to be, or as like Anthropic or opening eyes, but like we're heading in that direction. - Yeah, I think that history books will be written about, you know, the art of business in this time. Like, I would love to read the new "The Art of War" with like everything that is happening here 'cause I think it's pretty extraordinary stuff we're seeing. What do you think it takes to win an AI versus pre-AI? And like, what does it feel like to be a founder right now versus when you started books? - I am both jealous of and also not jealous of. Like the young founders you meet 'cause you're just like, like ought to be young again and the whole world is your oyster and you can go in at, you know, any direction and the leverage you have, you'll meet with them and you're like, oh my god, like I saw a product we can have to go and they did a demo of the product and I was like, I was like, absolutely, this would be enough 40 person project five years ago. Like, especially when we were starting out, easily 40 person project and it was two people. And you're just like, how do you have so many tabs that work? And they all seem to have stuff behind the tabs that all seem very functional, like this is not fake. And so I'm very jealous of that. Like it's like incredible because you can just like, you can start your company from scratch with that as the design principle. Now we will get there because we're just gonna muscle through it. There's a couple of things that we just can't do which is like we're not, like we're very uncomfortable at the idea of like, you sort of, you know, removing the code review and like some of these things to get talked about because our customers can't possibly entrust us with their data security and compliance if we don't take that seriously. So we're always gonna have a little bit of a discount on the productivity because of where we are in the stack, what we do as a business. But so jealous of being able to kind of be fresh in that. And then on the other hand, like it's like, man, like at the same time for every great idea, it's like instantly five competitors. We didn't have that, you know, problem. We had a good kind of couple of years where we just could like, we could just grind on our product and our sort of experience. And it wasn't like every three days you were like, oh, like, so Koya funded this thing and Benchmark funded this thing. And like, we weren't going kind of nuts like with that. Now we had our own version of that. So like at the time I probably was going nuts, but it was like, like in retrospect, it was like not worthy of going nuts. Now it's like, oh, man, this is like a real race in every one of these markets. So I think I'm probably pretty consensus on this, which is in a world where AI builds things so much faster, then probably the shift moves to whoever can actually get it to the customer is in the best position. So, you know, it's fun talking to founders that are pretty kind of pilled on that, you know, Scott or Matan are like, they get the mandate. They're just like, this thing is going to be an enterprise diffusion play. And so you have to get it to the enterprise. And anybody who kind of mistakes the mandate right now, you're just going to lose. It's just like it's game over, sorry. Like, there is quite literally trillion to trillions up for grab at the applied layer. And the companies that know how to build the teams and get to the enterprise will be the ones that win. It's just like, obviously you're in team. Well said, Aaron, this is a very fun conversation. Thank you so much for joining. Thanks for having me. [MUSIC PLAYING]

Podcast Summary

Key Points:

  1. The application layer of AI—bridging models to real-world enterprise workflows—is critical and represents a massive, underexplored market opportunity.
  2. Enterprises face significant challenges in integrating AI due to complex data, governance, legacy systems, and human-in-the-loop processes that require domain expertise.
  3. Successful AI adoption hinges on tailored, workflow-specific agents that understand business processes, not just generic models, leading to more accurate and efficient outcomes.
  4. Open-source models are expected to gain traction in niche, cost-sensitive use cases, especially as inference costs decline and performance improves through fine-tuning.
  5. The future of AI in enterprise lies in long-running, background agents that automate workflows silently, with users receiving results rather than initiating tasks.
  6. Systems of record (like CRM or document management platforms) will become essential for AI agents, requiring deep integration and access to real-time data for governance and compliance.
  7. Trust and transparency in AI-generated content remain problematic, with societal discomfort around "work slop" reflecting deeper issues of accountability and human judgment.
  8. Founders and startups should focus on solving specific, deep-domain problems rather than competing directly with AI labs, as the application layer offers more sustainable value creation.

Summary:

The integration of AI into enterprise workflows is not just about improving model performance—it's about bridging the gap between powerful AI models and real-world business processes. As the conversation with Aaron Lovie highlights, enterprises face complex challenges like data governance, legacy systems, and human oversight that make generic AI tools insufficient. The key breakthrough comes in the application layer: building AI agents that understand specific workflows, such as contract review or compliance monitoring, and operate autonomously within existing systems.

This requires deep domain expertise, fine-tuned models, and seamless integration with systems of record like CRM or document management platforms. Open-source models are expected to grow rapidly in cost-sensitive, specialized use cases, especially as inference becomes cheaper and more efficient. While skepticism around AI-generated content—such as "work slop"—persists, the future will see a shift toward background, long-running agents that operate silently, delivering results without user intervention.

These agents will automate critical processes, like security triage or contract analysis, enabling faster decision-making and reducing human error. Ultimately, the most valuable AI applications will emerge in vertical markets where workflows are well-defined and deeply understood. Founders and startups should avoid competing directly with AI labs and instead focus on solving specific, real-world problems through tailored, workflow-aware tools.

This approach not only creates sustainable value but also fosters trust and transparency in enterprise environments, where human judgment and accountability remain essential.

FAQs

AI agents can automate complex tasks like contract analysis, document search, and security incident triage. They process vast amounts of unstructured data, extract key insights, and integrate into existing workflows to improve efficiency and reduce human error.

Box uses AI to create intelligent agents that search through billions of files, extract metadata, and answer questions about enterprise data. These agents help automate workflows like contract review and compliance checks by understanding and navigating sensitive business data.

Chatbots respond to simple, one-off queries and provide immediate answers. Agentic workflows involve long-running, autonomous agents that perform complex, multi-step processes like document analysis or security monitoring, requiring deeper integration with business systems.

The application layer bridges AI models to real-world enterprise workflows. It addresses domain-specific needs, integrates with legacy systems, and handles human-in-the-loop processes, making it essential for practical, scalable AI adoption.

Yes, open-source models are expected to grow in adoption, especially for cost-sensitive or specialized workloads. Enterprises may shift to open weights for long-tail tasks where lower costs or customization offer advantages over proprietary models.

AI will enable faster, more efficient content generation, such as creating presentations or reports. However, trust and authorship concerns may persist, leading to a transitional period where users evaluate AI-generated content alongside human oversight.

Chat with AI

Loading...

Pro features

Go deeper with this episode

Unlock creator-grade tools that turn any transcript into show notes and subtitle files.