Go back

How the engineer behind Claude Cowork actually uses Claude | Felix Rieseberg (Anthropic)

59m 25s

How the engineer behind Claude Cowork actually uses Claude | Felix Rieseberg (Anthropic)

The discussion highlights how AI, particularly Claude, can be used creatively to automate complex, tedious tasks and free up human energy for higher-level thinking. Felix Reesberg, who leads Claude products at Anthropic, demonstrates that the main barrier is not tool capability but users' willingness to input any problem into AI. He showcases a personal workflow where Claude analyzed a house floor plan, extracted dimensions from public permits, and built an interactive 3D furniture planner using purchase data from email—all without manual input. A key insight is the importance of abstracting tasks: instead of manually entering furniture dimensions, Felix asked Claude to find the data from his email, and then asked how to make the system permanent. He advises using Sonnet for well-defined tasks and Opus for ambiguous ones requiring reinterpretation. The conversation also notes that children, like Felix's nine-year-old, use AI naturally because they lack preconceived limits. Overall, the core message is to continually push AI to handle more background work, build systems for reusability, and invest creative energy in steering outcomes rather than performing repetitive steps.

Transcription

11737 Words, 60505 Characters

English
AI is used poorly if it just needs to move the mouse cursor for you. I want AI to do a bunch of annoying things in the background to free you up for your creative energy. The biggest gap that I see, it's not the capabilities of the tools. It is literally people being able to understand that almost any problem can go into these tools. I have built this little thing, which is just like a teeny tiny clawed on a little stick, and this stick has WiFi, has Bluetooth. I want my little claw to live on this thing, and I wanted to cheer me on every single time I do a good job. And also every single time I need to approve something the claw is doing. I wanted to be on this big button that is out here. The clawed has built all of that, in one shot. I needed to correct absolutely nothing. My nine year old is a daily active clawed user, but he has decided he's really into cyber security. We're like very hacker adjacent here. And so he's truly clawed on one thing, the terminal other, he's like, "Mom, do you know that your device ID is this?" A truly magical thing is happening with kids because they've never learned what not to ask for. And I think our generation, we're very used things, just not working. So we've been living in this mind prison for years. Welcome back to How AI. I'm Claire Vau, product leader and AI obsessive here on a mission to help you build better with these new tools. Today we have Felix Reesberg, who leads some of our favorite clawed products over at Anthropic. He's going to walk us through how you can solve almost any problem with clawed and show us how for just $20 you can build your own hardware clawed buddy that you can smash a button when you need to approve things. Let's get to it. This episode is brought to you by Magic Patterns. Today's engineers use cursor and clawed code to ship features in hours that used to take weeks. If you're a designer or PM, you've probably felt a shift too. The pressure to move faster, validate sooner, and keep up with the team that's operating at a completely different speed. You've already tried AI prototyping tools to close that gap. But if your prototypes don't look like your actual product, it doesn't matter how fast you can build. You still end up redrawing it by hand. Magic Patterns takes your product team from idea to production and works from your real design system. When you build a prototype, what you get back actually looks like your product. You'll validate faster, get alignment sooner, and when it's time to build, engineers can connect your prototype to cursor or clawed code with the Magic Patterns MCP to pick up where you left off. Your end team has their AI advantage. Make Magic Patterns yours. Try it today at magic patterns.com/howiai. Felix, welcome to How AI. Thanks for joining us. I care. How are you? I am great. We were joking before we got started that I have referred to 2026 as the year of our quad. 2026. That is. That is the era we are all living in. And you are in charge of a lot of the experience that we every day get to play with and work with. So tell me how much of a quad do you get to product? Normally when I introduce myself, I say I work on Cloud Core, I work on Cloud Core, then I work on Cloud for Chrome, and I work on the Cloud Desktop applications for my custom windows. Because obviously it's a team effort, but I'm currently the engineering need for those products. For those products. And what's really funny is I'm going to give you a little bit of a hard time. But every time I talk to someone about Cloud and how they're using it, I say which of the tabs is your favorite? I know. I know. Yeah. Yeah. Which one is your favorite? The one I use the most in the desktop app is co-work. I'm really trying my best to figure out co-work because I work with a lot of folks who are just uncomfortable in the Cloud code. What is a terminal interface? Even that third tab stresses them out a little bit. So I've been spending a lot of time banging my head against co-work, scheduled tasks, live artifacts, all that stuff. So that's the one I'm living in. I think we live in the sex super interesting time right now where I often explain to my friends and also to people who work here as the time right before we all came up with the glass pebble as the correct shape for a phone. I think we currently live in this super interesting time where some people are like, should you form a shape like a taco? Should we shape a lipstick? Should it have the keyboard underneath the screen or right next to the screen? No keyboard. I think that's the time we currently live in and I think you can see that in a lot of products. I think that's also why you probably see more entry points into Cloud because I myself as an individual, I think it's a super interesting year because we're playing with all of these different form factors. And I've not yet gained the confidence to say, throw them all away. This is the one. I'm like perfectly happy if people sort of pick their favorites, but I do understand that simply giving people a choice, right, like the same way that a restaurant does, creates a little bit of like extra work that we put on the user. And it's true that if I fast forward to like what is the end state for this, I'm probably not going to make people pick anymore. Right, I was going to whatever you want to do, here's the one place where you do that. But right now it helps us quite a bit to know, are you just showing up to get some quick answers? Are you showing up to like do deep meaningful work or are you showing up showing up to do engineering work? Like those are sort of the three buckets we put you in right now and knowing that ahead of time makes it a lot easier for me to give you an experience that is really really good depending on what you came for. Yeah, I like that because a lot of what I tell folks is we are really pre-convergence on AI tooling just generally and AI experiences. And so my answer to, you know, how do you want to, how do you want to use, like why not all of them? Just depends on the day. It depends on the day if I want my phone to be a taco or a glass, glass pebble. And it honestly depends on what mindset I'm in. Well, we're going to talk a lot about product at the end, but to start, this is how I AI and we want to know how you clawed. And so we were talking before we got started. And I said, you know, we've done a clawed co-work 101 episode with JJ. We've done a lot of clawed code in the terminal episodes. But we want to know how you use it because you probably know the edges and secret features and some workflows that maybe folks wouldn't think of. So I'd love for you to walk me through one of your favorite clawed maybe co-work workflows that you're using these days. You'd think that it would be much better using the tools that other people are. Right? Because like my entire job is to like build them, work on them. And an interesting thing is happening where whenever people show me something like super impressive in how they how they use clawed, like any of the product services, it is pretty rare that I'm impressed by something the models capable of. Like, I sort of know the model capabilities. We have a pretty good understanding of what the model is good at, what's better. And usually what impresses me is like the creativity and structuring your work and coming up with an idea. That is usually what impresses me quite a bit. But my favorite example sort of like change week over week, it kind of depends on like what I'm currently working on. Claire, you know, like right before we started the interview, like briefly you talked about our kids and like how we both recently had kids and like if you'd asked me three months ago, I would have said, oh, like just putting all my medical documents into a folder and like constantly annoying cloud with all the questions that didn't have time for in the hospital. It's like an excellent use case. But one that I've one that I've quite enjoyed recently was I'm about to move, I'm about to move into a new place. And my realtor just gave me the little like marketing floor plan that you get from from a real estate company. I mean, it didn't have any units in it. Like not so ever. And this is like the kind of thing where I turn to co work. And what I've done is I have a folder and I like made made a very similar, I'm sorry, I mean like a similar fake folder that doesn't contain all the same like secret stuff, but it contains fake documents about like an artificial house and an artificial house I'm like picking. I'm just going to select this year. I'm going to say always allow. It's the demo folder and the demo folder contains all the disclosure, disclosures you would get. It's a floor plan that contains like information about the mortgage, any kind of like the records that could find about the house. And I remember seeing something along the lines of in this folder, you can find a floor plan. Can you figure out what the units for that floor plan are and maybe make me a new one with units, right? And you can fire this off. This doesn't actually need that smart of a model. I actually did that with Sonnet, so you can like just fire that off and it's going to go off and do that work. This is a fake house. So it's not going to do nearly as interesting of a job. But for me, what it did was I'm going to move to Marin, broadly speaking. And it figured out that it figured out that it found a permit for the garage. And I was like, oh now that I know how big the garage is from the permit, like do everything else for you. And maybe we're going to share my other screen in a second. But the next thing that happened was once this is done, I was like, cool. Now that I have a floor plan with units, can you come up with like some examples frontier or design? I could just want to like see some possible layouts where can the bed go, where can the nursery go, what can we do here? And Claude wanted to know how do you want that? Like do you want me to just like put the furniture in the floor plan? And as I was writing the answers, like never mind, I need an interactive planner. I want to be able to like, rip around. And every since that has happened, I've just been like obsessed with how Claude did it. So I'm just going to show you how Claude did it. Let me just like make a new window real quick. Great. And while you're doing that, I have to ask a question because you very quickly said, this is not a problem that needs the smartest model. And you switch from Opus, to Sonnet. Yeah. Give us your like quick, when you need the beefy model and when you can go with Goodall Reliable, Sonnet 4.6. What's your heuristic there? I think people probably don't have to think about it as deeply as I do. Like, I think for most tasks, Sonnet 4.6 is actually very, very good. It is very, very good. And it's pretty rare for me that I bump into the ceiling of Sonnet 4.6. This might be in part because the kind of things that I do every single day, especially in my personal life are just not that tricky. Going and finding the right floor plan on like a public website and then making a new floor plan is not that hard. But again, what you're saying, right? What does that mean? Not that hard. Where's the line for not that hard? My heuristic is usually my tolerance for the model not having thought through very exactly what the actual problem is. Let me explain that a little bit more. Like I think if you think of, if you think of say a lawyer or an attorney or an accountant or a doctor, a big chunk of their work is that they not just give you the exact answer you were looking for, but they also need to sort of reinterpret what you're actually asking. What are you really trying to figure out? That is a pretty important job. And any of the creatives who are listening in, right? And creative work that is the most important piece of your job is like figuring out what is the client actually want because usually what they come in and the door with is not really what they want. And I reach for opus over sonnet if I have self identified as someone who doesn't really know yet what they're asking for. Is that helpful? Yeah. I mean, it seems more like your ability to scope the problem is how you, is how you choose versus you know, biting off something. I mean, I guess if you were to buy off something incredibly technically complex, maybe you would reach for opus, but it seems like more how it decomposes, generally stated problems into more specifically stated problems. It's all this is a very specifically stated problem, which is I have a floor plan. I need units for that floor plan. I need a new one. So that seems well scoped problem for four six. I will say I, I love four six. I use it a lot. It's been very happy player in my open clause. So I like the four six makes me happy. It's like it's a, it has a really good soul structure. But like quite a machine. But you know, it's a little bit like, it's like a restaurant menu again, like no wrong, no wrong answer. It's not really. Okay. So Claude came back with like this interactive planner and this is the thing that I find so cool. I'm obsessed with this enough and like telling people about it for a long time now. So in theory, this is a pretty novel furniture pattern. It is like, go ahead and like move furniture around, right? Like it's no big deal. But, but what Claude did is Claude used Python. And this is maybe a thing I should explain. Co-work gives Claude its own computer. So Claude and Co-work is its own little developer. It has its own computer, a virtual machine where it can develop whatever software it needs to do to solve your problem really, really well. And in my case, it like, analyzed the floor plan and then built a 3D model of the house where I can still move the furniture around in 3D and I can like drop in and like walk around like and like sort of look at things myself. At no point did I tell Claude, hey, you like should do this. Like at no point did I like go inside and say, you should make me a 3D model. I have also no idea how you actually do that. I'm a pretty good software engineer. I have no idea how you turn like a 2D floor plan, X-Things, a reliable 3D plan. I picked a little bit at the transcript and it did some contrast analysis on the floor pan to figure out where the walls, thick are the walls. But I found that really impressive. And then a thing I often like to tell people is that Claude gets a lot more powerful for your personal life if you manage to get, give a context, right? Context in the form of your emails, your calendar, the kinds of information that is important you to get your task done. And in this instance, a task that was pretty important was figuring out what kind of furniture I have. And in the, in the olden days, I probably would have like looked up what furniture I have, looked up the dimensions, cut that out of paper. But in this case, I just told Cobra, you have access to my emails. You find all the furniture that I bought and then please like add it in here so that I can move around the furniture actually. I just want to pause so people really reflect on that use case because I think they, they could gloss over if they don't hear it again, which is using your email as a source of truth for personal inventory, which is all of your purchases end up going through your email. And so you're buying furniture, your purchasing rugs, you're getting receipts, even maybe moves that you've done and I have a thing about this. I've moved maybe twice in the last 10 years and I've had to do that inventory manually and email it to moving companies. And if you use your email, which I don't know, I'm sure your, your personal emails like my personal email, which is just sprawling and completely inconceivable to like manage through and you use that as a source, connect it to Clawed and then inventory your stuff. Then you have like a structured source of data out of your email. I'm going to do this with my clothes. Honestly, like you buy clothes, you're like, what do I have? What do I have? Like in my closet or I can look at my email because we're all shopping online. Are there other things that you found like queering your email, queering your calendar, like that have been interesting kind of slices of data you wouldn't have thought of? I think what you're saying like really resonates, right? Like especially the clothing thing, this is an idea I didn't have yet. But now the you mentioned it, you can like build yourself a virtual closet and then use Claw to like get advice about like what to extend and like what else to buy. For me, and this is like honestly the trick. This is like something I have to remind myself of every single time I use AI is there was a brief moment where I started entering like manual furniture, right? Like the furniture banner had this little thing at the bottom where you could enter like my bed is like this wide and this deep. And like in the middle of it, I was like, what am I doing? I'm just going to tell a clot. I have this piece of furniture. And then I went another step up. I was like, again, what am I doing? Why do I need to tell a clobber kind of furniture? I have just like you figure out what furniture I have. And like applying this like step up in abstraction of the task and doing that over and over and over again and then like spending all of my energy on the piece that is maybe like more fundamental greater, which is like steering clod on what the what the house planner should be like or like adding stupid little features like I want to walk be able to walk through the house myself in 3D like it's a video game. Those are things that I spend my time on and spend my time less on like figuring out what was my furniture when that I buy it, who did I buy it from? Because I don't know for you, but for me, certainly I did I did have this problem that I look at my house and like I have no idea about all of the stuff. Wait till your kid starts bringing more and more stuff into the into the house. And I do a very similar thing. I've been spending a lot of time with executives trying to figure out how to scaffold their own operating system with AI a lot of times. I called to work at the center of it. And my rule, I call this like the anti to do list, which is anytime you're like doing something that's tedious, I just like I snack their hands. I'm like, why are you do it? You don't do that. Your hands are not allowed to touch this. You need to go ask again, go that abstraction layer up. How could clod do this? And then how could I never do this again? I think is is the next question, which is if you want to keep this this furniture or household inventory going forever, the next abstraction will be like, what's the system that in a year or two years, if I have to ask this question again, it's already there and ready for me to go. And so that's the other piece that I think people kind of miss is going that next layer up, which is like, how will I never have to do this again? Yeah, yeah. This is really good. This is really, really good. Like what you say makes a lot of sense to me because like I also frequently, I frequently then take the same step to what you're saying. Like how do I keep this going? How do I make sure I can continue using this and like the new data makes it and I could continue to be helpful in my live and ongoing basis, not just the point in time. And like a thing that happened to me recently is a lot more people have figured out that they can just like message me on Twitter to like solve their problem, which is nice. But it created this problem for me where I now suddenly have to keep track of my problems. And I did briefly like, sorry, not keep track of my problems, but keep track of my promises. The promises I make to people, right? Like send me your logs, I'll look at them, I promise you I'm going to figure out whatever one draw. And that choose a problem that is give cloud. I was like, dear, you can read all my messages. I want you to keep track of all my promises. I also want you to figure out how you can do that without like rereading all the messages every single time I talk to them. And all of these things, cloud is like, good. I have never actually looked at like clouds, a little database. I think it like created both the SQLite database as well as like a mountain of text files, keep track of all the promises I made to people. But it's quite good occasionally reminding me of like, hey, just seen our two weeks ago, you said you would do X. It is time to do X. Please go do X. What I like about what you're saying to is, well, you might be curious about how these things are built. You also aren't getting in your way being like, how do I build the perfect 3D renderer of my house? Or like, oh my god, I cannot believe this is text files. This is so ridiculous. Like, as long as it solves the problem, you can sort of move on with your life because these are, you know, little micro apps. They're just for you. They don't have to be architecturally, you know, perfect or the code that you would write necessarily, although they're probably pretty good. And so you really get to like how to solve the problem versus or that the problem is solved versus how you've solved it being the most important thing. Yeah, yeah, I think that's totally true. Like I increasingly started stepping away from from actually like supervising cloud too closely and really only judging and on its impact. It's like something that I think for people in the workforce, we often aspire to that we really only be judged by like the actual output. And I think as a control freak who like, you know, for a long time really needed like read every single line that cloud writes anywhere. It was a little difficult for me to give up that level of control. But I'm getting increasingly comfortable consulting cloud with things where maybe I'm not the ultimate authority myself. Right, like there's a lot of things I'm good at. There's an even larger amount of things that I don't know and I'm not very good at. And I think a lot of us are making making this experience for the first time with getting just a little bit more context or medical issues. This is like, this is like a thing that I think is very universal when I talk to my friends like when when they have medical issues that don't fully understand at least not completely. And they just have some questions about the physician's advice. They ask it both to the physician as they should, but they all of them without fail will also like ask and they I model off their choice. He can just explain this to me a little better like I have the following 10 questions about this right like and in a way their AI is replaced. You know the usual like Google and point for I have the following correction about life and the internet and knowing knowing that I'm quite comfortable with with using these tools and then domain where maybe I'm not the ultimate authority has also made it easier for me to not double checking every single thing it does because three point like if the entries all this good for like I have no like I am obsessed with software. I'm not just not a single line of this financial planner. It's just for I'm just going to play with it myself. It is really only for me and my wife to like design our house will get thrown away in a month but in this moment it is very, very fun and I don't need to optimize it for like a million users. This episode is brought to you by Google the AI layer of truth for your company's knowledge. Here's the problem. Your AI is only as good as the information you feed it. Companies are getting confident but wrong answers from AI because their underlying knowledge is outdated incomplete or just plain incorrect. That information doesn't just slow you down. It costs you money and puts you at risk. Guru solves this by adding a verification layer between your company's knowledge and AI tools. Instead of just hoping your AI gets it right Guru automatically scores content for accuracy flags outdated information and ensures your team gets trust for the answers every time. It works with the tools you already use so you don't have to change how you work. Thousands of companies trust Guru to keep their AI accurate and compliant. Ready to stop playing Russian roulette with your company's knowledge? Visit getguru.com to learn more. I want to go back to something that you said which is you know you built this promise tracker which I think is really interesting and that maybe think about a new a new feature in cloud that I've been using and playing with a little bit which is live artifacts and I think this idea you actually I'm not going to I'm not going to pitch live artifacts on your behalf. I'm going to let you explain what it is and then maybe you can give us an example of where live artifacts could be a helpful tool because it reminds me a little bit of what you're building with your furniture builder. So tell me a little bit about that in cloud. Yeah yeah here let me like show us. And I'll give a little bit of a quick spiel of like what are artifacts what are life artifacts why do we have them what's the point so generally speaking what do we call an artifact right like I can say dear Claude please make me. Beautifully formatted page with two poems on it format it nicely. I like I like the letter form yeah the lack of creativity in the promise like it's like pretty rough but it's beautiful. The what cloud is not going to do obviously is cloud is going to figure out a case Felix wants me to read some poems and then those should add are they should end up on a page and this page is what we call an artifact we we within the cloud world an artifact is like some kind of file output from what you from working on the furniture planner just showed you was a single file. That is an artifact any kind of PDF you would make as an artifact spreadsheet presentation all of those artifacts and here we go there are my poems over here on the right this is a classic artifact and artifacts become really powerful if you if you use them in a way that they help with your life right like the typical examples of reports dashboards presentations and we've discovered that data is a really important piece in your work. Like a typical example maybe for the founders out there is like a pitch deck right like you need to go and pitch your start up to 60 different VCs all of them have like slightly different information that they rely on the different reference points and terms of other companies that invested in the past. The data should be up to date and those she's rather cover many many sign ups you had is probably different this month and was last month. As a founder you spend a decent chunk of your time making these pitch decks right like a week is it down you update your pitch deck and if you like abstract away and generalize a little bit what the core problem here is it's that you have this like core idea of something you want but you wanted to update it maybe for the audience you want to update it with the latest data and we thought about the idea of can we make an artifact that like refreshes itself with the latest data and a good example many people have used in the past is like sort of a personal dashboard. So when we say life data what we use is we use connectors connectors are a way for you to get all kinds of information into cloud about all kinds of things. And like we launched this Spotify connector today I've actually tried this yet this could go terribly well. I was you want to come on. Okay we're live so we're just going to connect Spotify real quick there we go I'm going to have to configure this and like actually log in. Actually this is good this is good. It's not going to show you my terrible music taste I appreciate this quite a bit well I mean if you are like any of the parents out there and if you know I think this is like Bay Area insider baseball if you're moving to Marin you're going hard parenting. So if you're like any parent out there though your Spotify is going to be white noise and then then Disney soundtracks that's it. Yeah one of the next six years of your life that's really going to be the thing yeah but is what we can do we're just going to go ahead now and I'm going to say hi please make me a personal daily dashboard including reports and information. From my various data sources say Spotify Gmail calendar notion whatever else you find that's relevant to my life. You can you can see you can see that I'm like getting increasingly comfortable just like just what I'm letting I think it out yeah like usually my experience is that like whatever ideas I have cloud will probably come with a better idea and will go a little deeper than me will spend like just a little bit more time thinking about this. And then I'm also going to say this is for a product demo please do not use any real data just make all the data up. And then we should probably define some kind of design that is always a good idea. Last time you said beautiful and nice. Hey it was beautiful and nice but we can go with something like a modern editorial design something calming yeah I think that's good idea that's great right oh also make this life dash life artifact. You know what I want to show for people is there is this thing called live artifacts I always say when you're prompting something like use the magic word use the incantation. And in this case the incantation is live artifact i'm just to make sure you're getting that that style of auto auto refreshing auto updating artifact yeah I have to ask you a couple questions while this is loading please do you always greet. I've seen a lot of dear clods and a lot of hello hi friend do you always do that or is this just a little demo magic I always do that I do think I do think this might be like a thing about the people working on the topic we probably all have like a relationship with cloud that is a little bit more personal than like maybe people have outside the company yeah I think I I. Enjoy being polite and nice to cloud I don't care if I don't like you should that yeah I think. I understand that the ultimately the chips don't care right like that's the whole thing we ultimately know that i'm interacting with the tool here. For me as like someone who cares about mental health it's like good for me and my communication with anything to like be polite and nice yeah I ask this question on every podcast and so you will be the on the very polite nice camp and I say it's not about. Clods humanity it's about my humanity is why right yeah which is I don't need to get in the habit of being rude and in written language I also have found myself it's so ridiculous but it makes me feel good. Any broadly scoped problem i think it's a silly ending with like I believe in you I. know you can do it and make good decision. And it's like my own view. Do you like and make some difference? Yeah, I do. Because I feel like it asks me less when I say that. Because a lot of times I just don't actually want to be asked my opinion. I often just say whatever you think. And so this is my method of saying like you make the decisions. I trust your judgment. Yeah, I believe that you can do it. And I trust you. Look at this. It's beautiful. Nice. Sorry, but before we talk about my dashboard, I have like more things to say about like what you do for me about like telling Claude that you believe in it. I think on a very personal level, it is wonderful that you do that because I think it's like good for you as the human in the loop. It is good for you. However, however, I have an actual tip for I have an actual tip for people like interacting with Claude. We have noticed quite a bit of difference internally because sometimes the experiments that we're doing here are I want to say a little bit on the fringe of what is possible with the operating systems. I'm at heart a desktop developer. I want to make full user for computer. And that often means pushing the computer far beyond what what maybe most people do with applications. And like just operating a little bit on the fringe. I'll give you an example of like something that we have not shipped. We will not chip. But there's your operating system has a layer in between your icons and your wallpaper where you can drop pixels, which draw like is useful mostly for art. The reason you don't have any applications to like draw stuff in between your wallpaper and your icons is because there's not much used to be found there. But it's a concept. It's like fun that you're going to put things there. And I have frequently found myself telling Claude that something is possible and then now it's possible. Yeah, sort of the idea of like I don't actually know how, but I know it's possible. Yeah. We'll figure out how you can do it. And that does seem to give Claude like more confidence in actually going after the task at hand. It also like pre-empts a bunch of conversations that Claude and I might have about Claude in like Felix, your ideas, Dom, you probably shouldn't do this. And I from the get go can say I know I'm engaging in art. He's going along with it anyway. I love that. So okay, I know it's possible. I say that's my I believe in you. I think I think you're capable knowing it's possible. It will discover the space. Yeah, yeah, exactly. But here we are. This is now my little like personal dashboard. The design, it's like something that Claude just came up with on the spot. The widgets that came up with are on the spot. This is like this is like clay, right? This can be anything you want it to be, which is very open ended, but therefore so powerful. People frequently use this to get a little report about what they want to do in their day, right? Like just prep me for my day. What are the meetings I need to like think about? But again, the thing that is maybe most powerful here is going one abstraction error up. So I actually don't believe strongly in morning reports that just summarize what kind of meetings you have today. That is not all that impressive. I can just look at my calendar. What is really impressive is saying, look at all of my meetings I have for the day. Go figure out who I'm meeting with. Catch me up on like the recent conversations we've had. What were the themes there? What were the problems? If it's a coworker going stack figure out what kind of stuff they've been working on in the last week and what stuff they might want to talk to you about today and then what you need to know about that concept. You can just keep playing this graph bounds where you go and pull in more and more information to get you prepared even better for whatever you have for workers. And that's where these things get really powerful. And this is the kind of data you can pull in live and have cloud crunch on the go. Well, and I want to call up for folks a couple things that they might not notice. They think are really unique about these cloud live live artifacts, which is one. The killer feature here is this little refresh button up in the top, which is you can constantly pull in and reload data. And so this isn't this is your day today. Every time you come to this, it's going to refresh your data and pull the latest in. Then the second thing and correct me if I'm wrong is it just is reusing the off from your connectors. And so there's like no magic. I have to put an API key in and where am I going to store it? It's if you go into settings and go into connectors and connect your stuff, you can use any of those kind of connectors to scaffold out one of these live artifacts. And like look at this list of stuff. There's so many things that you can just one click add in, sign in through OAuth or whatever. And then you can build a live artifact in cloud without having to like ask for an API key. Exactly. And it can be, you know, it's not just the ones we have in our in our little like connect store. You can also connect your own. It is quite powerful. And the thing that I enjoy about this the most, this is probably fairly unique to myself. But the thing that I enjoy about this the most is the amount of creativity you can pull in and how you can really shape this in your image. Right. Like we could go in and say I want this to look like a software made in the early 2000s. Oh, 200 maybe 200. Let's see what it does. I mean, honestly, this is flawed. Cloud is probably smart enough to know that I meant the 2000s. Well, this is my go to cloud design use case, which is I did an episode on cloud design earlier this month. And I redesigned Lenny's newsletter in like 1999 Geocity style. It is incredible. We'll put the link in the show notes. It did an impeccable job at this. And what I told people is it wasn't the design that was really impressive to me. It was the copy was so always like. Yeah, it was like Geocities. It was Geocities era. It was 11 out of 10 exceptional copy. Beautiful. I want to see it. It's going to do 2000s or 200s. 200s would be way funnier. We can probably look at it already see like it's very first thing is 2000s like cloud is smart enough. And now it's not too much. And also, I mean, this is obviously like a bit of a demo account. But if you if I showed you my real account, cloud is like quite used to the fact that I constantly misspell things and like I've talked it in a slightly different style. I'm like, I'm like eager to see how this is going to go. I'm in general quite excited about the amount of creativity you express. And especially the amount of creativity people can express who are not software developers, right? Like this used to be this entire domain where you were maybe a designer over going to a software company and like maybe then software developers would execute your vision or you like pick to medium where it's a little bit easier. You can like low code things. But I think what is really exciting to me is that we can now pull in people from all these different from all these different like expertise areas. And they can all build these artifacts like either the presentation will be like straight up tool. Sort of in the vision they have a couple of weeks ago, I read somewhere that Margaret Edward wrote about using cloud. And the immediate thing that popped up in my head was I want to see software written by Margaret Edward. Like I want to see like tools look like that she has made for like writing her own books. That would be like so interesting and exciting to me. Okay, Margaret, if you want to come on how AI, I would love love to see your your your cloud setup. And while this is we're going to make this happen while this is loading. I do want to pull out because they do think there's a gap. People listen to and watch how AI along a broad spectrum of technical capabilities. So we have the most AI pill that float through the tokens, intense software engineering folks that are really pushing edges of what these tools can do. And then we have very very early users who are just coming to this in sort of a naive growth mindset way and saying I need to solve a problem. The biggest gap that I see which we were again talking about before we started recording is it's not the capabilities of the tools. It is literally people being able to understand that almost any problem can go into these tools and what like a workflow would be. And this is why we've done this podcast and on the the chat here at the website we have I think it's now close to 200 AI workflows that we've listed from this podcast. There's just like if you're trying to solve a personal problem with quad code here are the 15 ideas that we've seen on the podcast. And I do still think there needs to be this education and muscle memory change of you can build yourself a daily dashboard. You can build yourself a newborn sleep tracker. Hey, you're moving. Why not throw it all into a folder and then make your life easier as you're trying to close on the on the house. And I think people still the gap between technology and use case is still pretty pretty broad. And so you know my and my advice is like if you're petting with something or computer ask cloud to do it. Any other any other tips you've seen on how to like discover use cases. Yes, but I think I think before you even if you answer I just want to like underlying how correct I think you are. Many years ago I spend a decent amount of my time like I spend five years at a company called Slack which I think I think now is like fairly well known as like this chat tool that a lot of people use. And people were sort of like using Slack for different reasons, but they were all more about the way they organized their work with other people rather than it was about the tool itself. So slack by itself, if you used it the exact same way you would maybe communicate with emails in a silo was not all that useful, right? Like slack becomes really powerful. If you open it up to the idea of what if you communicate more transparently and people can see what's going on and we like sort of instead of having email threats, we have a channel and like the channel has opened to anyone who wants to see what's going on, right? Like it's this transformation of work and the transformation of how do you actually organize communication with other people. And AI is like in a similar vein of it, it like opens up so many opportunities that to harness them all you probably have to change a little bit how you work. Like if you really want to harness them and yeah I think you're right that like one of the biggest problems we have as an industry overall is not even like training the models, I'm making the models very smart, I'm making them very powerful or giving them the tools that allow them to turn that intelligence into like output. The biggest hurdle we have is how do we design the human model interface? How do we make this very easy for humans to harness? And right now I think the way it shows up is that humans are sharing these like tips on how to use this resource, right? I think the tip that you gave was a good one. It was like constantly whenever you do something that you find annoying and you're not enjoying and it doesn't feel creative and it doesn't feel like something where like you're you know it doesn't feel like the core of what you really want to do right now. That is a good time to pause for a second and like wonder is there a way I can I can use AI to do this. And then of course, and this is probably not surprising but of course like many people have a decent amount of success just like asking Claude, right? Just ask Claude how would you help me with this task and you know it comes up with a pretty good idea. I call this the like reverse interview which is just going into Claude and being like I am a mom of three boys. I run too many businesses for my own good and you know my biggest challenges are XYZ. How can you help interview me and then tell me how you can help me? That can be a really good exercise because again people want the guidance of like do you have problems with your calendar? You know are your kids in any sports? Any any of those things and so I do think this sort of like reverse interview where you can use Claude or whatever AI tool to sort of solicit out of you the ways it can help solve your problems is a really a really good one. And then again while we're sitting here I have to ask you another question because I think the um anthropic and the Claude products are so well known for this but we are chit chatting right now because we are waiting for co-work to load and one of the things that I think you all have solved is making loading delightful. So give me your thesis on how to make a product with built-in latency not so annoying to watch loading. Honestly the most important piece is probably to just get comfortable. They help the user is get comfortable with the idea that things are asynchronous and I think most humans are actually quite comfortable waiting for something if the quality that they get at the end is very very good right? That is generally something we're quite comfortable with and like maybe in the example of Slack like this is a good example of Slack. This was a problem we had fairly early on. The first version of Slack that I worked on when you had sent on a message it would immediately succeed or fail immediately right away. And of course the problem is the internet it's the internet as an entity is not very stable it's like this complex mesh so like messages would frequently fail and we fairly quickly replaced that with with a version that like try sending the message once twice three times and only after like a good couple of seconds of it failed that would be like hey by the way something seems to be off here and this is the same way that like I a message works today right like if you send a text message it's okay if you're current in the tunnel it's going to like try again like about a second after okay we can update this. Oh I this is beautiful let me make this big to my heart this is good this is this is very good. I'm like how I am moments where we're real delighted about yeah I'm like I'm like such a nerd for this stuff I'm like mildly obsessed with like software the only 2000 but yeah this is beautiful I'm a big fan of this this is quite good I love I love that it like brought in a song thinking notes it was like Felix requests it's Spotify about really the only 2000s which is what win amp. Win amp I know I was gonna say you need to skin your win amp module here. This is beautiful. Okay so when I wrap what we were talking about which is loading screens get comfortable with latency I think realize when tasks don't need to be secretive and build that concept into your product and then look at that we just chit chatted for a while and as we were talking about latency cloud must have been listening and said I'm gonna show them yeah I'm gonna pop this right open and and again folks not paying attention to the details look in the top right the clock is moving it's ticking along in the seconds you have this refresh this is I want to I want to open up and look at this every day it's pretty fun and you can I get vision like you can shape this in any form you want but I'll finish I'll give you one more tip my car to actually build these things that like where you got to wait a little bit and like people need to wait for them and get a little comfortable with waiting I think for us as Anthropical like maybe for me a support builder I will always trade off taking a little bit longer and giving you a better result I think ultimately better for humans and the thing I probably want to teach people is that it's okay to like not watch cloud as it's actually working because that is not super that it's not really the vision of AI is that we humans just like sit around to do nothing and watch the AI do the thing that otherwise we could just do ourselves like the thing I always say is that AI is used poorly if you just needs to move the mouse cursor for you the thing I really want to do is I want AI to like do a bunch of annoying things in the background to free you up for your creative energy so you can come up with ideas as good as make a daily plan I look like it was bold in the 2000s you will have better ideas for me but I think I think it's sort of like actually moving people from having to watch the thing into a position where they get more comfortable not watching it and I think this has more to do with trust than it has to with patience I love it well we do have one last little demo that you're going to show us basically on that topic which is how you know when when clouds done and this is actually the thing that I reached out to you about doing because I love it so much but what talk to us about a little stick yeah so in the interest of like getting really creative and like being more comfortable with like areas you know very good at I have always been like multi obsessed with like these like little hardware devices and I'm just not I'm not a hardware developer I never really like soldered anything together I'm not a hardware developer in any in any shape or form but it occurred to me that I could just go on the internet and buy all of these components myself I saw a tweet yesterday on Twitter from someone who said hey if you want to build your own like if you want to build your own ebook reader the components are actually quite cheap and very available and it occurred to me that I can just connect this device to cloud and we talked a lot about code work but we also have cloud code right so I have built this little thing just like a teeny tiny teeny tiny cloud like on a little stick and this stick has Wi-Fi has Bluetooth so let me tell you what this is still the internet is a magical place and on the internet you can just exercise free will and buy whatever you want and what you can now buy is you can buy like these teeny tiny hardware devices with a perfectly good LCD screen LED screen this thing has Wi-Fi has a Bluetooth it has a little bit of disk space and you can program it you do need to program it in a low level language but you know right we live in the future you don't need to do you don't care so what you can do is you can just straight up connect this like this is a little stick right here right like you can just straight up connect this to your computer I just plug this in and then all I did it was a 12 cloud code here's here's my vision it's my great vision I want like my little claw to live on this thing and I wanted to cheer me on every single time I do a good job and also every single time I need to approve something the claw is doing I wanted to like be on this big button that is out here and clawed has built all of that in like a one shot I'd need it correct absolutely nothing and I've seen on the internet that a lot of other people I've like built some other things because we I open source my code so people play can play with it but I've also seen that this is just like the tip of the iceberg there's like so much more cooler devices out there this by the way so this thing is 19 dollars has Wi-Fi it has blue ivory mentioned this like many times but I can't I can't get over I can't get over the idea we've been talking a lot about like how we optimize our our lives sort of as it happens on a computer right like because that's what we live but I keep having this idea that it can just like underneath clawed onto like all these little hardware devices and also improve my improve I mean just make like more delightful make a little agree I did a very similar thing in a recent episode I bought it's like it's already preloaded with this proprietary software but it's like a tiny retro computer very windows 2000 and I had to hack into that thing I was like blue to snow between the iPhone app and the thing. I was dumping all the logs in and being backwards engineer the encoding of the files into this thing. And I finally got it and made myself a little CLI tool where I can type and it's so cool. >> Yeah, I see that is so cool. That is so cool that we can do that just now. This thing also communicates over Bluetooth. I learned a lot about the Bluetooth protocol as I was building this just by a small size. Do you want to see it? >> Yeah, I do want to see it. >> Okay, so this is now also like partially live in actual CLI. So you can build something very similar. If you'd like by any IoT device of your choice, I'm not going to make a recommendation, but anything that you find on the internet will probably work as long as there's Bluetooth. But you go into help, troubleshooting, you enable developer mode. Developer mode allows access to developer tools and features. We give you that warning because it does require that you sort of know a little bit about what you're doing. It's going to restart the application. Here we are. And then you have this new developer menu where we hide all of our developer features. This is for people who work with MCPs or also for people who want to build their own little hardware devices. And in here is now a new open hardware buddy. This thing. You will notice that it looks a lot like the one I've actually purchased. But it doesn't have to be the same one. I think I made that comment here. For your heart, be creative. And you can hit connect. And it's going to scan for this whole thing for a few seconds to find it on Bluetooth. And it's founded. There we go. So now it's connected. It gives me a passcode. Okay. Cool. So we're now connected. And Claire, you tell me if you can see anything. So maybe what we're going to do is we're going to. We're going to ask for like anything that would require any kind of like permission. I'm just going to say. Just make a hello world dot to see and write it to disk. And the point of this is to just fire something off that will require permission. Okay. So you can now see. I heard it. It's not cute. Isn't that very cute. Really? And if I approve this here. Then it will be approved. That's how it works. So now Cloud is off to get something. I love it. We saved the best for last people. If you have made it this long in our in our episode, we have saved the best for last Felix. Man, I really like it. And I'm like, I'm like, I'm perfectly serviceable software engineer. And I have no idea what I'm doing with the Bluetooth protocol and with hardware. And it's just been a thing that I've stayed so far away from. I really appreciate this. I think more is as my kids get older too. I don't want them interacting with like the full computer thing. But I would love to have little little things for them to interact with. I think like being able to scope. Kind of like micro devices to to a use case, just like we're getting this personal software is going to be really fun. Yeah. Like one one of the pieces that's been maybe most joyful upon my job is that people frequently send me like little videos of the kinds of things that kids are doing with cloud. And the creativity they have is like beautiful. Right. You can like just take a photo of like a little animal you kid has drawn. Give it a cloud and be like, I need to jump and run. I need a flappy bird. But instead of the bird, it needs to be this little drawn bird over there. And then you put your kid in front of the computer and like truly, truly magical things happen because I think I'm still wrapping my head around this clear. But a truly magical thing is happening with kids because they've never learned what not to ask for to them. The computer is just like can do anything. And I think to like sort of our generation, we're very used to like things just not working. Right. We're like, we used to like, oh, you can't do that. So like, so we've been like living in this mind prison for like 20 years. This is very on brand, but my nine year old is a daily active cloud user. But he's decided he's really into cyber security. And so he's like truly in like, clad in one thing, the terminal other, he's like, mom, do you know that your device ID is this something like, yeah, babe, I do know that. Good job. Good job. Yeah, I think it's totally fascinating. We'll feel like I know we have just been having so much fun this episode. I think people are going to get so much out of it just for a verse for folks. We talked about cloud co work being able to build you artifacts, both sort of like standard crazy 3D printed or 3D renderings of your floor plan and other things that you can just stand up to solve little problems in your life. All the way to life artifacts that can pull from your live data and really give you a rich personal experience with your data. We touched on a lot of topics, including email as a source of truth data. So what we're going to do with all this latency and how to pick the smart enough model, which is just say, you know, you know, when you need opus and you know, when you need sonnet, but we both think that sonnet's pretty good at most things. And then you showed us how we can hack into hardware for the all in price of 20 bucks, including shipping and build little little buddies for herself. I'm going to get you out of here. One quick lightning round question again, we did this at the at the midpoint. So maybe you can just answer really quickly, but when Claude is not listening, you know, we've talked about how to set it off on a good path, but when it's really just making mistakes instead of making no mistakes, it's making all the mistakes. What is your prompting strategy? I can't imagine you yell. You don't seem like a yell or, but what do you do? Yeah, I do not yell. I think I think it is, it is useful for me to know when people curse at Claude. This is like an interesting thing for me to know as a product builder. But my strategy for when Claude doesn't really really understand what's going on or like Claude seems to have gone off the rails. I usually try to debug my workflow straight up by asking, okay, here's what I actually expected. Can you maybe walk me through at what point you expect if something different or like how we can maybe prevent this in the future? It doesn't always work. Claude is AI and AI can make mistakes. However, that being said, I have frequently found ways to improve the data source or to improve the amount of noise that is in the data or like with Claude to come up with mechanisms. Okay, how do we set up something to dry run? I usually end up at a place where the learning at take away is not, oh, Claude can't do this. I'm not going to have Claude do it. Usually the learning at take away is I can maybe change a little bit of the harness, the prompt, I can change something and like how we set this up at the beginning. And I think after the time we had together now there's no surprise to you. But like usually we also do that as to also involve Claude and say, "Claude, what do you think we can do here?" Claude is a good friend and if people need your people need your ben and people need to like externalize their frustrations, Claude can take it. You can do it. Maybe just smash the button, like have an angry button instead of saying the thing on our little hardware buddy. You can have like the mad button and the happy button. You just, I'm not pleased Claude smash that. Yeah, yeah. And like there is a, I'm not pleased button that actually also ends up on my desk that I do want people to like use. So every single time Claude does make a mistake, we do have the little like in many of our product surfaces, this is a cross-cloud, you will find the little thumbs up thumbs down buttons. Those are super useful to us. We use those in training, we use them in like improving, improving not just the model but also the products. So maybe actually the thing I'm going to say is like if Claude hasn't done the thing that you wanted to, curcing it Claude will probably not fix it for the future. But like pressing little like thumbs down button helps us quite a bit because it doesn't end up on my desk. We deal with it. Perfect. Well, this has been super fun. Before we get you out of here, how can we find you and other than hitting the thumbs up thumbs down button, how can we be helpful? It's really that that's like the number one thing that like really helps us build a really good product is getting a good sense for what works for people. The option space is so big, we're still in this like funds, Married Found Time, we talked about it. And I do want to hear from people. I want to hear from people what works for them, what doesn't work. I'm always grateful for all kinds of feedback. You can find me on LinkedIn and X, also the two big places. Great. And you make promises. You made a promise to me before this, before this call that we will get to after we end. Well, thank you so much for joining how AI that this has been great. Thank you, Claire. Yeah, this was fun. Thanks so much for watching. If you enjoyed this show, please like and subscribe here on YouTube or even better, leave us a comment with your thoughts. You can also find this podcast on Apple podcasts, Spotify or your favorite podcast app. Please consider leaving us a rating and review, which will help others find the show. You can see all our episodes and learn more about the show at howiipod.com. See you next time.

Podcast Summary

Key Points:

  1. AI should handle tedious background tasks to free up creative energy, not just automate simple actions like mouse movement.
  2. Many people underestimate that almost any problem can be input into AI tools; the gap is often user understanding, not tool capability.
  3. A hardware "claw" was built with WiFi and Bluetooth to cheer on good work and provide a button for approvals, created in one shot without corrections.
  4. Children, like the speaker's nine-year-old, use AI naturally because they haven't learned what not to ask, unlike adults who often limit themselves.
  5. Felix Reesberg from Anthropic leads Claude products and emphasizes that the most impressive uses often come from user creativity in structuring tasks, not model capabilities.
  6. Example workflow
  7. Heuristic for model choice
  8. Key advice
  9. Context, like connecting email and calendar, makes AI more powerful for personal life, enabling tasks like inventory management or tracking promises.

Summary:

The discussion highlights how AI, particularly Claude, can be used creatively to automate complex, tedious tasks and free up human energy for higher-level thinking. Felix Reesberg, who leads Claude products at Anthropic, demonstrates that the main barrier is not tool capability but users' willingness to input any problem into AI. He showcases a personal workflow where Claude analyzed a house floor plan, extracted dimensions from public permits, and built an interactive 3D furniture planner using purchase data from email—all without manual input.

A key insight is the importance of abstracting tasks: instead of manually entering furniture dimensions, Felix asked Claude to find the data from his email, and then asked how to make the system permanent. He advises using Sonnet for well-defined tasks and Opus for ambiguous ones requiring reinterpretation. The conversation also notes that children, like Felix's nine-year-old, use AI naturally because they lack preconceived limits.

Overall, the core message is to continually push AI to handle more background work, build systems for reusability, and invest creative energy in steering outcomes rather than performing repetitive steps.

FAQs

AI should handle annoying background tasks to free up your creative energy, rather than just doing simple things like moving a mouse cursor.

He uses Sonnet 4.6 for well-scoped problems where he knows exactly what to ask, and Opus when he needs the model to reinterpret or figure out what he's really asking for.

Felix used Claude in Co-work to analyze a floor plan, create a 3D interactive model with furniture, and even pulled data from his emails to inventory his actual furniture without manual entry.

It's a rule where if a task feels tedious, you should delegate it to AI instead of doing it yourself, then think about how to automate it so you never have to do it again.

He gave Claude access to his email to automatically find and add furniture he bought, turning email receipts into a structured inventory for his house planner.

He suggests giving AI context from personal data like emails and calendars, and continuously stepping up the abstraction of tasks to let AI handle more of the work.

Chat with AI

Loading...

Pro features

Go deeper with this episode

Unlock creator-grade tools that turn any transcript into show notes and subtitle files.