TruFonry is an enterprise AI gateway and deployment platform founded by Nikunj Bajaj, inspired by his experience at Meta, where machine learning was vertically integrated into a unified software stack. The company’s core hypothesis was that as ML hit an inflection point, organizations would need to move from parallel stacks (software, ML, generative AI) to a vertical stack running on Kubernetes. This led to a year-long MVP focused on building a Kubernetes-based infrastructure, enabling deployment on any cloud or on-prem environment. The product roadmap balances a stable foundational architecture (Kubernetes) with an adaptable UX layer that evolves with industry trends—from RAG in 2023 to agents in 2024 and MCPs in 2025. The team, including co-founders Anragan and Abhishek, was built for complementary skills and a shared vision, with founders personally hiring for hard skills, problem-solving passion, and ownership. Scalability is achieved through Kubernetes-native design for horizontal scaling and a split-plane architecture for the AI gateway, which sits in the critical path of API calls to LLMs and agents, ensuring reliability. TruFonry now serves large enterprises, helping them connect, observe, and govern agents through a single control plane.
This episode is brought to you by The Built, a new podcast from the guys behind Sincera, Michael Sullivan and Ian Myers. They built their company by figuring out clever solutions to a few important ad tech problems in their industry. And that's exactly what this show is about. Mike and Ian interview some of the smartest tech minds in the biz to hear about how they identified opportunities, solve their hardest challenges, and grew their businesses in the process. Listen to The Built with Michael Sullivan wherever you get your podcasts. TruFonry provides an enterprise grade AI gateway product. And our AI gateway definition is slightly broader than the industry, so we encompass something called an LLM gateway, MCP gateway, and agent gateway. Think of these three as three components, LLM's, MCPs and sub-agents to build your agentic applications. AI gateway literally sits in the middle of your traffic. To every single API call that you're making to your LLM's and agents. And it's something sits in the critical part of your request, you want to make sure that piece of software always stays up. So we actually chose a design principle that is called a split plane architecture. My name is Nikunj Bajaj, I'm co-founder CEO at TruFonry. This is Co-Story, a podcast bringing you interviews with tech visionaries. Think six months moonlighting. There's nothing on the back end. Who share what it takes to change an industry? I don't exactly know what to do next. It took many goes to get right. Who built the teams that have their back. A company is its pitiful. The teams help each other achieve more. Those proud of our team. Keeping scalability top of mind. All that infrastructure is a pain in fighting it as we grow. Total waste of time. The stories you don't read in the headlines. It's not an easy thing to achieve, my friend. Took it from Shell, if it does it it often. Trying to begin. To ride the ups and downs of the startup line. I need to really want it. It's not just about technology. All this and more on Co-Story. I'm your host Noah Labpart. And today, how Nikunj Bajaj has built an enterprise ready platform with the target AI gateway and agentic deployment. Today's episode is brought to you by.techdomains. And this one hits close to home. Back in 2016, I was building my startup and went hunting for that perfect.com and found next to nothing. So I did what every founder does. Settled. Here's what I wish someone had told me. You're building a tech startup. Just get a.tech domain. It instantly tells investors and customers what you're about. Don't overthink it. Secure your.tech domain today from any registrar of your choice. This episode is sponsored by Unblocked. Unblocked is the context layer your agents are missing. It synthesizes your PRs, docs, slack, and tickets into organizational context that agents actually understand. So they make better plans. Write higher quality code, use fewer tokens, and require fewer correction loops. If you're running cloud code cursor or any agentic workflow, Unblocked is worth a look. Learn more at getunblocked.com/codestory. This episode is sponsored by Mesmo. If your team is collecting large volumes of logs, metrics, and traces, but still struggling to get timely answers, Mesmo can help. Mesmo is an active telemetry platform that processes and enriches observability data in real time before it's stored or analyzed. That means lower data volume, lower cost, and faster root cause analysis across your existing observability tools. The C.I. works, get a demo at mesmo.com/codestory. That's m-e-z-m-o.com/codestory. This episode is sponsored by BrainGrid. If you are building with AI coding tools, but your features keep breaking, you need to check out BrainGrid. It is the product management agent for AI builders. BrainGrid turns messy ideas into clear specs, tasks, and prompts that coding agents like cursor and cloud can actually build the right way. Ship real software, not fragile prototypes. Start free at braingrid.ai Nakum Shabajaj was born in India and completed his undergraduate studies there. The intrigue of Silicon Valley in 2013 brought him to the Bay Area, where he got his master's degree from Berkeley. His studies and his time after school supremely inform what he is building now at his current venture. But outside attack, he is an outdoorsy person enjoying running, biking, and scuba diving, with his favorite place to dive being Bali. He enjoys playing board games with his friends and listens to a lot of audiobooks from a wide range of genres. After joining Metta, Nakum's realized that building machine learning models for the company is different than using public ecosystems. He realized early on that machine learning models will hit an inflection point where the stacks will need to change and adapt. He and his team decided to take on this challenge ahead of that inflection point. This is the creation story of True Foundry. True Foundry provides an enterprise grade AI gateway product. Think of these three as three components LLMs, MCPs, and sub agents to build your agent applications. We serve large enterprises, help them connect, observe, and govern all of their agents into a single control plane. Besides the gateway layer, True Foundry offers another product that we called AI deployments. This helps enterprises to deploy and train custom LLMs on their own GPUs, host their MCP servers, and even run these custom agents, all through a Google Attis native interface, on their own on-prem or VBC computer. So that's our product, basically summarizing the two major modules that you ask for AI gateway and AI deployments. The starting story of True Foundry actually goes way back and the motivation starts from our time at meta. So before joining meta, I was actually at a startup where we were building a lot of machine learning models and ML infrastructure, but using the public cloud ecosystem. When I joined meta, a realization hit me that the way you build machine learning models, ML applications at meta is actually foundationally different from how you do it using public cloud ecosystem outside. Meta really thinks of machine learning as a special case of software engineering and generative AI as a special case of machine learning. So you can almost think of this as a stacked, vertically stacked platform, software in the bottom, machine learning in the middle and generative AI in the top, all of them running through a unified interface on some underlying infrastructure, basically. What that helps me do as a machine learning developer at meta is I can take a generative AI model or an ML application and run them on thousands of nodes without actually depending on backend engineers or infrastructure people at all. On the other hand, most of the enterprises create to completely parallel stack for running their software applications, their machine learning applications and actually now even third stack for their generative AI applications. When we started back in 222 beginning, like this was before chat jibbity, our core hypothesis was at some point machine learning will hit an inflection point where more organization will want to ship large enough number of models to production, where this parallel stack won't work and they will need to switch to this vertical stack like that of meta and that was the the driving factor for us to kickstart a platform like this where we take other inspiration from meta and adapt it for the requirements of large enterprises. Let's dive into what you would consider the MVP for true Foundry's that first version of the product you build, how long it take to build and what sort of tools we're using to bring it to live. Actually turns out that given we always aimed to build true Foundry as a software that manages production workloads, the MVP of true Foundry was not something like an MVP that you hear in the traditional sense of MVP that you roll something out within a few weeks and it's ready to go. It's one of those things where founders have started with a core belief, with a fair understanding of what needs to be built, with an opinion of how the world will evolve and when you start companies like these, typically your MVP actually takes a fairly long amount of time to build this out. So in fact, we spent more than a year headstown developing the platform because we were building the core infrastructure on top of which enterprises can start building their machine learning and genetic way applications and start launching them to production. So we actually spent a lot of time building out this plumbing layer. The tools technologies that's the end of taking a bet on was actually Kubernetes layer where we believed that at some point all of machine learning will also get orchestrated through Kubernetes layer and actually this is one of the other things where we took an attack informed bet in the beginning of our of the founding story of true Foundry, where we noticed avoid getting created in a industry where Qflow that used to be the only piece of software that was meaningfully helping run organizations, machine learning on top of Kubernetes, was actually seeing a declining contribution. Google was investing more and more in vertex, Qflow started
declining and it actually was very in line with our bet that machine learning will run on Kubernetes. So we actually took that opportunity, invested heaven into Kubernetes and built our entire software MLGenei stack to be run on top of Kubernetes, which by the way also gave us flexibility to run on any underlying infrastructure, AWS, GCP, Azure, on-prem, etc, which is extremely desirable now in the world of Genei. Today's episode is brought to you by.techdomains and this one hits close to home. Back in 2016 when I was building my own tech startup, I went on the hunt for that elusive.com. Looked high, looked low and guess what I found? Nothing. What I did find cost me an arm and a leg. So I did what every founder does under pressure through an extra letter settled for the less than optimal name. And here's what I wish someone had said to me back then. Noah, you're building a tech startup. Tech startup.tech domain. It could not be more obvious. It tells investors, customers and anyone who looks at your website really that tech is at the core of your build. And I've kicked myself plenty since, especially when I see the clean and sharp names tech companies have landed on.tech. Nothing.tech 1x.tech Aurora.tech CES.tech Ultra.tech Alice.tech Neon.tech blaze.tech high.tech. You get the idea. So take it from someone who learned it the hard way. If you're building a tech startup, don't overthink it. This episode is brought to you by the build. A new podcast from the guys behind Sincera, Michael Sullivan and Ian Myers. They built their company by figuring out clever solutions to a few important ad tech problems in the industry. Mike and Ian interview some of the smartest tech mines at Magni, Jalice, DoubleClick, and LiveRamp. To hear about how they identify and opportunities, solve their hardest challenges and grew their businesses in the process. This show is for you if you've had some of these breakthrough moments yourself or if you're seeking inspiration for the next one. Listen to the build with Michael Sullivan wherever you get your podcasts. Okay, so then you've got that, you know, for bourbon, it's working, you're getting the feedback you want. How are you building your roadmap for true foundry? How are you deciding that? Okay, this is the next most important thing to build or to address with the products. There are two things that have always guided our product road map and our product thinking. One is the foundation, right? We think about the architecture, which stays consistent with everything that's happening in the industry. Some of the core principles of building how you manage your infrastructure, how do you run your applications and workloads. That's foundational and that stays consistent in this grounding principle that we learned at Meta. And then the second aspect of it is the UX layer, the Devex layer basically, which by the way kept adapting as the models or brandy of the day was changing. So actually if I walk you through the timeline a little bit, end of 2022 is when chat GPT was launched and that was the aha moment of the industry that you can start sending out these amazing prompts and you start getting some very meaningful responses from these large-ranked models. Then enterprises realize that actually these responses are not as useful unless they start grounding themselves in their own data sources. Right? So, Rack became a thing. Retrieval of mental generation became the new models apparently in 2023. After 824 emerged, the world started to think about agents and multi-agentic systems. And in 2025, this evolved into MCPs or model context protocol, A to A or agent-agent communication. So you see that every single year, the models' apprendi of the world kept changing. And the way true found we inform its product decisions is we adapt to the models' apprendi. We build out the UX layer around the models' apprendi, but we bring them always back to the same grounding foundational principle that we had started with about how you run these workloads on the same underlying infrastructure. So the biggest and most meaningful shift that happened in this roadmap is how enterprises are building agent applications and how you need to connect all these components that I talked about with the evolution, right? Your actual agents, your MCPs, your NLMs, your guardrails, all of that through one unified layer or a control plane that we call as AI gateway. I think that ended up being the most informed shift from that MVP that we talked about to the thing that literally every enterprise that we know of today is jumping towards. Okay, I hear you saying, "we tell me about how you built your team. What do you look for in those people that indicate that they are the winning horses to join you?" I think the team is the most call it like our proudest, we win a true foundry. First of all, let me give a little bit of a background about my co-founders because when we started, I think that ends up becoming the right seat for the company. So my co-founders, Anragan Abhishek, they are actually my very close friends from undergrad and by the way, now our undergrad is approximately two decades old, so we practically grew up together. Great to be building the company with your close friends, but also we were fortunate at the fact that my close friends were also like bringing lots of complementary skills as to build the company together. For example, Abhishek was also at Meta where he led the entire videos org and brings in this very deep infrastructure experience from Meta. Ananrag used to use machine learning to build trading strategies at WorldQuant and he was member of the Founders Office and has led a lot of expansion initiatives within WorldQuant as well, including expanding the company to two different geographies as well. So this actually brought us from my machine learning Abhishek's infrastructure and Anragan's strategy and go-to-market background, it formed the right team to begin with. Then we started hiring and actually turns out that the first few months of the company, we actually ended up spending quite a bit of time of the founders in just hiring. We look out for, you know, of course some of the hard skillsets because building enterprise infrastructure, you can't teach everything from scratch, so like people should bring in some of those hard skills, but most importantly, if we focused on whether people cared about solving this problem, whether people believed in this vision that we are working towards and do the naturally aligned with what we're talking about because that's the thing that in the early stage of building a startup, you don't want too much deviation from that vision. Like people should be aligned on the mission and your vision from the beginning. So we would look out for that talent and lastly, the fact that they are bringing in the kind of ownership, the founder mindset that's needed to build an early stage startup essentially. And fast-forwarded today, we are approximately 90 to 100 people in the team and even today, we have every single person who joins through Foundry gets through Founder interviews, we are extremely deeply involved into building the team. We think that's the highest value that a founder can create in a company. Building with AI coding tools is exciting, until the moment things start breaking. You ask for a small change and suddenly three other features stop working. AI gets confused, misses edge cases and loses track of your intent. The problem is not code generation, the problem is planning. That is why BrainGrid exists. BrainGrid acts as your product management agent. It writes clear specification, maps UX flows, asks the clarifying questions you forgot to ask, and breaks big ideas into engineering grade tasks that AI coding tools can build reliably. It guides cursor, claw code, replet, windsurf, and others so they deliver features that work and keep working. Founders use BrainGrid to build real AI native SaaS products without a technical background. If you want reliable features, instead of fragile prototypes, try BrainGrid for free at braingrid.ai. That's braingrid.ai This episode is sponsored by Mesmo. If you're responsible for reliability, performance, or platform architecture, you already know the problem. Telemetry volume is growing faster than teams can manage it. Mesmo addresses this by moving observability upstream. Instead of storing everything and asking questions later, Mesmo processes telemetry in motion, filtering, transforming, enriching logs, metrics, and traces before they reach your observability back in. The result is cleaner data, reduced ingestion costs, and faster root cause analysis using the tools you already rely on. Mesmo integrates with platforms like DataDog, Dynatrace, and Open Source Stacks, giving teams more control without adding operational overhead. This is especially useful for platform engineers and SREs supporting complex distributed systems where context and speed matter. To see how active telemetry works in practice, get a demo at mesmo.com/coatsstory. That's m-e-z-mo.com/coatsstory. Okay, let's flip to scalability. I'm curious about this given, obviously, the nature of what you're building. It's ingrained in probably how you build a product, but I'm curious about how you approach it in the beginning. Then if there has been interesting areas where you've had to fight scale as you've grown. Scale has two aspects to it, right? I always think about the entire business when I think about scale. Now, one aspect to scale is around your platform core infrastructure, right? Which lets your product scale meaningfully, and the second aspect of your scale is how you think about the overall company scaling your go-to-market scaling, and both of those are important aspects, right? So I'll start with the product side. First of all, the general infrastructure scalability of our platform was heavily rooted in the right design principle that
we started with, right? Everything that we did not we end up making it compliant with the industry standards, the enterprise stack, all running on top of Kubernetes and all getting exposed in the lowest form of Kubernetes, a language that every enterprise understands, we ended up exposing that as part of our product. So that helped us leverage the entire community-based development around Kubernetes or the scale, horizontally scale our our product basically. The second around the infrastructure side, which becomes even more important is the AI gateway product. And let me actually throw some light into why scalability is critical here. AI gateway literally sits in the middle of your traffic to every single API call that you're making to your LLMs and agents. And it's something sits in the critical part of your request. You want to make sure that piece of software always stays up. So we actually chose a design principle that is called a split plane architecture, okay? Where we have control plane, the brain of the system sits separate from the actual gateway plane, which basically sits in the middle of the critical part of your request. And the gateway plane itself, we designed this as a lightweight system that you can deploy multiple instances of it across different regions of the world. Today our gateway plane runs across 17 different regions of the world as a highly available piece of software. So that continue to help us scale and maintain our SLAs. And the fast forward to today sharing some metrics here. We actually have we are actually able to achieve more than four nines on our gateway. And we are running SLA of less than five millisecond worth of latency that gateway introduces, which is remarkable compared to other gateway products that achieve in the industry. And our customers are running our product today in production critical application where we have tens of thousands of requests per second that we are fielding through our gateway product. So the system has truly scaled from a software standpoint. The last part around scale is how do you think about scaling into our company that go to market around this thing? And this is an area like where we have followed an experiment or stay extremely lean approach until we have proven that something works. And when we realize something works, we create a machinery around this thing. So what I mean by machinery around this thing, we mean that then we scale in that function aggressively. We hire in that function aggressively. We run training programs. We run onboarding programs. And we program it as the entire thing that this itself can now run as a truly automated scalable piece of an organization basically. So that's a modest opportunity that we have followed from the beginning where we experiment in a lean way until we prove and then we scale aggressively. I want to dig into something here. Why do you think that there is a pull for AI gateway? And what are enterprises realizing now that wasn't obvious before? We have actually seen the entire evolution of this AI gateway not being in demand to AI gateway being in critical demand over the last three years since the chart GPD moment. And let me actually walk you through this timeline a little bit. Back in 2023, enterprises were towing around the journey AI applications. They were building some internal productivity applications, mostly prototypes, POC type of things. In 2024, as agents started to become a reality, enterprise started realizing the value that these agents will likely be able to create over a period of time. So they started becoming more and more serious about Gen AI going to production. And at that time, one of the big shifts that had happened in industry was every new launch of a model from different providers was better than the other ones. So OpenAI, Anthropic, Gemini and Open Source models, all of them were competing. And nobody was ready to take a bet that this is a winning horse. This model provided a winning horse. So multi model stack became a reality in 2024. But at that point, all of these models were what we call as our OpenAI compliant API signatures. So people thought that I'm going to build out an internal LLM proxy layer that will help me route these queries to any of these model providers. Great, it worked. It's set in the critical path of their model queries and people built it internally and nobody was looking for an AI gateway externally. Okay, this is in the beginning of 2024. As we started moving towards the end of 2024, these applications, the agent application that they started actually started going to production, which means the uptime of these applications became critical. But at the same time, the world outside of these enterprises started changing very rapidly, which means these model API signatures that were consistent earlier started diverging. So now this AI proxy layer has to maintain this completely diverging model API signatures. But at the same time, new protocol started to emerge. For like MCP started to emerge, A to A started to emerge and people could now see that what started as a thin LLM proxy layer will start duplicating itself in the MCP world and in the agent world. So now this proxy layer has to become an overall control plane for all of the agentic or genetic API applications that are being run within the enterprise with all the things around guard rails compliance rules cost pin ops layer. All of these things have to be centralized within this control plane. They had to centralize the observability, governance, layer of these agents into one single control plane. And that's when enterprises started realizing that building a piece of software as complex as this while I need to maintain these applications in production is becoming too complex. And that's when a natural pool for AI gateway started happening in the industry. So we started seeing this in the Q1 Q2 time frame of 2025 where we started seeing inbound request and by the putting it into perspective, Gartner also predicts that by 2028, we will have more than 70% of enterprises that will end up adopting an AI gateway and we are really seeing that pool coming to life right now. As you step out on the balcony, you look across all that you've built as far with true foundry. What are you most proud of? The absolute thing that I'm most proud of is the team that we have built at true foundry. The reason I believe that is the biggest win is because we see this very smart group of dozens of people who are at true foundry who are extremely motivated to solve this problem long term. Nobody is looking here for just quick wins. People want to solve this foundational problem. People are ready to roll up their sleeves, get into any of the problems within the company. Cross-functional challenges, talk to customers, fix customer problems, build the products, right? Sales people are talking to product people, giving feedback, product people are jumping on customer calls. So this kind of motivation that we have within the company is the biggest win. And it also shows in the rate of hiring, the rate of retention, the rate of churn of these people within the company, I think that's the massive win. Outside of this, when we think about the overall product landscape, one of the biggest things that I'm proud of from a product standpoint is this core engineering or the plumbing layer that we have built out where how we can run any pace of software fitting into an existing complex enterprise stack and just run this in production, right? So our stack, our foundational stack, not depending on a modus operandi, really allows us flexibility to adapt to the market. That I think is such a massive differentiator that true foundry has built over the years that is extremely challenging to replace for any other new player out there. Let's flip the script a little bit. Tell me about a mistake you made and how you and your team responded to it. Back in 2024, remember how I mentioned that all the enterprises thought that this LLM proxy layer is going to be the thin layer sitting in a critical path of the request and people will build this in-house, right? So that's what the enterprises were thinking. And actually true foundry, while we had that product back then, like, well, we had built this out for our own internal usage, we had built this out as an external proxy layer. We also believed that this is a layer that will be built more in-house and it's such a thin layer that people will actually not buy this. That mistake made us lose some of the development that we could have made for the year between 2024 beginning to 2025 beginning around the product of AI gateway, right? And then we adapted to solve for this mistake by keeping our eyes and ears open to signals that we were seeing in the market, how this gateway layer evolved and how this became a critical component of the overall enterprise infrastructure over a period of time. And the way we solved for this mistake was actually responding to it really fast. Once we noticed that trend, once we noticed that cool from our customers and we are obviously in a great vantage point where we have privy to these signals early on, we responded extremely fast, like we acted quickly, decisively, we invested a lot of our engineering effort, product effort, go-to-market effort around this thing. And within six months, we actually built out so much, we covered so much ground that today we are proud to say that we actually are one of the most advanced AI gateway products out there. And this again, could also the team that they shifted so quickly and built the product out that fast. Your coding agents have access to your code base. Maybe you even connected other tools via MCPs, but access doesn't mean context. Agents can't reason across MCPs. They don't know your architectural decisions, your team's patterns, or why the API
was shaped the way it is. So agents look in the wrong place and deliver bad outputs. Then you spend time correcting. More loops, more tokens. It synthesizes your PRs, docs, slack, and tickets into organizational contexts that agents actually understand. If you're running cloud code, cursor, or any agent work flow, unblocked is worth a look. Learn more at GitUnblocked.com/coatsstory. Let's look into the future then. So what does the future look like for true founder for the products you built, for the team, for the company? And as you look into the industry too, like maybe the challenge is around enterprise GNI projects and what that looks like moving forward. The reality is that even today, by the way, with all the buzz around agents and agent applications, I think most of the enterprises are still building these agent applications in a very low risk, low reward setting. And what that means is people are probably building hundreds of these AI agents, which are primarily personal productivity boosters, or maybe at best a small group of people, a small group of analysts, a small group of marketing people. So these are like things that are being built for small functional units. And the impact of these applications are likely not as big. So I think the first challenge that the industry will need to solve for is actually go from these like extremely micro-agentic applications to applications that have meaningful business driving impact. And we have actually seen the enterprises that have done the best in the GNI I've worked at the ones who have taken some of these bolder bets and put these agents in the critical path of their business as opposed to these side case. So I think that's the first version that will start changing in the industry and we're starting to see this trend happen. As people start putting agents in the critical path of their business, ensuring that they have complete control over these agents, it does not end up doing performing unintended behaviors. People do not have prompt injection attacks. Agents don't end up giving out these $1,000 flight tickets for free through people jail breaking and stuff. So those are some of the things that they will really need to tear because one such big mistake will again take back all the investments around the agentic side within the enterprise. So these are a couple of things that the industry will absolutely need to solve for, which means that architecting their stack right having this central control plane where they are able to see meaningful applications landing in production, while they can do this with confidence. So that I think is the industry level challenge. And that also very nicely shapes up in how we think about the company evolving because at this point it's fair to take the bet that the biggest type of advancement in the compute utilization will happen through the agentic applications. Like most of the compute in the world will start going more and more towards these agentic applications. And from a true boundary lens, we are actually building out the orchestration platform, the control plane layer where we can manage all of this compute flowing through a single gate window. So we have observability and governance and we can run this compute through our AI deployment layer all on top of Kubernetes. So we start becoming this one platform where agents are developed and orchestrated runs. And this I'm still talking about the next few years where agents become a real thing, but in the long term, the vision of the company is that we want to become the central compute orchestration platform for organizations. So a reasonable way of mapping true boundary is what data warehouse companies like Databricks or Snowflake did or data of an organization. The unleashed magic by centralizing the data of an organization. True boundary intends to do the same thing for its by centralizing compute of an organization. Because once you start bringing all the compute layers in one central control plane, you will notice that a lot of the other things start falling into place. And this vision that we started with in the beginning is started to become more and more apparent with agents taking control of this compute layer through MCP layer and skill sets. Skills of the agents basically. Let's wish to see you, Nikaj, who influences the way that you work? Name a person or many persons or something. You look up to and why. Maybe I'll mention two people here. One from my personal life, one from my family, and one from an entrepreneur that I respect a lot. So the one from my family is actually my dad, who influence a lot of how I work. Maybe I'll share a story here. There's one day when I was ironing my shirt and while I was ironing my shirt, I left the bottom 10% of your shirt that you tuck in. Actually, I left it unironed. Okay. And my dad was like, of course, my rational was that nobody gets to see it. So why do I run it? And my dad was like, it actually doesn't matter that people get to see it or not. But if you are doing something, you do it with perfection because you know there's an unironed edge quite literally of what you have worked on basically. And that will never give you confidence that you executed on something perfectly. That's the model's apprendee with my dad works. Do whatever you take with all your heart into it and with all the perfection. And that now shapes literally everything that I end up doing. If I end up taking like what is known as the most meaningless task in building a company, I still do it with that complete dedication and try to execute that with perfection. So that has just shaped how I operate as an individual in life, not just in company building. And then an entrepreneur that I admire a lot, the way he operates, is actually Elon Musk. I read a lot about him. Of course, there's always these controversial statements that keep happening about Elon Musk in the world. But like this year dedication, where he boils down everything to first principles and he takes these bold bets and is not scared of building out these extremely large like long term problem statements and showing that if you are executing on these problem statements with a lot of dedication, you create that kind of environment, like that alignment towards the vision of what you're working towards. Then you have a team that follows it right. And what we have seen in our team and this is like not just true with my motives apprendee like my co-founders as well, that the three of us align on this vision that we are working towards long term vision, right, where we are solving a problem that really matters. The team is bought into that problem statement. And now even when things are slightly rough, the team will just come together and they will work towards it, right, like they will work through patches of the company building and that's what you care about. And the fact when they see that founders are truly driven towards working towards that mission, they are putting their heart and soul into doing that thing, the team starts emulating that behavior. And that is one of the things that when I look up to the stuff that Elon Musk has done in life, like I keep taking inspiration from that. Nikon's last question, so you're getting on a plane and you're sitting next to a young entrepreneur who's built the next big thing. They're jazzed about it, they can't we showed off to the world and can we show off to you right there on a plane? What advice do you give that person having gone down this road a bit? Like, in any point in time, you are either earning your reputation or you are burning your reputation, okay? And reputation I do not mean to say in the shallow sense, you know where people know about you and they're talking about you, I'm not talking about your brand, I'm talking about your reputation as a person as an entrepreneur at a deeper fundamental level, right? And what that means is that if you are a person who is doing things with the right intent and you're communicating that thing, always, every single time, clearly, honestly, to everyone around you, where you do treat your, you do not have this three different faces that you show to your team, to your investors and to your customers, you keep things consistent. If you make mistakes, you call that out to everyone. If you have a vision, you work towards that. If you make some changes, you call that out to keep people aligned on what you're working towards and you're ready to own things up, that reputation keeps on building. And then even if at some point you make a mistake, people know that whatever you are saying is all there is to know and they do not have to second guess what you're doing. So like your entire ecosystem that is critical for your own success, will stay aligned with you through and through. And that I think is the biggest piece of advice that I would give to any upcoming entrepreneur that just focus on that, do not try to game the system, keep working on the first principles. Life has a way of adjusting, getting refined and working in your favor over a longer horizon of time. That's fantastic advice. Well, the coach, thank you for being on the show today. Thank you for telling the creation story of True Foundry. I really appreciate this Noah. Thank you so much for having me on the show. And this concludes another chapter of Code Story. Code Story is hosted and produced by Noah Labhart. Be sure to subscribe on Apple Podcasts, Spotify or the podcasting app of your choice. And when you get a chance, leave us a review. Both things help us out tremendously. And thanks again for listening.
Podcast Summary
Key Points:
TruFonry provides an enterprise-grade AI gateway product with a split-plane architecture, encompassing LLM, MCP, and agent gateways for building agentic applications.
The company was founded by Nikunj Bajaj and his co-founders, inspired by their experience at Meta, where machine learning was treated as a vertical stack (software > ML > generative AI) running on a unified interface.
The MVP took over a year to build, focusing on a Kubernetes-based core infrastructure, anticipating that ML would converge on Kubernetes for enterprise scalability.
The product roadmap is guided by a consistent foundational architecture (Kubernetes) and an evolving UX layer that adapts to industry trends (e.g., RAG in 2023, agents in 2024, MCPs in 2025).
The team was built around complementary skills (ML, infrastructure, strategy) with a focus on hiring for problem-solving passion, vision alignment, and founder mindset, with founders deeply involved in hiring.
Scalability is addressed through Kubernetes-native design for horizontal scaling and a split-plane architecture for the AI gateway to handle critical API traffic reliably.
Summary:
TruFonry is an enterprise AI gateway and deployment platform founded by Nikunj Bajaj, inspired by his experience at Meta, where machine learning was vertically integrated into a unified software stack. The company’s core hypothesis was that as ML hit an inflection point, organizations would need to move from parallel stacks (software, ML, generative AI) to a vertical stack running on Kubernetes. This led to a year-long MVP focused on building a Kubernetes-based infrastructure, enabling deployment on any cloud or on-prem environment.
The product roadmap balances a stable foundational architecture (Kubernetes) with an adaptable UX layer that evolves with industry trends—from RAG in 2023 to agents in 2024 and MCPs in 2025. The team, including co-founders Anragan and Abhishek, was built for complementary skills and a shared vision, with founders personally hiring for hard skills, problem-solving passion, and ownership. Scalability is achieved through Kubernetes-native design for horizontal scaling and a split-plane architecture for the AI gateway, which sits in the critical path of API calls to LLMs and agents, ensuring reliability.
TruFonry now serves large enterprises, helping them connect, observe, and govern agents through a single control plane.
FAQs
TruFonry provides an enterprise-grade AI gateway that sits in the middle of traffic to LLMs, MCPs, and agents, encompassing LLM, MCP, and agent gateways for building agentic applications.
TruFonry uses a split-plane architecture to ensure the gateway stays up, as it sits in a critical part of every request.
The founders, who previously worked at Meta, realized that Meta’s vertically stacked platform for ML and generative AI was superior to the parallel stacks used by most enterprises, and they aimed to adapt this approach for large enterprises.
TruFonry bases its roadmap on a consistent foundational architecture (e.g., Kubernetes) and adapts the UX layer to evolving models and trends like RAG, agents, and MCPs.
TruFonry looks for hard skills in enterprise infrastructure, alignment with the company’s vision and mission, and a founder mindset with strong ownership.
Scalability is achieved through a design principle rooted in Kubernetes, leveraging community-based development for horizontal scaling, and ensuring the AI gateway handles all traffic reliably.
Chat with AI
Loading...
Pro features
Go deeper with this episode
Unlock creator-grade tools that turn any transcript into show notes and subtitle files.