Go back

Meta Hiring Lead On Behind The Scenes of Senior+ Eng Hiring

102m 39s

Meta Hiring Lead On Behind The Scenes of Senior+ Eng Hiring

The transcription details insights from a Meta hiring committee member on the behind-the-scenes hiring process, emphasizing the importance of behavioral interviews for leveling decisions, particularly for senior engineers. The process begins with a recruiter screening based on years of experience and past titles, but candidates from non-FAANG companies may be downleveled due to "level inflation." For senior roles like staff engineers, onsite interviews include multiple system design assessments. Behavioral interviews are crucial for evaluating a candidate's scope, influence, and organizational impact, with committees looking for evidence of large-scale project leadership and measurable business value. While lying about experience is theoretically possible, it is challenging due to rigorous follow-ups and multiple interviews with experienced evaluators. Effective preparation involves crafting concise stories that highlight technical depth, complexity, and impact, skills that also aid in career advancement. The overall process involves recruiters, hiring committees, and engineering directors, with committees advocating for candidates during final decisions.

Transcription

21632 Words, 119390 Characters

English
sometimes we would down level them significantly. - This is Austin MacDonald. He was a meta hiring committee member and led mobile hiring across the company. And I asked him to share what happens behind the scenes. - But I have seen cases where referrals play, you know, a huge role. - What does that rubric look like? - We would not be able to hire someone at a staff level unless we had provided two system designs. - We covered how to avoid down leveling at senior levels. - You mentioned there's an initial leveling determination. - There are certain conversations you should be very careful about. - And how to prep for specific companies like OpenAI and Anthropic. - I'd be curious to hear what you see in their values to help people who are looking to get hired at these companies. - An Anthropic they're known for assessing whether or not you are. - What if you had some really unethical candidate? - You know, we can talk about lying, right? Now if you can do that successfully. - Here's the full episode. - Behavioral interviews are kind of one of the most common signals in hiring committees that down levels candidates. And so, and I think this is especially important for senior engineers and hire. And so today I want to cover all of the common mistakes people make, how to prevent from getting down leveled. And also I'd like to go over some company specific tips for people who want to work at hot companies like OpenAI and Anthropic. So, yeah, I'm hoping that with your experience working on recruiting, leading iOS and Android recruiting across meta and after having conducted hundreds of interviews. I'm hoping you can kind of give us some of the behind the scenes in these hiring committees. So we can learn about how to do better in our behavioral interviews. - Oh yeah, behavioral interviews, my favorite thing to talk about, so I'm excited to be here. - What actually goes on in the hiring committees? - The first thing I would say is like, when I would get a packet in front of the hiring committee and it was a senior packet, the first thing I would do is go to the behavioral interview. I would want to understand what is the scope that this engineer has operated at in the past? What's the level of influence? What's the level of insight? What's the level of communication? What's the level of organization that they've operated in? And that would be the first thing I did. And these committees are built of other engineers, they're built of other engineering managers who are influential in the company. They're recruited by someone like me, the hiring committee chair. And their job is to partner with recruiting to understand whether or not this engineer should be hired, hire in a higher decision, but also a leveling decision. And then they send that up to sort of company-wide committee of people who, honestly, most of the time, what they do is just sort of a gut check on a cross company, a hiring bar. - So I'd love to learn more about the back end of the recruiting. So let's say I'm a staff candidate and I'm gonna go get hired at Metta. Who are all the people involved? What do they care about? And how do they contribute to the hiring process? - Yeah, great question. So the first person you typically engage with is somebody called a sorcerer. This is someone who is responsible for finding potential candidates. Oftentimes they are more junior on the recruiting side and this is a entry level job for a recruiter. Their job is to co-contact you or maybe to process referrals, this is their first touch point. They're looking at some kind of job description and looking at your years of experience. That's probably the biggest thing. They're assessing your past companies, your past, whatever they can find about your past experience, looking through the referral that they look at and seeing whether or not they want to pass you through to some kind of phone screen process. So this is the part where you see it as an engineer. Sometimes this phone screen is a technical one where they are gonna be giving you some kind of coding interview right that's really common. It could even be a sort of pre-phone screen conversation where they're asking you sometimes we would give out multiple choice questions for engineers like, oh, same but this part of iOS is a time this part of Android and then you'd have to be able to answer those questions just as sort of a pre-filter to make sure that we're doing phone screens in an efficient way. Of course, once your phone screen happens, it goes back to the hiring committee actually unless it's a very solid hire. If it's a very solid hire on the phone screen side, you get passed directly onto the scheduling for an on-site interview. But if it's kind of on the border, then we would review it as a hiring committee. We would look for signals, all the signals that people talk about in coding interviews. Communication and problem solving and all those things. And we would see whether or not would be worth to follow up interview or we should just pass on this person on through to the, to the, to the rest of the, of the hiring process to onsite or if we should maybe pass on that person overall and just maybe come back to them some other time. So that would be the first time that the hiring committee is involved in a hiring decision. After that, sometimes the hiring committee would be consulted when there's a certain kind of candidate has specialized experience. So for example, if you were like a very low level mobile engineer doing like C++ work, for example, on the mobile side, we would want to make sure that you were giving you appropriate system design interview that really assesses you for your specific skills. So then we would also typically be consulted at times when there's a, a, a choice of whether or not this person isn't as a staff level engineer or a senior engineer. Oftentimes that's the place in companies where the hiring process starts to change. So for example, at Meta specifically, staff level engineers would have two system design interviews. And so they would not be able to hire someone at a staff level unless we had provided two system designs. So that sort of decision about how to structure the loop starts, starts there at that, that on screen, on site scheduling point in the hiring process. And then of course, as you go up, as you go up to principle or as you go up to distinguished engineer, those hiring processes are very different and they add additional behavioral interviews and that's what they add. So we can talk about that at some point. That's how they are assessing whether or not someone is a principal engineer or distinguished engineer. And then after you go through the on site experience, then it comes back to us as a hiring committee. And we make a decision, do we hire you at what level? Do we add any additional follow-up interviews? Maybe one interview didn't go very well, maybe an interviewer, maybe you flubbed it and we want to give you another chance. Maybe we, maybe the interviewer didn't do a very good job acquiring signal. And that happens a lot actually in the behavioral interview. So the behavioral interview is one of the hardest ones to give and one of the hardest ones to interpret. So oftentimes we would do follow-ups on behavioral interviews if we didn't get the right signal. And then after that, at least at meta, it would go to a committee of engineering directors and they would make the final hiring and leveling decision. Sometimes members of the hiring committee would accompany the recruiter to that conversation with the engineering directors and advocate for our decisions as a hiring committee. So possibly we're deciding to take a chance on somebody, maybe this aspect of their packet is weak, but we're really excited about that. We think that the company would really benefit from having engineers who have whatever that specific trait is. This problem solving piece or this technical skill or this organizational influence skill that they've demonstrated in their on-sites. And we would need to go and advocate for that before the engineering directors. So that would be the process for an engineer from start to finish. At the beginning, you said there's that low level recruiter that makes some gut reaction. And just to understand, because the leveling decision is the thing I'm most curious about, the way that they would judge the level of the person to kind of enter the funnel is mostly based off years of experience, is that right? Years of experience in previous title. So if you are a staff engineer at Google, then they'll probably try to bring you into staff engineer here at MetaNow. A lot of companies like Meta don't have public levels, so it can be difficult to see just from someone's LinkedIn what level they are. So that's why they rely so much on years of experience. A lot of people, their companies, might be someone outside of thing who has many years of experience and their title is extremely high. Let's say they're-- Right, they're-- They were confined. It's in their vice president. Yes, yes, exactly. Vice president-- Get the vice president like four years. Yeah, yeah. But let's say it's somewhat a principle architect at some non-fane company, for instance. What's that recruiter going to set them at? And how do they get leveled when you're not in thing coming into thing? So sources understand this. And recruiters understand that there is level inflation in different parts of the industry. And so we would take somebody who worked at-- even sometimes big tech companies, but non-fane companies, like maybe companies that are more oriented towards a business, we would take them and down all of them significantly. So they would even be supporting maybe 10 or 15, 20 people as a manager, maybe even more, maybe 50 or 75 people as a manager. And sometimes we would down level them and just give them a team of 8 or 10, thank engineers, right, at meta. And likewise for ICs. So it's not just that if you put on LinkedIn, I'm a principal engineer. You can suddenly get principal engineering sources reaching out to you. They understand that different companies have different expectations for their levels. And maybe there's some world, which we'd like to live in, that this is all consistent, but it's not the world that we live in. Just out of curiosity, what if you had some really unethical candidate who they worked at Google? But let's say they-- in reality, they were only a senior engineer or something wherever they were. But they had the years of experience where it'd be believable that they could be maybe a senior staff engineer or something like that. And that was listed on their resume. What would happen if someone did that? And I imagine that first hop would go to senior staff. What then happens that prevents that from working? Yeah. For example, the first phone screen with an engineer that you have for a staff level engineer or above is usually some kind of-- not just a simple coding exercise, like you would for a mid-level or a senior engineer. But it is also sort of sort of scope check. There's a mixture of coding, system design, oftentimes a conversation with you about your past experience where you walk yourself. they walk you where the candidate needs to walk the interviewer through some large project that they shipped. Now, so that's the first sort of check. Can you pass a sort of system design conversation at a high level such that we would pass you through for the on-site, the real system design interview? And then can you tell me a story which is of sufficient scope of what you've executed? Now, you know, we can talk about lying, right? There are some really famous liars in the world. We call them actors. So, but I will tell you that Los Angeles' restaurants are filled with people who are trying to get into the lying business, right? And they can tell you how difficult it is to be an actor. So, yes, I do think you can. Maybe you can come up with a story, right? And you maybe you can use AI to tell you, oh, let me tell you about this, like, a company-wide project that I shipped at Google. It is pretty challenging to lie in a convincing way. We as, as, you know, people, we have this sense of, is this person really telling me the truth? And then there's always the follow-up questions. And I've experienced this in my coaching job where I can tell someone's telling me a story that they have gotten from an AI because I start to ask them these follow-up questions, especially about technology. And then they start to give me these kind of vague answers or they really don't. The answers don't sort of don't fit together. And then I get the sense of, like, this person's just not telling me the truth. Am I foolable? Like, yes, everybody's foolable. If you're good enough liar, yeah, you can make this happen for sure. But I think it's actually much harder to lie than most people expect it to be. And so that's the first step. And then after that, you have this barrage of on-site interviewers, interviews with highly calibrated people. So when we put interviewers for staff level or for, or principal level engineers, we send very senior people to those people who have been in the industry for a very long time, who have interviewed a very lot of people. They are highly calibrated. And yes, you will have to lie repeatedly to these people in a convincing way in order to get all the way through. Now, if you can do that successfully, I don't know, maybe you are good enough to be a staff engineer or principal engineer, you know, maybe you'll be fine. And then we'll hire you, right? And then the question is, can you meet expectations at that level? I do not have stories about people that we hired that we just. We thought was totally lying to us, even though of thousands of people. I have not heard that story. I think it's much more difficult than people expected to be. In theory, if someone was a generational liar, they could do this. It's just a lot harder than people think, okay? Because yeah, I think that's on a high level when. Maybe it's just an engineering mindset. When I'm coming in and I'm thinking about interview prep. My first thought is, okay, I got to be good at the technical, but the behavioral, I can kind of wing it. I can tell some stories. It's a little bit of a softer thing. It's about me, right? Just be yourself. Yeah. I think that's a thing that a lot of people get wrong. That gets them down leveled. So that's why I'm kind of so curious to go through what is it in the behavioral interviews that leads to the leveling determination. So you mentioned there's an initial leveling determination, kind of a gut called by the first hop in the in the layer. At some point, you're placed into. It sounds like a range. You mentioned in one case. Exactly. There's a. They're trying to figure it out, and so then you're. Maybe staff, maybe senior, and they give you another loop. What do you need to do such that you are placed in staff if that were your goal? One of the most important things when you're choosing any kind of story to tell in a behavioral interview, or when you're having a conversation with a recruiter, which is also kind of like a behavioral interview, is to ensure that you're establishing yourself as a certain scope. That scope is about what size business problems have I solved with technology and what level of ambiguity and what level of organizations have I operated within, and what have I been able to accomplish in that operation? So when you have a conversation with a recruiter and you're talking about your past experience, you have got to land, and that first, talking about yourself, kind of thing, like, "Oh, who are you? It's about you, been up to you." That conversation is super critical, and people think about it from an interviewing perspective, but it starts there in that conversation with the recruiter. So you have to come in and say, "I have demonstrated and delivered large business value with technology." And it's kind of like the greatest hits from your resume. People always tell you have measurable impact and results that's present on your resume. That's using some kind of metrics. That's super important. It's also to convey a sense of depth, a sense of complexity. You could say something like, "Well, I improved performance in the Facebook app," and then people say, "Okay, that doesn't sound super hard." But if you said something like, "Well, I organized across 100 engineers this entire organization to spend a 12-month performance improvement project that ran into multiple very difficult technical issues that required multiple staff-level engineers in order to solve many months of investigation and experimentation." And then we came out with these three core principles, and then we then we, you know, we we ship this performance improvement. So I think when you start talking about the complexity of the work, you need to communicate the technical depth, you need to communicate the organizational depth, you need to communicate the business value, and the business impact that you delivered. And those are the things that the recruiter is listening for, and likewise, everybody in the process is listening to that. All the interviewers are listening for the same thing. So getting really crisp and practicing that tell me about yourself piece is the first place where you can ensure that you're getting into the right leveling bucket. I noticed there's a lot of correlation between what you're talking about and also promotions as well. For instance, when you're talking about promotional behaviors for staff, your projects don't just want to be, "Hey, I ship this thing and it's good for my team." You want to be doing things that are across the org and larger and complicated and challenging. So are you saying that those are pretty similar? Oh yeah. In fact, preparing for behavioral interviews will actually make you a better engineer. And I think being a great engineer is being a great communicator especially about your impact is the thing that you need to do is to be a great behavioral interview. So yes, for sure, you need to be able to quantify your impact, communicate efficiently, communicate effectively. And honestly, we're talking about lying earlier and trying to keep people from lying. But most of my clients, most of the people I talk to in my coaching business, they have a problem not telling enough of the truth, like not telling, they're not busing themselves enough, not talking to be enough about the accomplishments that they've done. So to me, that's the thing that most people need help with. They need to, they need help showcasing how difficult the problem was. They need to show, show casing what kind of impact they made, not just on whatever top line business metric it was, but also what kind of impacted it have on the team, what kind of impacted it have on on code quality, what kind of impacted it have, no long term in the organization that they were operating within. So for me, think about if you're, you know, coaching engineers to do this, I spent a lot of time thinking about, you know, what are all the implications of the work that you've done? And then how can you be really crisp about having that conversation? Because the flip side of that is like, well, if I want to talk about all the things I've done, that takes a really long time. So that's why I take some some some preparation, but certainly getting really good at behavioral interviews, communicating, telling stories, for example, telling stories about what you've done, you do that all the time. You do that to your manager every week in a one-on-one. You do that to the executive whenever you're presenting your results. And that's a super important skill to learn as a senior engineer. In the interview process, it sounds like at every point, whether you think you are or not, you're actually being assessed. Well, I mean, as usually that first call, at least from my recollection, it was pitched to me as, hey, this is a little chat, you don't need to prepare for it. Just go ahead and, you know, come and talk to me. I'm just the recruiter. But actually, that call is, hey, talk to me. I'm trying to figure out what level you are so I can place you in the right loop. And even see if you're worth talking to for follow up. So am I understanding that people should just sell themselves at every single minute of this recruiting process? Yeah, always be closing, for sure. Definitely, this first call is an evaluating call. They are interested in you, right? Usually they, they, they've contacted you or they have you applied and they're contacting you. So it is a softer kind of evaluation. You shouldn't be super nervous about it. They are your, they are your, your buddy, they are your partner. Let's remember that especially a big company, these sources and recruiters are incentivized by how many hires they can deliver. So no, they're not your friend, right? They're certain, certain conversations you should be careful about, especially about compensation with these folks. But they are advocating for you. It is actually benefits them to find some a great candidate and be able to get them all into the process. That is in their best interest. So it is a, you know, it is not a confrontational experience you need to prepare for. But yes, it is evaluative. You should not just show up to that phone call, emotionally disconnected or unprepared to talk about your past experience. And if you're, if you are like that, then I would delay the call. So we scheduled a call, spend a little bit of time preparing what you will say to the recruiter so that they get an accurate sense of the kind of impact that you've delivered. And that's going to be your best bet at getting that at higher level offer. I've had experiences where I got through everything. And at some point they said, congrats. You've got the offer. It's verbal, but you have an offer now. So, you know, congrats. We just want you to talk to the hiring manager just one last time. Just, and this is for you. They want to tell you about the company this and that. Right, right, right. Is that also a case where the hiring manager is trying to get signal on you? Oh, of course, of course. I mean, the same exact things apply. So yes, it's a little bit lower pressure than say the behavioral interview or the coding interview in the middle of the process. But definitely when you have this hiring manager chat or at a place like meta or Google, they have a team matching phase, right, where you're having conversations with multiple managers. And they're trying to find a fit for sure. You know, that conversation is super important for you to have a buttoned up introduction of yourself. I tell me about yourself. I do think that that one is a little bit more social. So in an interview. setting the interviewer has a set of questions. They want to go through the questions. So the longer you spend introducing yourself, you're actually hurting your time management there. You're preventing them from collecting other signal about you. However, I think this higher manager conversation, it is more of a, like, do I want to work with this person? Do I want to hang out with this person? So you do need a little bit more of a loose social engagement, especially in those early phases of the conversation, hey, how's it going? I don't know whether sports something something, right? I think that connecting with the manager on whatever's important to them is really key for that interview. But certainly, it is not just a formality or it is not purely for you. It is certainly the case that the higher manager wants to see, do I want this person on my team? And they need to come out of that conversation with a couple things. One is, do I like this person? Do I think they'll be successful in the team? Will they fit the team culture? Will I, you know, will I as a manager benefit from bringing this person onto my team? And then they need to come out with a sense that you can deliver and solve problems that are similar to the problems that they have. So it's so important for you to do as much research with the recruiter and sorcerer in advance if you're going to have this conversation. Understand what this manager values, understand what their team is working on, and then be able to tell your stories in a way that showcases it. Yes, you can solve the problems that this manager has. You mentioned briefly there. You said the recruiter, the compensation conversations with the recruiter and how you need to be extremely careful in those conversations. What's the most common mistake people are making when it comes to those compensation conversations? Yeah, look, I'm not a negotiation expert. I won't present myself as one. You can even hire people who are really good at helping you negotiate with these big tech companies. And I recommend that you go get some advice from them. But I will say that, you know, early anchoring in any negotiation is dangerous. So if, if, if early conversations with their asking you about your compensation expectations, you should be very careful about what you tell them because that will, that will anchor you into the expectation, to the conversation that you talk about. You should definitely get some advice and understand the laws in your local jurisdiction. So for example, in California, in New York, you required the recruiter is required to tell you about the bands and salary of bands and total compounds for each of the jobs that you're applying for. So you can leverage that to understand where you are in the compounds at that point. But I would not say I'm an expert at negotiation. I think probably the biggest mistake most people make is they don't have multiple offers. So if you are negotiating from position of weakness, like I don't have any other offers, I'm just talking to you and you're the only company. I'm talking to you. It's going to be very difficult for you to get to extract anything from that company, and which is why it's so important for you to orchestrate your offers, to land at a somewhat similar time. I know that's more stressful. I understand it takes more work, you know, to go through the interview process at the same time. But if you have multiple offers in hand, that's your best bet for being able to improve your compensation position. So I guess going back to the leveling side of things. Let's say I'm staff engineer and I will only take an interview if it's staff and I make a mistake early in the process. Like I'm talking to recruiter. Like on the phone screen, for example. Yeah, yeah. Can I be direct with the recruiter and say, hey, I see that I'm getting a lot of coding interviews. I think maybe I got the wrong, I might have sent the wrong signal. In which case it's fine. Let's just end the process. Or can I get leveled at a heart? Can you negotiate at that level in mid-process? Yeah, that's a really good question. I'm sure it depends on the company in the process. I would say that's a good conversation to have with your recruiter if you know that you're being placed and to consideration for a level that you don't want to be. What I will say is that there are many times when we would up level people as well, as down level people. And so the recruiter will, it's their interest. They'll try to keep you in the process. They will say, let me stick around. Maybe we'll evaluate you. And maybe we'll go for you this second thing. And I would push for to go ahead and try to get as much of that evaluation process done for the level that you would like to be hired for as much as possible. That way you don't have to go through follow-up interviews or they don't have to change something about the process late in the game. Try to collect as much information for the hiring committee as possible at once, as possible. So yes, I think that's a good conversation to have. But if it was a job you were really interested in and they were offering, they were considering you for one level below and they were not willing to change anything. I would, it depends on the job. Obviously it turns on the total comp opportunity and where you're at. But I would say try to rock the interviews as much as possible and then get that consideration for the hire level. And you can do that in a couple of key ways. So the first way is to make sure that you're anchoring every conversation you have with all of your interviewers at that hire level, which again, it comes back down to that tell me about yourself when they, especially behavioral and the system design interview, when you're having those conversations and you are talking about very large scope projects, talking about impact, which is commensurate with that hire level, the behavioral interview will especially will notice that. And then they will want to dive into that and they will want to ask you questions and they will then you're resetting their mind about what to expect from the interview. And that's super important. And then the second place is in that, is in the story choice that you have for your behavioral interviews. So remember that this, when everyone's asking you a behavioral interview question, there's always a question behind the question. Like why are they asking me this? They don't actually really care about my favorite project or like they really don't actually care that much about some time I had a compliment manager. They're probably going to forget a bunch of those that detail right after the interview. What they want to see is are you operating at the level that they are expecting you to operate? So make sure and I talk about this in the book. There's four different considerations for whenever you choose a story. And the number one choice is scope. You want to make sure that you have come out of that behavioral interview, telling the stories that are the highest scope and the ones that represent you the most, the ones that you would love to tell to a hiring manager. So that's your job as a behavioral interview candidate. I want to leave that interview having told the most important stories from my career. And sometimes I can be kind of challenging because they, you are not driving, right? The interviewer is driving. But your task as a candidate is to guide the interviewer towards that signal, towards that place in your career, where they're going to collect the signal that you think best represents you. And you do that by choosing stories that are the highest scope and the highest impact that you've delivered. So around a year ago, buddy of mine, he was applying for a senior role at all of the top AI labs. And he actually got offered an orthopic. When he was going through the process, I remember him telling me that the single most impactful tool for him in preparing for system design was the free resources that Hello Interview has on their website. If you were preparing for technical interviews, I highly recommend you check out Hello Interview. I would have said that even before they sponsored this episode, I think they're providing something that's great for the community. Also, if you're preparing for behavioral interviews, they're actually partnering with Austin to provide more behavioral interview resources on their website. So I'll put a link in the show now so you can check it out. This is the absolute first ad I've ever done for this podcast after over a year. Right now, the podcast is running net negative. Hopefully it can sustain itself soon. This is a step in that direction. And I just want to say thank you so much for supporting the podcast. With that, let's get back into the episode. Austin's about to tell us how to avoid being down leveled accidentally. The big question then is how do you do it concretely? Maybe we can go over some concrete examples. What would a senior scope project look like? What would a staff project look like? Senior staff principle? Maybe we can take the same example and kind of evolve it so people can hear what are the key words people are looking for. Right, I'll give you a sense of where big tech companies like Fang-oriented companies are at with their levels now. But for the specific company that you're applying to, you should go to some research and figure out what is expected of a mid-level engineer? What is expected of a staff level engineer? Oftentimes you can find this information on the internet. But I'll tell you, the very simple rubric is something like a new grad engineer is doing tasks. They do a task. Come back to the team, I got to the manager, Jira, whatever or whatever is given the task they go are doing the task, right? That's their job. A mid-level engineer is doing a feature. A feature has many tasks. And the feature is something that might take a couple of weeks or something, and that's what they're working on. And the senior engineer is doing projects. Projects have many features, which have many tasks. Oftentimes projects are ones that are working through others, perhaps other mid-level engineers or other junior engineers who are working underneath them. So there's some kind of leadership and delegation and organization and communication expectation for this level 5 person or the senior person. Staff person, level 6 at Meta, for example, would be somebody who is responsible for some kind of goal. So this is the goal in order to accomplish this engagement goal or this revenue goal, we have need to have multiple projects, which have multiple features for most full tasks. So there's this natural cascading hierarchy of what's expected based on ambiguity, right? That's what levels really mean is how much ambiguity can you handle. The ambiguity of an intern is very different than the ambiguity of the CEO. And that's what differentiates the levels and differentiates the compensation. And then this level 7 or this principal or distinct, whatever you want to call it, this next level, is more about organization. So I'm responsible for an entire organization, which has many goals, which is many projects, which has many features of many tasks. And then maybe whatever the next level is, it's sometimes a distinguished or different people have different names for this thing. But that's responsible for industry. I'm responsible for this industry, right? Which has over this entire business, which has many organizations, which has many goals, et cetera. So I think that when you're choosing stories to tell about landing a certain job, you don't understand what those level expectations are at the company that you're targeting. And then making sure that you're telling stories that hit those notes. So let's take, for example, staff. Staff level engineer is a big difference between that and a senior engineer. And really it comes down to how the breadth of impact that you're making. So you are making impact more than just your small project. and your small area, oftentimes it's an entire team or maybe multiple teams you're working with. Oftentimes you're telling stories that involve a lot of working across an organization, a very large organization. So this is why it's so difficult for startup engineers, unless you were the founder, for example, to get a job at staffer hire is because those experiences are oftentimes limited by the number of people that you've worked with. So if you didn't have to, you know, if there was only one stakeholder CEO and like two or three engineers, it's pretty difficult for you to demonstrate the kind of depth of organizational leadership that is required for that staff level position. Then there's like a technology complexity. So here you can, and this is really difficult in a behavioral interview, how do I communicate the difficulty to this technology problem, this bug or this architecture decision? And you have to quantify that. So you have to talk about the amount of time it has to quantify the risk. You have to talk about the number of people you have to talk to to get advice or you have to somehow give me a sense of how risky it was right in order to make this choice, how difficult it was for you to back out of this choice, for example. So you can talk around the complexity of this technical problem and give me a sense of what is there. And then there's oftentimes leadership pieces. This is something that people forget about. They talk maybe they talk about tech, almost always talk about technology, right? Engineers, oh, I love talk about tech. You know, probably if anybody, they talk too much about tech, right? Then there's this organizational thing which I talked about before, but sometimes people forget that even talk about the leadership parts. A lot of projects involve some kind of influence in mentorship, for example, over others. So now you're convincing people to do things, maybe they don't want to do. That's a big part of a staff engineer motivating people or getting concessions out of other teams, aligning on road maps, that sort of thing. And then there's also mentoring. So how did I mentor and help the people who worked underneath me and made them better? How did I make the team better? I made the org better. So those things are oftentimes forgotten about when people are trying to anchor the listener and make them think, yes, this is a staff level engineer. So really, and we go back to what you said earlier. If you can reflect on your own career, I understand what makes you successful and you can identify those pieces which differentiate you from other engineers. Those are the things that you need to talk about in the behavioral interview. And vice versa. So if you reflect back on your career as a behavioral, behavioral candidate and you think about what made me successful, then you can start to repeat those things in your day job, right? And you'll be more successful in what you do. If you know the rubric, then you can do the rubric and you can also talk the rubric as well. Right. So know the rubric, right? That's the most important thing. I think one of the biggest ways that you talked about scope was kind of in the organizational complexity or how many, what's the leadership position you are in the org? But what about specialists? So I've worked with engineers who, they're solving problems that no one else can solve. They're their own snowflake. And we need that person because they're pushing the industry forward. And it's having a lot of impact. How is someone like that supposed to talk about their work? Yeah. So the first thing is to understand business impact of what you're doing. And I think this is really hard for some engineers, right? Who are focused more on the technology. But there is some reason why this technology was required and some kind of context of which, Brent, which it lives. And I always encourage people to think about, what would Steve Jobs say about this technological advancement that you've brought about? Why is it that this project was so important or so critical to the company? What's the business context? So make sure that you're delivering that. One framing I know that's common in promo committees is this person solved problems that those people couldn't. And well, those people are staff. So then if he's solving problem staff, people then he or she must be greater than staff. So when you're managing to sing that on your behalf in a promo committee, it makes sense. If you say that on your own stories, say, yeah, I landed this project. And actually, there's a team of five staff engineers that failed for a year before I got there. Sounds a little bit too much. I don't think, actually, I don't think so. I totally disagree. So I think this is one of the methods that I hear and is very successful is, again, you're talking around this complexity to give people a sense and to pattern match in their mind. So behavioral interviewers are patterned matches. They are looking to see if you match the patterns that they expect for this level. And one of those things is going to be whether or not you have solved problems other people haven't. So I don't think it isn't necessarily bad to say something like when I took on this project, I was the third owner. And this is where they had failed. And this is where I'm looking for there is not just like, "Haha, I'm better than all these other people." I'm looking for the insight that made their efforts unsuccessful. So, oh, these people attempted, this product market fit and that didn't work. Or these people attempted this technical approach and that didn't work for these reasons. And that kind of judgment and reflection is a big part of assessing someone at a senior level and something that people often forget. They just tell the story, had a problem, I solved the problem, I'm done, and not giving me some sense of what they learned or what the deep-gror inside is. And to me, that's the sign of somebody who is above staff level. The analogs between promotion, conversations, and recruitment conversations, it makes a lot of sense to me. And one thing that I see actually, 'cause when I was looking through the YouTube comments of the previous interview done, there were some people who were saying, people can just oversell themselves and the person was a little bit salty that someone could manage the optics and kind of get a good recruitment outcome. But, and I see that very similar stuff on the promo, the promo content that I've made is some people, usually a vocal minority saying, "Oh, this person just really knows how to sell themselves." And I think that's true and unfortunate that it can just be not necessarily your achievements by themselves just objectively being true. You kind of have to, where it's a very human process. So how you sell it is gonna have a big impact on how it's perceived in both of these. So I guess it's one of those things where, it's just how it is. And you need to learn how to play that game if you want to have good results in the game. - Yeah, welcome to the world, right? And this works for, this works, this is the case in our careers, this is the case in our personal relationships. Don't you know that I love you? Can't you just feel that I love you? That doesn't work, right? You have to do the behaviors, you have to demonstrate the things that, in your relationships, you have to demonstrate the things in your career. And you have to tell people, right? You have to communicate those things. And that may be unpleasant for some folks, and it can be difficult. But this is part of us maturing as people, and us maturing in our careers is understanding that there are certain things that are worth doing that maybe it's a tax like on our progress. You don't have to do them, but you also will not get promoted, or you also will not get the, like staff level engineer, the job, right? I tell people, look, on the other side of this principal engineering job is a million dollars of your compensation. So you better eat your wheaties before you go into that interview, right? You better be ready. And you can say what you want about, like how difficult it is to assess people, whatever, but they're gonna give you a million dollars a year, they're gonna put you through the ringer, so you need to be ready for that. - So going back to the promo committees, I wanted to understand, I'm just kind of like recollecting all the people you mentioned. So there's the Sorcerer, there seems to be a hiring committee. There's the people-- - There's a recruiter. - Okay, yeah, the recruiter, there's the people in the hiring committee, there's the people who conduct interviews, and I guess they draft up notes that the hiring committee reviews, but who's the actual decision maker in these processes? - Right, right, so we should talk, there's a Sorcerer, there's also a different person called a recruiter, I forgot to mention them, but usually the Sorcerer, someone who finds you, they typically will hand you off to someone called a recruiter, once you get into the process, once you get through the phone screen. And this person's the person that you're gonna be doing, the negotiation with, the person that's gonna be organizing your loop, the person's gonna be advocating for you in front of the hiring committee. So there are obviously many decision makers. There's a Sorcerer who's just looking at your LinkedIn and deciding whether they should contact you, there's that decision. There's also the decision of the initial phone screener, whoever's talking to you, at different levels, that could be again, that Sorcerer doing a multiple choice question, or it could be an engineer who's giving you a coding phone screen. Then there's the hiring committee, so the committee makes a decision based on, and usually it's driven by consensus. But sometimes we would have to fall back into voting, but the consensus would be established whether or not this person should be hired at this level, or whether we should do a follow-up, or whether we should drop the person from the process. And then again, like I said, there's this decision being made, generally as a consensus among two or three engineering directors who are above us making that final call. And those folks would operate mostly in consensus, but sometimes they would vote. In the hiring committee, have you ever seen cases where there was some obvious bias? Maybe someone's son happens to land in the hiring committee of the father or something like that? I've never seen an experience where there's any kind of over-nepotism or bribery or anything, and that's really exciting like that. But I have seen cases where referrals play a huge, huge, you know, a huge role, whether or not the referral comes from somebody who's very senior, or whether or not someone has actually showed up in the room in the hiring committee. So sometimes there's a friend or there's someone who's worked with this person before, and they will show up and advocate for you in the room into the hiring committee, and that does make a big difference. So if you can find a referral, I know this is not news or to anybody, But if you can find a referral, you can find somebody who knows you and who will be willing to go and spend a time in a meeting, that will make a big difference. Oh, when I worked at Meta, I mean referrals and as a low level engineer, they just kind of felt like this thing where I just fired it off and forgot about it. But are you saying that at a higher level, like the level of the person matters and to the point where they can even hop into the hiring committee, is that right? For sure. Well, yes, for sure, the level of person who's providing this advice is very much matter. So if it's a VP or a director who is referring this person, they understand that their reputation is on the line. They are not just passing through someone they found on LinkedIn to this process. They are, they have directly worked with this person most likely and are willing to put their personal reputation on the line to hire this person. That's a big deal. I will say that referrals, of course, have varying qualities. So we talked about level. Also the content of the referral. So if it's like, hey, I knew this person in school, like maybe consider them is very different than I work with this person. They have this quality, this quality, this quality and that's why you should hire them. And so for certainly when you are asking for a referral, especially if the person has worked directly with you, you should provide information to them. You should like write the referral for them, provide them information about that they should pass on to the to the hiring committee. And we would certainly look at that. So we would, we would read through those referrals and understand whether or not this is just somebody who happened to come across one of our employees and that's how I got referred or someone who worked directly with them. And if it works directly with them and they say relevant things, that makes a big difference. And I would say the biggest difference it makes is when you're on the border, when you're on the bubble. So if you are, you know, maybe you, you flood a couple of interviews. I think I think this is my, my situation. So when I applied, I, I've, I've phlebed a couple of the interviews, especially in the phone screen stage and I got a, I got to follow up. And I'm pretty sure I got to follow up because I had a referral from somebody that was in, in school with who worked directly with me. And so thank you. Thank you. Nathan, I appreciate it. Let's say I, I did relatively bad. Like I probably would not have passed, not not terrible, but it's pretty lukewarm from everyone in the room at best in the hiring committee. But my, my referral is the strongest referral you've ever seen from a VP. Let's say at their previous start up, I was their chief of staff and I was really organized and I did an excellent job. And then now they're VP at Facebook or something like that. And then that person comes in guns blazing. Would that type of referral make me pass in that case? So typically referrals are going to be helping you on that bubble. And this was saying earlier. So the, it's really about whether or not you're going to get a follow up interview. I have never seen a case where, where there's a general consensus that we should not hire this person. But yet the referral results in the beginning of hire. I think that may happen more at leadership levels where the kind of people that you bring from your previous jobs, that that could be very sensitive to that. And leadership hiring is a different whole different ball of wax. But on the engineering side, I've never seen a case where there's almost a, you know, unanimous consensus that we should not have this person. They don't meet the bar. And suddenly a like VP comes in and then is able to push the committee to hire them. I haven't seen that case. But I have seen the case where the VP will be able to or whoever it is will be able to push the committee into giving a follow up and maybe multiple follow ups. Right. And so I think that you, there is a, you still have to perform in the interviews as an engineer. But if you have reached like a senior manager or director level, I think that it is a little bit more about who you know, sometimes than, than your raw performance. I will say that a good hiring process is not like that. So good hiring process is one where you have identified what's successful, what makes people successful inside the organization. And then the hiring process is evaluating that and people are making a non bias decision. But I think that this level, the number of decision makers is smaller as you move up and more influenceable by, you know, by those around them. One thing that I think you can only really see with experience and you worked at metaphor for quite some time is I'm always curious, what is the, the correlation between someone's performance on interviews and their downstream performance at the company? And I know that you've been involved in hundreds of interviews and you've seen people go and enter the company. What would be that correlation? Like how often do you see that that person smashed interviews and they're doing excellent at the company? Or maybe they're off. So what we have looked at is not so much in the terms of the number of interviews that they succeeded or failed, but rather the confidence level. So the confidence level, we all oftentimes people would assess the interviewer's confidence level. You would put in a hiring decision, a level decision and like how confident you are that confidence decision does correlate with someone's future performance. And I think what that should go to show is that people, there is some sense that the interviewers are sort of applying to their, even though there's a rubric and they try to structure it as much as possible, there is this kind of kind of sense that they get from whether or not someone will be successful. And that is predictive of future success. And it makes sense, right? We, you know, if you've done hundreds of interviews as a calibrated person, you, you kind of know what good looks like. Maybe hard to define and you try to define as much as possible. It reduces bias when you do that, but ultimately sometimes it comes down to these kind of, you know, feel things. I will say that certainly there have been people who rock the interview and don't do well. And certainly people who are kind of rocky in the interviews and they do great. And I think that what that shows you is what we're talking about earlier. Interviewing is a skill. So it is not the same skill as doing a job. And unfortunately in the world we live in, you do need to spend some time getting good at the interviewing skill. We talked earlier about the rubric that those interviewers are trying to fill out. And I'm curious for the, the behavioral side of things. What does that rubric look like? So every company is a little different. A well run company, especially big companies. Oftentimes they hire PhDs in industrial psychology. They're called selection scientists. And what they have done is they've assessed, they've gone around your company. They've talked to different people. They've tried to understand what makes an engineer or whatever the role is very successful. And they've codified those things into a set of signal areas that they look for in the behavioral interview. So at meta, there's five of them. They are driving results, embracing ambiguity, resolving conflicts, growing continuously and communicating effectively. Every company is going to have different ones. They might purely just be the company values. And we can talk about that. But for example, at meta, those are not the five company values at meta. So you should definitely talk to the recruiter and as you're having, as you're preparing for the interview and get this rubric in advance, it's very important if you can get it or go on the internet, look for it. So these, you know, whatever, five to eight things. Generally, they fit into a broader set of categories that I talk about in the book that I call signal areas. And there's eight of them. And so when you're working on your stories and your preparation, you need to have this rubric in front of you as you're thinking about your stories. And then you're categorizing your stories based on these signal areas. And then what you're doing inside the interview is this decode select deliver loop. This is your core operating system when you're inside of a behavioral interview. When you're listening to a story, you're understanding decoding. What is it? Why is it? Why are you asking this question? What is it? What is it they're interested in? And it's probably one of these eight areas or something related to their, to their company values. And so if you can identify that, then you can select a story, which is appropriate and fits that, you know, delivers the kind of signal that the interviewer is looking for. And then you can deliver that in some kind of engaging way. And that's your core loop decode select deliver. So it is really important that you understand what these rubrics are. Oftentimes, a recruiter will give it to you. And at a smaller company, it's a lot harder. They may not have thought about this at all. They may not have structured their, their, you know, their behavioral interview process with any kind of rubric. So there, I think you rely on company values. You also rely on conversations with the recruiter. Usually at smaller places, you may have even talked to somebody on the team before you get to the behavioral interview. And I think you should ask them questions like what makes engineers successful in your company? What do you look for in the hiring process? And then take that and build your own little sense of what's valuable for that company and then use that as your, as you're going through your decode select deliver loop. That, that decode part is so important because, I mean, I've also been an interviewer for hundreds of interviews. I did a bunch of engineering management interviews as well. And it's interesting is a lot of candidates, I feel they would tell me something and I would, I'm looking for a signal. And I ask a very targeted question. I say, can you tell me about this? And then they don't, they don't get and they, they talk past it or they continue on their, their feel. I thought you're, you're missing opportunity. Help me, please help me fill this out. I'm, I got a blank spot here. I'm trying to fill out. I asked you the specific thing, but you're continuing on some rehearsing. It's, it's actually like a, a mutual exercise in helping fill out this rubric. So yeah, I think that's, that's so important to interview to what they're actually, and then you, your job as the candidate is to sort of tell the story from a perspective like, like you would build a trailer out of a movie different trailers, Robert Hamilton, a PM behavioral coach talks about this and he says, like, well, this, this movie is movie may have some action parts, may have some romance parts, right? And you can sort of remix the trailer in different ways to see what this movie is, right? And at the same way with these stories. So when you have a story, it may have a part about, it may make ambiguity. It may have a part about communication. It may have a part about a conflict resolution. And so you can take the same story. And in fact, you probably should take the same story. Like I said earlier, you should identify what are those core stories of stories you really want to get out and be able to build a movie trailer, which sort of fits the question that they're asking about. And you need to do that early, right? To your point. So you can't be that in three, five minutes in that then we're starting to get to the ambiguity part that the person asked about ambiguity. It needs to come up, up front in that initial context setting. And this is, this is the way that, you know, that you are internalizing you being a partner with the interviewer. I think people forget about that. That like you said, the interviewer is trying to accomplish a task, trying to evaluate you. You need to be a partner in that and you need to help the interviewer get to the signal that they're looking for. You mentioned tailoring your stories and your experience to the specific values of the company. I was thinking what might be interesting. We could go over some concrete examples, maybe with some hot companies right now, like OpenAI and Anthropic. I would be curious to hear what you see in their values and how you might mold stories to help people who are looking to get hired at these companies. The first thing I would encourage people to do is first understand your stories from the perspective of these eight core areas that I talk about because most company values can be boiled down into these eight different areas. We could talk about them at some point. But inevitably, especially for newer companies like AI companies, there's some part of their company values that don't fit within that. So for example, OpenAI has this one that's called Act With Humility. Really, what that means is growth. That's one of the eight areas. Do you respond well to feedback? Are you seeking to improve yourself, proving the people around you? That's how the same thing. But they do have one called Feel the AGI, which is not really one of my eight areas. So you'll need to understand what that means for them. And so what that means to them is that you are very optimistic and positive about what AGI and what AI could do for the world. Now, Anthropic has one called Hold Light and Shade. And really, what they're trying to assess there is that you can understand both the positive and the negative implications of AI in the future. And so for me, you need to understand what the cultural zeitgeist is of this company that you can assess via their company values and by researching them before you go in. So how much you do that? If you were telling a story about how you leveraged AI in the past to Anthropic, you would really want to mention how you thought about the potential negative implications of this project from an AI perspective. How did you go about mitigating those? How did you go about assessing those? And if they don't hear those things, they're not going to to feel comfortable about hiring you, hiring you. And likewise, on Open AI, if you are not somebody who's very AI forward and very much excited about about new domains that we can apply AI to, they're not going to be as interested in hiring you. So when you're reviewing your stories, you need to understand what every behavioral interviewer looks for. Those are those different, it was a different areas, things like ownership, handling, ambiguity, conflict resolution, the things that we do on a daily basis, but also mixing in what are those specific things that are unique to their company? We covered how to avoid getting downleveled. But I'm also curious before we leave that topic, what are the most common mistakes that people make in behavioral interviews that lead to worse results than they should have? Yeah, let's stay focused on senior engineers for a second because I think that they are slightly different. So the number one, what we talked about before, which is inappropriate choice of stories. So you didn't choose stories that fit the appropriate scope that you're targeting. So that's number one. I would say the another one is, usually as you're more senior, you're a better communicator. And so you might talk a lot. So this happens especially for manager loops. Oh yeah, let's be talking about this project. And then I'll use to talk, talk, talk, talk. So this sense of giving around too much context is really common. And the key there is something like you should only give the kind of context, which is required for me to understand the behaviors. Again, that's what I'm assessing you on is the behaviors that you've done in the past. And if you give me too much context as irrelevant for this, then then you're just you're just using your own airtime. You're wasting your time. And another guideline there is when you're talking, even if you are talking about the middle part of the project and what you did, if it's been like 30 seconds since you have told me something that you did, some kind of action, you know, someone a verb is coming into this conversation. If it's been that long, then you should rethink that. Like maybe I'm providing too much content with too much technical detail, too much backstory, too much aside, it's whatever it is. You need to keep the you know, keep the keep the action coming. Keep the work stories are just not that exciting. Okay, let's just be honest. Like, stranger things versus like me listening to a behavioral interview like I've rather watched stranger things, right? So I think people want to want to be they want to see action and movement in the story. So keep it keep it moving. Another one is really common for senior engineers is opening themselves up to uncharitable interpretations. And I call this one the opposite is thinking defensively. You need to think defensively. So in this in this kind of senior role, it's very risky to bring people on bring leaders on. They have a huge impact on the team. And so interviewers are very risk averse. So if you start presenting and telling stories like, well, you know, the code base had a lot of technical debt. So we decided to do X sounds like a great story, right? Hey, you're somebody who solves technical debt. But if you're the senior engineer in the room, then like, how did we get this technical debt? Right? It's your fault. Right? So I think this kind of how can my stories be interpreted as unfavorable is really important for you to consider. And the way around that is to make sure that you are compensating when you're telling that the context in the story. So it could be that like we were a startup. We needed to close, you know, our next round of funding. Therefore, we decided to take on this technical debt. And then it was our role to solve it. And I decided to prioritize it because XYZ. So here we are, giving some kind of thinking or backstory or judgment piece to how you ended up in this situation. We touched on it briefly before. But another one is is not talking enough about the non technical parts of the work that you do. Obviously technical parts super important need to establish yourself as somebody who can solve hard technical problems. But if you're a senior engineer or a staff engineer, principal engineer, a lot of what you do is working with people. How you mentor it, how you organized, how you delegated, how you influenced the roadmap, how you resolved conflicts, how you worked across teams, how you managed to operate. So those parts of the story are super important. Another thing is that oftentimes you're telling stories that are very long. Okay. So you're talking about, especially a principal engineer, their telling stories that are often multiple years or two, three years worth of refactors or some, you know, large product build in a new product space. So you need to have your stories well organized. And you need to understand what's really important for the listener out of that story. So I recommend people have some kind of table of contents at the very top, which requires you to understand what's important. So you could say something like, well, some business contacts and this is what I'm doing, this thing that I then you say, oh, yeah, they're like five interesting parts of the story. You know, how I initiated the idea with management, how I aligned the stakeholders on the technical approach, how I saw some difficult technical problems, and like how we did this very complex rollout over, you know, multiple multiple years, something like that. So now we also set the stage for the conversation. And then I can tell a longer story, keeping it organized in these different verticals. And it also gives me a way to come back to them. So if I'm a candidate and the interviewer is peppering me with follow up questions and they're interrupting me, which is super common for these senior engineers, senior senior interviews, then I can always come back to, oh, you know, remember that part? I was talking about the hard technical problems. Like, let me just go back to that. And then you can then you can bring the listener back to the most important parts. So that story organization pieces is super, super important for a senior, senior candidates. We did talk very much about choosing those stories. And I did say that the most important thing is scope, which I don't think is is is immediately apparent to most people who've thought about behavioral interviews. Oftentimes you would think, well, relevance is the number one thing. I have to tell a story, which fits the, the question that they're asking. And that that's very logical, right? But like I said earlier, the most important thing is that you get out of the behavioral interview having told the stories that showcase your impact the most. So scope is the number one thing when you're choosing a story. How can you fit a big scope story into the question that that is asked? Number two is relevance. Obviously you can't tell a story about, you know, some time when there wasn't very ambiguous if you're being asked about ambiguity. The third thing is is is is a recency. So of course, you know, newer stories are more important than older stories. But I would rather hear a large scope relevant story from a senior engineer versus someone that's very new. So a relevant recency is not the most important thing. And the guideline there is something like two to three years for sure is okay. Beyond three, four years, now you have to have a really good reason for telling that story. And of course, this scale increases as you get more senior. So if you have a 30 year career, then telling and your your applying for a principal role, then telling a story from 10 years ago, probably isn't that bad. And the last one is uniqueness, which is something people don't often think about. But how can I tell a story that I haven't told already? And this becomes super important for interviews where there are multiple behavioral rounds where you're likely to tell multiple, answer multiple, tell me about a time kind of questions. So maybe the question in the like project deep dive might not be the same story that you use when you're just asked about an ambiguous project in the general behavioral interview. So thinking about how you can balance uniqueness across the the portfolio of behavioral interviews that you're being given as a loop is important. And you said that scope is more important than relevance. Is it like, let's say I'm in a behavioral interview. I'm giving my stories and it's almost reminds me of a politician where they ask a question and I I have my rehearsed thing that's not exactly what they asked, but it's filling in the rubric. Is that you're saying that's best as opposed to say that is best. That's exactly what they say. So be like a politician, I guess, is unfortunately what I'm advocating that you do because I think that again, you want to to leave the interview having showcased the ways that you have delivered business value, solve problems, done the things you do as an engineer, the best. And if you just stay focused on answering their specific question, for example, like a question like what time about a time you had a conflict with a product manager, maybe you do have a story that you had a conflict with a product manager, but maybe the bigger story is a conflict with with the director of engineering or a conflict with your direct manager. So what I would do is I would try to pivot that that story into the one that is is larger. And they may they may constrain you, you know, they may come back to it and then you stuck telling this smaller story. But what I would do is I would showcase that you have this other story. So you can say something like I did have a conflict with a product manager and involved this in this. And I was able to overcome that conflict by compromising on this. You know, I could tell that story, but there is this other story that I could tell about how I I had to go through a longer conflict resolution experience where I had to collect data and I had to collect other people and we had to have multiple meetings about it. That might be a more interesting story. Can I tell that one? So you can pivot the conversation, focused on conflict resolution into a story that might fit better for what the interview is actually looking for. They may or may not really care about when you had a conflict with a product manager. They might just be collecting conflict resolution signal. - Let's say you're in the middle of the interview and you're trying to figure out, am I talking for too long, or is this person still with me, or should I am I saying the right things? How often should the interviewer be talking? How often should you be talking? - So there are different style of interviewers. So some interviewers really are listening. So I tend to be that kind of person where I would interested in what I think interested in what you think is interesting. So and I'm assessing you based on what you think is interesting and where you're taking me and I'm getting a lot of communication signal out of that. But some interviewers are not like that. They are, they interrupt you frequently. They look at, they wanna look at, pick out some part that you mentioned and like turn it over a couple times in their hand and then they can get back to you. So they may have a lot more follow up questions. They may interrupt you a lot more, or they may switch questions. They may collect a little bit of signal on this question and then like move rapidly to the other one. So I think you'll figure out which kind of interview you have pretty quickly in the interview and you should be emotionally prepared, especially for the second one. This person who interrupts you frequently can be kind of jarring for you and you can think, "Oh, I'm failing. "I'm not doing the right thing." But no, just getting an interviewer who likes to interrupt people and likes to bounce around. But to answer more specific your question, I think you can look for signs. So this is where you need to use your human part of your brain, not just your structure and organized part of your brain. But you need to assess like, are they looking at me? Are they taking notes? Are they any kind of indication that they're engaged? And if you notice some lack of engagement, then I would pause and ask them, "Is this what you're looking for? "This is what I was about to say. "Is that still relevant?" And give them this opportunity. A good interviewer is willing to interrupt you. A good interviewer, a calibrated interviewer, or someone who is confident what they're doing. They will be a little rude to you because they are looking, again, they are looking to acquire that signal and they are willing to go through a little bit of social awkwardness in order to acquire it. But some interviewers aren't that good. And so you need to make that easy for them to be able to stop you, which is why I recommend not talking for more than, you know, two to four minutes. If you're over, if you're talking for more than four minutes, five minutes, you gotta be really good at giving a monologue like that. It better be really interesting for the listener and you probably should know what you're doing if you're talking for that level of time. - When it comes to interview prep, I mean, a lot of what you said sounds like there's a difference between the levels. Senior engineers make different mistakes than junior engineers. And I imagine the weight of the behavioral interviews importance differs across the levels. Sounds like as you get higher up and higher up, they add extra behavioral interviews. So I'm thinking if someone was preparing for interviews across those high level buckets, how would you recommend they split up their interview prep time across coding system design and behavioral? - Most people are spending way too much time on coding and not enough time on system design and behavioral interviews because those are the more murky ones to prepare for. However, I will say that junior engineers, the most important signal is gonna be technical. So making sure that you nailed those coding interviews, mailing the system design interview. It's gonna be the most important. And then the behavioral interview, the key to focus on is you're thinking, your motivations, because you may not have a ton of accomplishments to lean on there, but you can lean on what you thought about or like what kind of ideas you had or things that you tried, maybe they didn't work. So those kinds of signals of what my future performance could be or my future impact is gonna be new super important for junior engineers. For mid-level engineers, I think you need a balance. I would say that AI is changing this game in the past. I think you could still focus even as a mid-level engineer only on the technical parts and just make sure that you didn't flood the behavioral. I don't think that world is existing anymore. Number one, there are so many candidates in the market with so many layoffs recently that you need to shine across all different interview types. And the second thing I would say is more and more of that technical work is being done by an agent coding experience. And so we are looking for mid-level engineers who can own problems into end. And how do you see that kind of ownership? You're gonna see that in the behavioral. We need mid-level engineers who are excited about growing and learning new things because the technology and the approach to engineering is changing so rapidly. And how are you gonna assess that? It's gonna be assessed in the behavioral interview. So I would balance more balance your time, right? The beginning part of the interview process that we talked about before is often some kind of coding assessment. So you need to get your coding interviewing practice in early, but once you get that onsite schedule or ideally even before that, some weeks before that, you have spent some time thinking about your behavioral questions. You've spent some time identifying the core stories from your passage you'd like to tell. You've looked at their values, you've looked at the rubric that you find for the behavioral interview. You've made sure that you have some stories that fit each one of those key areas that they're gonna be asking you about. And then once you get to senior and above, a lot of it's gonna come down to the behavioral interview. So like I said before, first thing I would do when I would look at it at a staff level packet is I would go to the behavioral interview. There just aren't that many different ways to design like a web crawler and a system design interview or aren't that many ways to solve to some and a coding interview such that I could see whether or not someone is a staff level or just a senior level. And I would go directly to the behavioral interview to see what the organizational impact is, what their level of influence is on others, how they resolve conflict. I would look to see what scope of projects they've been able to accomplish and what level of business impact they've been able to deliver. And that would be how I would determine whether or not they're really a staff engineer. And like you mentioned at that, super senior, like staff plus kind of percent principle at distinguished level, they're adding additional behavioral interviews and oftentimes are looking at specific things, things like how you work cross-functionally with partners. They may give you a PM for example, or another person from a cross-functional partner that will interview you and see how you work with others. Or they're gonna be wanting to get more information about one of your bigger stories, one of your bigger projects that they're gonna give you some kind of project deep dive interview where you walk them through some technical and organizational challenges she've solved in the past. And so those become the differentiators and the technical ones become kind of like checkmarks. Like you have to pass, you have to get over the bar, but really what's gonna get you hired is gonna be shining on those behavioral sides. So certainly a slide, I would say that most people under investing behavioral interview, so it's probably gonna take you at least a few weeks to perform well. And if you are at that staffer above, I would say start when you start doing your lead code. (laughs) Start thinking about those past stories, start working on how you position them, get some feedback, go do some mock interviews, at least with a friend, if not with a professional. And especially if you're gonna be applying for a fang or open-air and thrompe one of these big companies that's very in demand, I would try to find somebody who is calibrated at that company who can give you a mock interview and give you that squishy cultural sense that we were talking about earlier and reflect back to you whether or not you're hitting the right cultural notes. - When you were in hiring committees in the past for maybe more senior candidates, when you have a candidate who does okay on the technical sides, but really kills it on behavioral, is that the type of packet that could go through at the highest levels? - Certainly at the highest levels, definitely. If there's a place where you're gonna fluff a coding interview and be okay, I think that staff or principal level or manager level, those places where we just don't expect you to be doing as much day to day coding and so we would discount poor performances in those interviews for sure. I think it's much harder to do that at the junior levels. I will say that I had a candidate that I did the behavioral for and this candidate had not accomplished a ton in their career, the technical things were just okay, but I kept seeing glimpses of ideas that this candidate had, maybe they weren't able to execute on it. The manager didn't agree or they couldn't get it done in their organization, but they kept thinking about things and I said, "Now this person has so much like potential in this person's career that I pushed for that person to be hired and that person ended up being a staff person eventually." And I think that that was a good indication that there is a slope that we're trying to assess and the slope is often assessed there in that behavioral interview, even for junior folks. - We talked about some of the subjectivity in this type of interview and talking about how you talk about the scope of your work and all of those things that kind of help you with leveling conversation, but also another part of subjectivity is just how much does this person like you and their bias towards you based off of a lot of the soft influence you might have as you speak to them. So I'm curious how much influence do you think that has on the outcome of the interview? - It scales exactly with level. So with a more junior candidate, I think that, at least at a big company where they've spent some time structuring these behavioral interviews and they're trying to reduce this kind of, do I just want to have a beer? This person kind of vibe that they're collecting. They're trying to reduce that by structuring it and giving the interviewer some sort of form to fill out or some, clarifying what's important in the hiring decision. But as you get more senior, now they're expecting you to influence other people on the job. And that's how you come across in the meeting. Are you confident? Are you comfortable? Are you able to hold on to this kind of like casual excellence, right, which I think is very much a cultural quality that Silicon Valley has in particular. This idea that I can kind of show up and I look cool and I look not look cool, but I look calm. But yet I'm still very confident and can sharply to discuss things and deliver things. I think they are looking for that kind of signal. And. It's definitely subjective. And so I think your ability to connect with the interviewer in the first few minutes. If you come in and you're disheveled or you come in and you're nervous and you're not able to be present in the meeting, well, that's part of the signal they're quiet because you're gonna have to show up in the meetings and be put together and be confident and be able to stand in front of the CEO and deliver good news or bad news or ask some questions or whatever. And they are looking for somebody who will do a good job with that. And this is a high-pressure situation. And in an interview, you're gonna be in a high-pressure situation at work and they're assessing you there as well. So I think this is where you need to understand the cultural expectations of your companies that you're applying for. Different countries have different expectations around leadership and hierarchy and how they approach things. I think we're talking mostly about like a US-centered kind of Silicon Valley centered or associated places, Seattle, New York, those kinds of culture. And that place is one of, we need to be able to start the meeting with some kind of playful banter. And then we continue with like hard-hitting pieces, but sometimes I'm self-deprecating and I kind of pot out of that and we laugh out a few things, but then we're back in it and we're doing this like intense thing. So that's super common for those environments. Other countries, other companies, they may have different expectations. I think you need to understand what those are before we go in. - Let's say someone is if you're a staff engineer, they're not necessarily the most, they went described themselves as a people person, but they wanna come off strong in that interview. How would you reverse engineer, how to represent yourself strongly in terms of all those soft influence type of things? - So the first thing I say is that the inside always comes out of the outside. Okay, I know you don't wanna hear that, but the reality is what you believe about yourself, what you believe about others, really changes how you present yourself. So the first thing I would say is, it is not just some like list of things that we need to do or a checkbox stuff that you kind of put on. It's not a mask that you put on. You need to change your internal beliefs. And Sam Lesson has this book he just released about a Silicon Valley etiquette. And he did this podcast recently where he talks about the importance of lowering your own heart rate before you go into the conversation. So yes, this might be your like one and only shot at this job. It's possible. Oftentimes that's less the case than most candidates believe. So sometimes we think like, oh, this is my one shot at getting this company. Well, if the company's gonna be around it for a while, you probably have other shots. So don't put so much pressure on yourself. I know it's hard, but that is the reality. You need to tell yourself, give yourself an internal belief structure that makes it okay for you to make mistakes in this environment. You will come across a lot more calm. The second thing I say is try to understand what and be empathetic of the other person. So again, this is an internal thing. Believe that the other person is looking for a great engineer, a great manager, whatever it is, whatever the role that you're applying for. They're looking for somebody who's gonna do really awesome. They really want to find that person. They're spending their time interviewing you. They really want to find somebody who's great. And they're not just looking to nitpick you and like throw you out and binge-g you, right? So I think this kind of internal belief where you believe, you know, this person is not my enemy. This person is a human doing their job. I would love to do my job alongside this person. Let's have this great conversation. So that's the first thing. You have to start on the inside. If we are looking for other things than I would say how you show up physically. So what you're wearing, go that like one notch above. That's classic interview advice. What's in your background? So we know how does your room appear when you're doing a video call especially? How are you expressing care and interest in the person in the first few minutes of the meeting? So if you come in and you're just waiting for the person to say something, this is a very, you're taking a very passive role and you're showcasing that, you know, maybe you're not ready for these kinds of more active roles where I need you to build relationships with other people. Show me that you can be, you may not be like the most extroverted person, but you probably do value people in some way. People are probably important to you. You know, your mom is important to you, maybe here. Significat of this important, their people are important to you. And so let that come across in that first few minutes. Hi, how are you? I'm doing good, you know, or I'm interested in, and I'm like excited to be here, right? You can express enthusiasm even if you're, you know, not the most extroverted person. So those first few moments, the brain is really looking at that, like kind of just figuring out, it's just the kind of person I want to be with and you're making a lot of split second decisions. And so how you show up in those first few minutes are important. Practice that. Practice that with your mock interviewers. I don't just jump right into the questions. Practice that kind of, you know, early, early part, make the other person feel comfortable. Sometimes the interviewer is nervous too. Actually giving a behavioral interview is quite complicated, quite difficult, I would say. It is hard to engage the person in some meaningful way, ask relevant follow-up questions, but making sure that you're collecting the information that you want to collect, also making them feel comfortable so that they give you the best signal. Also, the behavioral interviewer is sometimes a hiring manager or some kind of leader in the organization. And so how they are coming across in the meeting is affecting the candidates perception of the company and perception of the team. So, you know, have some empathy for that person who's given this behavioral interview. Make them feel comfortable, make them feel like you're, you're at ease. How you do that? Is by changing first what you believe about the situation. Who do you think would perform better on average in a behavioral interview? Someone who is extremely curt and cold, but excellent. Everything you ask them, they give you the right words, really concisely great stories, but they're very, they're not there to be your friend. They're kind of cold and they're silent and they wait till you ask a question, follow-up questions, they say, no follow-up questions. Okay, thank you for your time. Or someone who's very warm and bubbly and, oh, how's your day? Okay, let's get into this. I hope I do well and they kind of build some rapport with you. And then they do so, so, on the actual stories themselves, across the body of people who conduct behavioral interviews, which one do you think would do better on average? Well, that's the key. Who conducts the interview? So if I'm conducting the interview, the second person will probably be doing better because I like to engage, or you might have noticed that, I want to get those more people's sides. So this is where when you say building rapport, building rapport doesn't mean that you're bubbly. Building rapport means that you are connected to the other person. So you need to understand in that first few minutes, like, who kind of person is this? Is this a person who wants to be more business-like and wants to assess things in a more cold and calculating way? Fine, that's okay. Or is this person, somebody who will kind of chop it up with me in the first few minutes? So I think you should start on a positive note. I think you should start energetic. You should start believing that with some excitement, showing excitement to be there, but respond to the other person and how they present themselves. They may, for example, if this is someone who doesn't even ask you for introduction, doesn't even ask you for, tell me about yourself. They may jump into, tell me about a time when you had an ambiguous problem. Well, you know exactly who you're getting now. And somebody who just wants to go down the list and bang out the signal and be very efficient. And so you need to match that and be very efficient with what you say. But if the person starts two or three minutes of whether sports, you know, high feeling, how's the rest of the interview is going? Like, you know you have a different kind of person that you're talking to. And so you need to match their energy. When it comes to these subjective parts of the interview experience, what do you think is more important? The first impression or the last impression? Do we have to choose? Like, why do we have to choose? So let's do, let's knock it out on the beginning and the end. But if I'm forced to choose, I would say the beginning. I think most of the time I am making a decision within the first 10, 15 minutes of the interview about whether I'm going to hire the person. And it's because I have been asking, usually my biggest scope questions, telling about your favorite project, telling about your most ambiguous project, telling about something that you're really proud of. And then I'm seeing what they're saying. And if I would like to have that kind of performance replicated in my organization, then the rest of the interview is more like, let me check the other things. Let me check conflict resolution, let me check growth. Let me make sure that this person is going to be successful. But ultimately, I would love for them to replicate their past success in my organization. So if I had to pick one, I would pick the beginning. But you can rock the end. Why not? And the most important way to rock the end is to have relevant questions for the interviewer. And people oftentimes forget about this in their behavioral interview prep. They spend all the time talking about their stories and they're really excited about telling answering questions. But then when it comes to a question that questions they have for the interviewer, they come up with something like, tell me about a day in a life of the day of life and the interviewer is pretty much the same across the company. OK, you know, it's like, hey, we're going to get up. We're going to do some work, go to meetings. It's just not that interesting of a question. So I think if you've thought deeply about the team, about the organization, about the product, about the company, and then you have some question, which is helping you decide whether or not you want to work there, the interviewer is assessing you on that even. And so you can leave the impression that you are engaged in the process. You're excited about the role. You're really evaluating whether it's right for you. That's a great way to leave the conversation. What percent of these interviews? Because you mentioned the first impressions, more important if you had to make the call. What percent of interviews do you think the result is decided within the first 20% of the interview? Yeah, so lots of social sciences have been applied here. I've not seen any social science applied directly to tech interviews. And sometimes you cannot apply, like cross apply, interviewing at a fast food company, too, interviewing at a tech company. But the research says something like, in the first 15%, the first 10 minutes of the interview, most maybe like 40% of the decisions has already been made. And I would say that that happens for sure in our experience as well as in engineering. Again, it's rare that I don't want to hire you in the first 20% of the interview. first 10, 15 minutes, and then suddenly you say something at like minute 38 that's making me, "Oh, I forgot to change my mind." I think it is common for me not to know, right? So for me to kind of feel like, "I'm not sure, let me think about it." And then when I go back and I would write the notes down, I would consider them according to the rubric, which is the goal of the rubric, right? Is to shift our decision making out of this initial gut response and into something which is more cerebral left brain. And there would be times when I was not sure and then I would make a decision later. But if I've made a decision in the first 10 minutes, it's pretty hard for you to overcome that. And most of the time it's because you're choosing the wrong stories. Or I can clearly tell that you just, you have not done work at the level that we're expecting for this company. Or you can't communicate very well. So like you can't tell stories very well. And that's giving me, for one thing, usually means I can't collect enough relevant signal to on the other axes to hire you. But also I know that if I hire you into my organization, like you're not going to be a very good communicator. I guess a lot of people, I've experienced this as well too, where you're in the interview and it's not going so hot and then halfway you realize they're zoning out because they've already decided that you're not getting hired. So that first half is so important. Another interesting thing I want to fall upon is it sounds like that last few minutes of the interview where they say, Hey, do you have any questions for me? This sounds like a not evaluative part of the interview, but it actually is. And you should continue to sell yourself by saying, Hey, I ask questions that matter that are important. I am aware of the things that are important and I'm asking about those. So what are good follow up questions to ask to make sure that you get the most out of that section? Yeah. So one of the themes here on our conversations, everything is evaluative. So the early conversation with the recruiters evaluative, the end of the behavioral interview is evaluative, the like hangout chat with the hiring managers evaluate everything is evaluative. And I think that makes sense. That's part of life. But yes, definitely. So I think first off, you should understand what's important to you. So what do you are you concerned about the like long term product prospects of this company? If that's concerning to you, why don't you ask about that? If it's, if what's important to you is career growth and a manager that's going to be supportive of your promotion and you're talking to the hiring manager, let's see, then I would ask about that. Tell me about a time when you tell me a story about how you help somebody grow from my level to the next level, right? So that's the story that you want to hear. Understand what's important to you and it could be about the technology. Although I think that those tend to be a little bit more than junior side of somebody's asking me about what kind of stack we use or how to overcome this particular technical problem. To me, that feels a little bit more junior, although if maybe in an AI context that might not be, so you could ask a question about in a model construction or evaluation or something like that, that could be really important for you to join the company. You could ask about the role. So oftentimes the one that I really like would be something like tell me about what makes this role really successful, like someone in this role really successful. And you can get us a lot of signal on how to be successful in the company once you get there and showcase to the interviewer that you're interested in being successful by asking a question like that. I mentioned company ones and manage your ones. So I think those are your categories for choosing one, some kind of insightful question. But I wouldn't approach it as in like how can I impress the person with a deep question? I would approach it more like what's important to me. And then that will come across as a deep question to the person that you're talking to. But I would avoid certain things that might be important to you. Some questions like I tell you about the conversation of this role, right? That's not a conversation that you have with the behavioral interviewer or like how is the free food? These things might be important to you, but like this is not the time to talk about those things. I think you need to be more related to something that the hiring manager also or the interviewer also cares about. One last thing I think on behavioral interviews. We did a lot of stuff on behavioral here is there's this idea of storytelling that kind of unifies everything. If you can storytelling well, you're going to do well in your behavioral. You're going to do well when you're advocating for yourself actually on the job. So I want to get your thoughts on how to tell stories well. What are the most common ways to get the most benefit with the least amount of time? Yeah. So a story has to have an arc, has to have some in the beginning, middle, and it needs to give the person whatever the story listener is looking for. Maybe in some kind of novel, we're looking for entertainment and we're looking for something like deeper meaning about life. In a behavioral interview, I'm looking to see if you are demonstrating past behaviors which are repeatable in that organization that I'm hiring you into, which align with the signal areas. So that's the goal. So let's just remind ourselves that you have an sort of arc and it needs to deliver this signal area. There's a couple of different frameworks people have talked about in the past for shortcuts for how we can get to this. And the most common moment is star, right? Situation, task, action, result. If you've looked up anything about behavioral interviews, you've definitely seen the star method. If you, I will begin by saying I don't love the star method. However, if you have an interview tomorrow and you have a bunch of star stories that you prepared, go for it. That's great. It'll give you that arc. It'll showcase those actions. It will book in the actions you have with some kind of context, understand them, and then some kind of impact or results that they can understand why you did the things that you did. I prefer one called Carl, which is context actions results learnings. I don't think the difference between a situation and a task is like super relevant when you're telling a story. Oftentimes stories just have context like what's going on in the business? What's happening on the team? Why I got this project in the first place. So I think trying to, you as a preparer, trying to figure out like what's the situation here? And then I'm going to move into the task. There's a task on like a two year project, where there's like many, many, many tasks really wish you're attached to the actions. So I think that thinking in terms of just context and jumping into the actions is super relevant. And then I think for senior engineers, the star doesn't provide any kind of space for reflection or any kind of space for judgment or learnings. And that's why I like adding learnings to the end of every story. Especially for senior engineers, I'm looking to see whether or not you can look at your past experience. Understand what made you successful or unsuccessful and then apply that going forward. So this gives you a nice and easy, pneumonic to remember to add those things to your stories. But I also think that when you're telling stories, you need to be cognizant of where you are in the interview. And I think this is another differentiator between junior interview and junior candidates and senior candidates. A senior candidate is managing the time. So they understand that, hey, when I ask some kind of big, I call it trunk question, trunk branch leaf. And I think the question, which is like time, but project that was really ambiguous, then you're giving, you're being given a carte blanche by the interviewer to tell a longer story. So you tell a longer story. But then if I ask something about like, well, who did you talk to in order to get this piece of information, then to do some action as part of the story, then now I'm asking some kind of like middle rounds. Maybe I probably have some thought about who I talked to and how I talked to them. It's a communication signal, right? So I should give them something. But I shouldn't give them like a complete star or Carl's story at that level. And sometimes I just want like some very specific information like, like tell me about the framework that you used for this particular project. Okay, they're just kind of like checking off a box, right? So I just want to understand a little bit of context I didn't have before. And so that's a leaf question. Just give them the answer and move on. So I think your ability to detect what kind of question, how long the interviewer wants to listen to a response is going to be an indicator of seniority and also like an important skill for you managing the interview. For storytelling, what do you think is more important? What you say or how you say it. So for instance, is it the actual words that are coming out of my mouth that makes the biggest difference or is it my presence, how confident I am? And is there one versus the other that you'd say people should really focus on to really nail their stories? Engineers tend to be pretty structured people. Engineering interviews tend to be very structured. Even in smaller places, someone will at least perceive that they're structuring the interview in some kind of rational way. And so I think it is less about how you say it and is more about what you say. So even if you came across confident and positive and encouraging and like some of that I would love to work with, but if somehow I did not hear that you were handling ambiguity in some kind of structured way or that you were applying some kind of conflict resolution framework to the conflicts that you had, then I'm that interview is not going to go well and I'm not going to be able to support hiring you. So I do think that it really does come down to substance. I think that's the most important thing. Form follows function in most engineering environments. And I think that it is the case here as well. However, I would say at more senior levels than how you come across and how you tell the story does make a lot more impact. Because we are expecting you to be telling stories like this one, for example, when the VP says, how's that project going in the status meeting? You need to be able to tell like an engaging and entertaining, or as much as entertaining as any work thing is, entertaining story about how the project is going. And so I am looking to see if you are providing interesting details, for example, like a detail that might be a showcase something that some thinking that you did or some unique situation that you were in. Sometimes, whether to include details is a big part of what you are going through as a behavioral interviewer. So you should only include details which help to accomplish some tasks. So maybe the task is that I want to showcase some deeply technical. I want to include a few details like that. Maybe the task right now for me as the candidate is to showcase that I am somebody who can work across teams So I want to include the the part about how the other tech lead had a bad, you know had a mean look on his face When I went to talk about this thing maybe that detail is relevant right because it showcases how I push through difficulty and push back on on other teams so Yes, I think those things are relevant. I think most candidates probably need to spend more of their time on basic Story structure basic identification of what actions they did that are repeatable You know, I wanted to ask you about your senior your your promotion to M2 at meta Actually, you've you've told me so much about how to speak about scope at this point Maybe you could you could tell me or tell the audience how you got promoted to M2 Why you got promoted to M2 and speak about it in a way that illustrates the scope of a senior manager noted to get to M2 I had to solve some difficult problems in the recruiting space and The probably the most important one was around diversity So I I left a team which was focused on building things for teenagers Which is another hard problem that I got myself involved in very difficult time for Facebook during that time But I left that team to lead a couple of teams within their internal recruiting products organization which is all about supporting candidates supporting recruiters and sorcerers and their goals and But the thing that really drew me over there was working on supporting a team that was hiring more diverse engineers That were meant a lot to me So how can I help make the world a better place as in my position as a manager would be to make what is the most The largest wealth opportunity in the world today which was technology and is technology How can I make that available to more people in the world? That's only motivating me so I that is not easy problem itself It's not a definitely easy problem itself from a perspective of a Product team right I'm not an education institution right I don't get to make all hiring decisions for example I don't get to pick you know what people learn in school so But we were able to move the needle there by improving Preparation of all things like interview preparation and that's how we were able to help improve the diversity hiring for for meta and That as well as supporting a number of other teams helping to establish a high quality of candidate data that would be Established for for Facebook's applicant tracking system and being able to You know clarify like what's important in type in terms of candidate data and being able to improve the quality that we have significantly over time. I think that's those are the reasons why I was promoted to him too So when I when I think I hear that story I just heard as if I was an interviewer I Heard that you were supporting multiple teams. I heard that you were taking on a an ambiguous problem Like how do you solve diversity? It's not immediately obvious and it sounds like you had a significant self-motivation to go towards this problem space and solve for the company so am I hearing that those are the the signals that you hope that an Interviewer would have got if you were interviewing for a behavioral interview Yeah, for sure. I would say I would add a few more other ones So one thing that that I didn't mention is impact across the company So I think leading leading the iOS and Android recruiting pipelines is an important way that you're scaling yourself and Applying yourself across more than than just the teams that you're directly responsible for so that was also a big part I should have included that I understand you left big tech at this point and You know looking back on your experience in big tech is there anything that you regret or anything that you wish you could have changed? I don't regret leaving. I think I had a really great time. I work with a lot of wonderful people I think that I regret The anxiety that I put into the teams and the anxiety that I put into myself I think we can all look back on parts of our life whether it's school or early career or even now And we think well, I really wish I hadn't worried about that at the end of our lives. We don't say things like I wish I had just gotten a few more percent out of that engagement number and that project xyz like nobody thinks like way right people value relationships They value connection And I think that I added a lot of anxiety to my life in various parts of my career and I regret that part I think that like I told you earlier I made conscious choices to optimize for my life experience versus my career I think there were times which when I was not honest with myself about that when I was not honest about what that that trade-off would mean in terms of compensation or in terms of career progression Or in terms of status for myself and I think being honest with yourself about what you really value and being okay with the trade-offs in advance and Since I've left big tech and supporting my wife is she's building her her her business Certainly that has come with like a decrease in pay and one of the things one of the ways that I have been able to apply the learning that I'm telling you is before I left I knew okay. I'm Pays going cash flow is gonna be low I'm gonna be okay with that because I'm making decisions to spend more time with my kids because I'm making decisions to support more community Organizations here and volunteering and I'm gonna be okay with that that choice and that's been really helpful I've been able to go back to that choice a number of times when the cash flow situation has You know, maybe wanted to improve that Maybe we missed that that kind of paycheck And maybe you'll experience this I don't know you know having just having just left big tech But I think having that honest conversation with myself has really helped in the last couple of years And I wish I had had had done that earlier and said you know what I really value are these things And that means I'm not gonna have those other things in life and that's that's okay If that's what you want right So making that kind of conscious and values driven decision and then coming back to it Maybe sometimes revisiting it. Maybe you want to change it But that kind of intentionality is something I wish I had was more honest with myself about So when you're saying you were you were not honest you Still thought you wanted that cash flow in those things. I think I was frustrated I think I was frustrated at various points about about not being able to progress And I think that there was I would even say bitterness at times when I would say I'm frustrated that so and so got this job So and so got promoted you know so and so was able to do the xyz right here look at me You know, I'm doing this I'm doing that But not being honest with myself of you know what you you didn't do the things that they did You did not move teams as a rapidly as they did you did not work as hard as that person You prioritize other things in your life you prioritize your family you prioritize and making an impact in In the community around you outside of work and And that has consequences right so I think we can live in this world where we think You can have it all right like you can you can be a whatever level seven I see and go home at five o'clock right and have a wonderful and engaging family life and maybe some people can do that Right, I think that that could be a skill that people have But that depends a lot on on your your talent level and what kind of skills you built up over time And but the reality for most people is that um if you want to accomplish something Extraordinary in your life you have to have extra you have to take extraordinary steps And I don't think I was honest with myself and I think that that resulted in some frustration and bitterness along the way But I think that once I decided Kind of in the middle what's important to me where I really want to be What I want my kids to say about me in 10 years that was what really what guided me What I want what I want them to remember about me 10 15 years ago now That was very clarifying and very helpful that intentionality Got rid of those feelings for you Well, I think that it comes back sometimes So especially living in a place like this where people are are stacking wealth in in in as fast as they possibly can And um you're going to see people like that around you all the time living in Silicon Valley And so you have to to ask yourself like is that what I want? No, maybe it is that's fine. Maybe it's not And then so it's going to come up and it comes up in my life You know on a on a semi regular basis, but it's really helpful to be aligned with your own values and have that kind of Mission statement or vision that you have for your life and what's important to you in the future And if you live like that you'll be satisfied You worked a long time at meta across other companies as well and I'm curious what was the best advice that you ever received in your career? I would say that the best advice that I ever received was the importance of Creating scope so if you would like to get promoted or if you would like to To you know to advance in your career oftentimes we are waiting like we're waiting for somebody to give us that opportunity and um, I remember one of my managers said like if you want this you know m2 role you have to create an m2 scope Scope team right you have to to accomplish and solve problems that are You know that are that are of this scope and I so I think that this this kind of honest Reflection on like what it really takes to get to the next level that you have to change Not just how what you do right? That's often advice to hear and not just doing the same thing that you're doing is your level better You have to do something different But what is that difference and really that difference is about creating additional scope and um Creating space for the the organization to succeed That was another key part of that advice was You know, what is your VP saying about your project and if your VP is not going to be talking to any of their peers or their manager About what you're doing then the question is am I doing the right thing? So what can what kind of kind of how can I work backwards right and we do this a lot We work backwards in the behavior interview What do I want to present kind of signal to area to represent you work backwards in a promotional experience What do I want the packet to be like and I think you can work backwards in terms of Creating scope, which is what do I want the you know the VP or the organization's leadership to say about what we've Accomplished and then go and figure out a way to do that thing Yeah, that's that's great advice. I mean there's there's always Situation and lock when it comes to career growth and promos, but I feel like the most satisfying promotions are the ones where you take initiative and you create the scope and no one could stop you in that case, so it's you don't need anyone's permission. And then the last question I'd ask is if you look back on your entire career and right when you graduated college and you could give yourself some advice now that you've learned what you've learned, what would you say? I had a lot of impostor syndrome, so I avoided, for example, I got a PhD out of a computer science, out of undergraduate school, but during the summers I would work just in the research in the university when a lot of my peers would go and work in industry, they would go get a like an internship, right, a Google or Facebook or whatever and work there. And really what helped me back was insecurity. I didn't want to go through the interview process. I didn't want to be rejected. And so I think that kind of fear and allowing the impostor syndrome that I felt to hold me back from those choices. I do think that had a my career was great. I love my career. It's great. I'm not sure I would change a ton, but I think it did help me back. I think I was slower to understand how big organizations operate. I was slower to understand how large code bases operate, certainly coming from academia. So I think that that kind of insecurity and fear really helped me back. I know that's super common kind of advice to give oneself in the past is like don't give into fear. But that's the biggest advice I would tell myself is don't give into fear. Awesome. Well, thank you so much Austin for your time. I really appreciate it. And I hope it's helpful for people. Yeah. Thanks, Ryan. Good to be here. Thank you for listening to the podcast. It's a passion project of mine that I've really enjoyed building. Another passion project that I've been working on kind of in secret is building an ergonomic keyboard that I wish existed and I finally have a prototype. So I'd love to show you what we've built. It's ultra low profile and ergonomic and I couldn't find anything like it on the market. So that's why we built it. I'll put a link to the keyboard in the description. You can take a look and learn more about the project there. We could definitely use your support. Also, if you have any feedback from me about the show, I'd love to hear it. Comments on YouTube have led to guests coming on like Ilya Gregorik and David Fowler. I wasn't aware of them until someone dropped a comment. Also, feedback in the comments helped me learn to reduce the number of cliffhangers in the intros. So your comments definitely make a difference. Please keep letting me know what you'd like to see more of in the show and I'll see you in the next episode.

Podcast Summary

Key Points:

  1. Behavioral interviews are critical for leveling decisions, especially for senior engineers, as they assess scope, influence, and organizational impact.
  2. The hiring process involves multiple stages
  3. Leveling is influenced by past titles and experience, but companies account for "level inflation" and may downlevel candidates from non-FAANG or business-focused firms.
  4. Lying about experience is difficult due to follow-up questions and multiple interviews with calibrated senior engineers, though not impossible.
  5. Effective behavioral storytelling requires demonstrating technical depth, organizational complexity, and measurable business impact, similar to promotion criteria.

Summary:

The transcription details insights from a Meta hiring committee member on the behind-the-scenes hiring process, emphasizing the importance of behavioral interviews for leveling decisions, particularly for senior engineers. " For senior roles like staff engineers, onsite interviews include multiple system design assessments. Behavioral interviews are crucial for evaluating a candidate's scope, influence, and organizational impact, with committees looking for evidence of large-scale project leadership and measurable business value.

While lying about experience is theoretically possible, it is challenging due to rigorous follow-ups and multiple interviews with experienced evaluators. Effective preparation involves crafting concise stories that highlight technical depth, complexity, and impact, skills that also aid in career advancement. The overall process involves recruiters, hiring committees, and engineering directors, with committees advocating for candidates during final decisions.

FAQs

Behavioral interviews are a key signal in hiring committees, especially for senior engineers, as they assess scope, influence, communication, and organizational impact. They often determine whether a candidate gets down-leveled or hired at a higher level.

Initial leveling is often based on years of experience and previous titles, but recruiters adjust for level inflation across companies. Candidates from non-FAANG or business-oriented firms may be down-leveled significantly to align with internal standards.

Staff candidates typically undergo two system design interviews, along with behavioral and technical assessments. The process involves multiple stages, including recruiter screening, phone screens, on-site interviews, and committee reviews to confirm level and fit.

While theoretically possible, lying is very challenging due to follow-up questions, calibrated interviewers, and the need for consistent, convincing stories across multiple interviews. Most candidates struggle to fabricate credible details about complex projects.

Candidates should highlight the scope, complexity, and business impact of their work, including technical depth, organizational influence, and measurable results. Practicing a crisp 'tell me about yourself' narrative is crucial for setting the right leveling expectations.

Referrals can play a significant role, especially in getting initial attention from recruiters. They help candidates pass early filters, but the interview process still rigorously assesses skills and experience through multiple stages.

Chat with AI

Loading...

Pro features

Go deeper with this episode

Unlock creator-grade tools that turn any transcript into show notes and subtitle files.