Yev Marusenko - How I Grow Viral Apps to 1M+ Downloads (just copy me)
38m 55s
Yev, the head of growth at Edtech app Sizzle, shares insights on building a scalable growth engine by finding tipping points and optimizing drop-off points in the user journey. He emphasizes the balance between organic and paid marketing strategies, leveraging ads strategically to amplify organic content. Yev stresses the significance of analyzing creative elements, as they have a substantial impact on growth. By experimenting with various content and amplifying successful organic pieces with paid ads, businesses can identify high-converting creatives. Yev's approach involves focusing on directional patterns rather than best practices of data science to achieve significant growth multipliers. The key lies in understanding the nuances between transitioning from paid to organic strategies and vice versa, ultimately leading to successful growth outcomes.
Transcription
8714 Words, 47851 Characters
Today I talked to Yev, who I believe is one of the best growth hackers I've met in a while.
He's currently the head of growth at an Edtech app called Sizzle.
And before that, he got into some really interesting stuff with YouTube shorts getting
billions of views for faceless channels. And in this video, we just go really deep into the tactics
and strategies of how to build a growth engine. And also, he gives some pretty interesting
takes on how to balance organic and paid marketing for mobile apps. So by the end of this interview,
we're going to know exactly how to build a growth system that is scalable and balance a lot
of these interesting tactics. So yeah, Sizzle AI has been growing super fast. Can you give us the
22nd version of what does the app do and who it's for? Yeah, Sizzle AI, it's a learning app.
It started over a year ago before all the hype of a lot of learning apps, study apps, and they're
actually learning science behind it. So I think we find this balance of not just revenue and growth,
but actual learning happening for anyone that wants to learn like student and prep, but any type of
learning topic and it's tailored to the learner. That's awesome. So by the time we finish this episode,
what kind of playbook or insight will people be walking away with? On the growth side, I'm focused on
finding these tipping points. So anytime you hear a growth hack, most of the time it won't work,
but what I'm trying to do is find these low-hanging fruits in all areas of the business on marketing
growth product and you realize there's tipping points, meaning these thresholds of low-hanging fruit
you do, and then at some point a growth hack like pops viral. So it's going to be this takeaway,
like where do you shift attention and your strategy to find these moments where you're getting close to
conversion, actually increasing, drop-outs decreasing. So it's these tipping points that I'm looking for.
So before Sizzle even started getting some serious traction, what were your first signs
that you saw that this probably has some potential? This is when you're looking at particular
pathways of the user journey. There's a lot of noise out there, but certain ones are highly
converting or lower drop-offs. So you know you're on to something because your product actually
solves the problem, but then the product is like never good enough. You need kind of like the growth
and virality and kind of amplifying what's working, but it's seeing these moments of hundreds of
journeys of the user taking, but some of them are actually having the lower drop-off. So you know,
you're on to something there. How'd you get like the first thousand users? Are there any weird hacks,
or do things that don't scale type of tactics that you did? Initially, this is hard to recommend,
but I'm doing everything on the growth side. Our founder is X Facebook, VP of AI, kind of just doing
announcement help. So it's not something we're going to give a growth hack of like starting exactly
from scratch, but that's where connections and PR start coming in. Gotcha. Okay. What has been
the biggest thing that you really think has made Sizzle grow at its fastest peak rate? One of the
growth levers is within this area of identifying every step of the funnel and seeing where the drop-offs
are the biggest and addressing those. So it's that clarity of identifying from the top of the funnel,
from the weather's organic content or paid into the app and then using the app, you have to see where
the drop-up is the highest. So as soon as we shift it focus knowing on there's over 50% drop-off here
when we improve that we see these two X to three X growth moments. As opposed to there's like these
moments of within the product you're trying to optimize ad features, but it's just these 10% improvements.
I think you're asking for like growth strategies like we'll get to those and it's actually not that.
That's like very experimentive on types of ads to run types of organic content and doing things on
meta side versus tick talk that have these big growth levers for scale, but I would say it's on the
conversion side. It's actually finding where your biggest drop-offs are and solving them and all
of a sudden you just two X, three X, how many people make it to the next stage. So we could go deeper
into like those moments within the paywall, within the onboarding. So I would say it's though it's
identifying where you have the biggest drop-off and focusing in on that. Like every team member is
thinking about what to optimize within that from different perspective of their expertise of
really dialing in that area. That's where you see just the biggest growth levers which you can
accomplish within a week as opposed to like a monthly quarterly goal where you making incremental
improvements over time. Yeah, I love the scientific approach to growth. It's just like being super
analytical about every single step of the funnel like where can we optimize this? I think we should go
super deep into that. Maybe first could you just tell us like what's the breakdown of organic versus
paid? Do you do a lot of organic stuff? And like I think everyone's trying to go viral and take
talk right now. Maybe you could talk a little bit about the organic side and what you guys do there.
Yeah, it's definitely a balance. So it's kind of like there's this tricky moment of wanting the
answer if it's organic or paid, but what I found out is knowing when to switch across the two
and knowing how to leverage each one. So that is the advantage where I would say like the paid is
easier to pull levers because you're like at budget and then you kind of see growth or not. So
that's kind of an easier one and out or on organic. There's a lot more things to test. Just a lot
more of how you're approaching the influencers, the creatives, which platform you're doing it on.
So what I found is when you get traction in organic certain posts or certain creators most of
the time you then go on to try to replicate that more, but what I found is kind of taking a step
back and it's kind of like this tipping point is now knowing which ones to amplify with ads. So it's
finding this balance. So it's actually doing both. Like we can get kind of into the percentages of each
and it's more on the ad side because we're using it to optimize parts of the final. So it's not just
paid ads to grow. It's like this very strategic insertion of an ad to find what headline works the
best and then we put it in a particular part of the ad. So it's leveraging ads in different ways
and actually it was interesting to break down on how paid ads are used versus on organic. There's
the virality, but that's to actually have stronger distribution across different creators and kind of
more like an engine of content being created and actually getting installs and purchases. That's the
goal of organic. But then when paid kind of has different levers within that one of them is to
amplify the organic to test organic more. And sometimes you kind of have organic content that
it doesn't go viral. Like it just gets like hundreds or views or maybe just like on the low
thousands of views and you think it's not working compared to the ones that have like hundreds of
thousands or millions of views. But there's like these wild cars where just like something in the
algorithm like you put it on TikTok and it just like doesn't go viral. But it may have been like
the timing or just something that you posted wrong. But we always kind of have the ignition with paid
ads to give it bigger of a lift to see if it actually converts or not. So it's finding those moments
knowing how to amplify organic with paid. I would say that's where I found biggest levers as
opposed to like just organic or paid because I'm seeing the differences is like well if you have like
extra budget depending where like your funding is coming from or how much profit is coming in that
decides on someone is mostly doing paid or someone's doing mostly organic because they don't have
the luxury of experimenting quicker or more with paid ads. So I'm kind of like in that position of
being able to like do both and find like the synergy across them. I feel like this is a huge alpha.
I don't think anyone really is doing this right now where they're thinking about the nuances
between transitioning from paid to organic and organic to paid. The classic playbook is like let's
blow up on TikTok and then we'll just run ads with those ad creatives. But what you're saying is like
there's a whole system that helps each side like compliment each other a lot more. I would love to
just dig into that like I feel like the editors could also put together like a diagram that kind of
shows all the connections between this but like looking into the process of how you think about
that that would be really interesting. Here's an example where well there's like different platforms
or strategies of trying to get organic content and creators influencers to create content free like
you're doing it yourself or you're kind of finding creators. There's different strategies to look
in like digging that more. I know you have a lot of experience in that too or understanding how it's
working. So in this example where try different platforms that are kind of like marketplaces for like
brands and creators right up. This particular one is from join brands and then there's a bunch of
ones like testing like side shift and like WAP and kind of our own discord and like just trying
different approaches of having creators make content for you. So one it's about the the piece of
content that's one thing. Two is the algorithm specifically on the TikTok side is that getting posting
just might trigger the algorithm so you kind of want post just a lot of posting there and three
a viral engine component which is different than the first two parts. The first one the content
is more of a paid ad strategy rather than like we kind of have our own designers creators and
like contractors people that create content for us but what if just that content could be generated
and then we could be amplifying them with paid ads. That's first one. The second one is more about
some of these creators have their own following so they'll kind of reach the algorithm different.
They have different styles or formats. Their account is posting like so if they do it in their style
it just may go viral differently like this one where it's like I just like covering the face and
kind of being shocked approach which is like kind of going viral regardless of who does it or maybe
it's like not as viral as before. So it's like well let's try that on their channel. Could you
actually break down this this whole TikTok. This video got 79,000 likes. What about the hook do you
think got like hooks that attention. What are the factors in that and then also how does it actually
sell the app. How long do you show the call to action if there even is a call to action like how
much do you show the product. Yeah perfect and I'll kind of say from two perspectives this is to the
other point where there's an organic strategy. So there's like a bunch of organic that we did
and out of the best ones we're amplifying with paid and then this is a paid where we can actually
track attribution as well. What purchase is it's leading to the cost per purchase in this piece
of content that's turning to an ad versus other ones where the cost per purchase isn't as good.
And then there's the parts of it like the actual hook why this video converts better than others or
why it's more scalable. So the first part was just a hook which it's done in the industry is just
something shocking and it's not even like talking. Some people want to like start talking right away
but it's just more about the expression and kind of like seeing what's working just like copying
like the headlines. So that's where just like testing a whole bunch. Some are done by a lot of
other viral pages and it's just like all right it just happened to convert. So I think that's more
of a emulating strategy of what's working for others and then putting it in the context of yours.
So then the middle is more like product demo showing. This is like calls out the audience more
knowing that later on it's actually might convert because it's for the relevant audience. Yeah
and essentially some sort of conclusion not even a call to action. This is where the paid ads do
that part where it adds the link. You have purchase attribution. So there's less focus on like
calling out what the app is and then in the comments you can see there's like questions like what is
the app or what is the app but it's like oh I could just use chaggpd for this. Oh this is like
quiz later or kind of whatever like kind of other apps and study apps. So then like the comment
section is for that and something that's goofy or whatever kind of just the creative thought of
that himself. It's just like how to how to end it and that just did better than other types of
videos that he shot different endings. Let's say it's like a strong hook and we should dig into the
hook more because there's like where I have a lot of virality experience on like on YouTube
TikTok what's different and kind of can even show different examples. So it's like that hook that
cat attention. Something in the middle that is more about relating to the audience that way it's
more likely to convert later. So I feel like there's like less best practices. It's more about
showing something about the product or how it's used that way. It's not totally relevant like it has
to be some relevance there and then some sort of conclusion that's different than the rest of the
video but there's continuity and it's more like a pattern interruptor but after the middle so they
actually stay on. That's kind of more about the video but I think it's now relevant talk about like
organic versus paid and why certain things work or not. So this is essentially where testing many
different creators and pieces of content and seeing like organically which ones finding the organic
outliers that do better than the rest. So this is where just in comparison to many other videos that
you just don't even get into like thousands of views right. This is different strategy than organically
getting millions of views. If you're able to do that organically like you're onto something
especially if you can amplify and then start replicating it, changing the first second or the
final second when you are onto that. So it's not even that it's more about growth hacking into these
tipping points where you have 50 organic videos. This actually took more like between 20 and 30
organic pieces of content to find one that's way better than the rest and then kind of replicating
that but it's within 20 organic videos kind of multiple creators, multiple hook strategies. You
just find the best one the top 10%. It may not be the best one that's viral but it'll do better than
the rest and all of them paint amplifying with ads. This might be the alpha. This does not follow
like best practices of data science even though I'm like former data scientists are like very like
mathematical. It's not that it's about directional patterns. You take all of your organic pieces and
just put a few dollars into them. If you're kind of on TikTok there's like a minimum of that but just
put a couple of dollars into each one and what does that mean? You'll have 20 pieces of content and
each of them get zero or one click or two clicks which is kind of bad. It's not a good sample size
but this is where the magic is. One of them will have like five or ten clicks and then you're like
asking wait was that a outlier? Was that random? Was it just chance? But then you just continue the
budget more and it either averages out and it was a fluke or you're on to something. So that's why I
like this kind of like low sample size approach of finding very quickly across a lot of variety because
whether it's in Facebook and Instagram YouTube TikTok the creative makes the biggest difference. There's
like targeting strategies. There's so many strategies to improve like the content or the ads. The
creative is the biggest one that gives you like the 10x multipliers. The ones where the right
creative will give you the 10 time difference as opposed to the small optimizations which is after
you have successful ads and a business model and customer journey then you can like make these 10
percent improvements which help your bottom line and you kind of know your numbers better. That
makes sense for like each month you make the improvement but when you're looking for the biggest
levers that's when it should be the 10x differences and that's the creative and then when you just put
a few dollars on each one you're amplifying that difference between the average creatives versus the
one that has the strongest hook and it just might be that expression in the face whether someone
is annoyed or excited you know kind of like catches that attention. People watch for one second longer
and that's a signal to TikTok YouTube the algorithm like all right the person just watched for one
extra second because of that emotional or something in the eyes or the face or the tagline so now they
show it to more and then it kind of amplifies from there but then that $1 10 $100 adspan on each of
these creatives amplifies that difference more. So I feel like that was your question on finding
that balance and actually doing it because I see so many kind of like these organic focus creatives
which is amazing they like figure out how to do it on like zero or lower budget like their time and
creativity but then it's such a low-hing fruit to actually amplify that even further and take those
middle quality creatives and actually find that they may be higher converting ones because this
kind of this paradox that happens sometimes the more viral it is it's kind of like viral for the
wrong reasons which is good for reviews but does it convert or not you kind of have to like drop
down the click baitness of it to find the ones that will convert better and those might be kind of like
that top 75% or like in the top 25% meaning like above the average ones those middle virality ones
that will convert better. I feel like half of the time I'm trying to find the balance between
click baity content and like not going to the spam your out but just the ones where you just get
attention it's an algorithm problem you just want to get attention to beat all of the other
advertisers or promoters or pieces of content and once you do that then it's about conversion but
if you make it way too click baity then it'll be hard to convert so you just have to have those
elements throughout the video in your piece of content. Yeah there seems to be attention if a video
goes super super viral then it probably means you didn't chill super hard in the video because
people are willing to share that video with their friends I don't want to share obviously sponsored
posts with their friends if a video does go viral probably means it didn't convert as well it's not
always the case but it seems like that's what the numbers have been saying for you there's two things
that I want to look at so first of all how well did this ad do what were the results for this one and
then second thing is I want to look into the workflow of like how did you arrive at this level what
were all the little experiments and the variations of organic and how much did you boost each one and
you know all that. So this is to the part where with the paid ads it's a amplifier for the organic
so I'm gonna like get into tracking what we're doing to track performance and knowing that there's
the full top of funnel and it's on the platform side of the social platform and then you're inside
the app there's like desktop performance but then you're in the mobile app then there's performance
within that so there's two ways of measuring the performance there's kind of like the obvious one
and it's how it fits into profitability of the ad and profitability of the company meaning that
like what are your goals what LTV do we need what cost per purchase do we need and this is where
targeting comes in the TikTok is like working better for like US targeting and then Facebook is
working better for global targeting and then it's a topic like iOS versus Android so these on's
on US and we have different goals on trying to reach $50 cost per purchase versus $100 cost per
purchase versus $200 cost per purchase I kind of set three different numbers because we have
different goals on one part of the ad we want to make sure we get enough data into like the onboarding
flow so if we're able to reach $200 cost per purchase which is way more lenient than if for like
being more aggressive on we need to reach profitability where some of these ads are like $100 cost per
purchase and depending if we're looking to the LTV so we have to like know your turn numbers really
well on one part of the ads is kind of like a break even approach and part of it is like pure profit
so you have to know that one of them you're building up that way it's it's profitable and scalable
and the other one is we're optimizing the onboarding flow so I'm kind of like sending in traffic
and knowing that we're getting 1% conversion rate from the install all the way down to the purchase
and then I'm taking the same ad this is where like the key breakdown happens where here's a successful
ad meaning it's it's in the top 10% of the organic content so now I can amplify it with paid ads
and knowing that this creative is like the testing amplifier so now I take my final the actual
journey from the install to going through onboarding in the app using the app and then there's pay
while related steps whether it's in the onboarding or after product usage so now I need to look at it as
two points of profitability meaning that anytime I'm split testing part of the app usage I kind of
like don't care about the cost per purchase because I'm sending in tens of thousands of installs
to optimize that data within a few days and then I'm tracking all of this data to know that here's
the best ad that I have and I know it's not like $2,000 cost per purchase or $1,000 cost per purchase
it's like something that's reasonable and now I'm optimizing the in-app really fast it's not
taking like weeks or months to optimize it it's like within days I do three-way experiment four-way
experiment I'm testing like crazy things like in the paywall other parts of the app and right away
that cost per purchase goes from $500 to $300 per per depending what I'm targeting I'm like all right
should I like target teachers as well or tutors so part of it is sending in data really fast to
optimize and then that cost per purchase moves down really quickly the performance is more about
the velocity of performance I'm using this ad to increase our velocity of getting from bad numbers
to good to really good because able to test really fast and then part of it I'm just kind of
separately tracking on we know that our churn is depending on the audience the country it's kind
of between three and seven months it kind of depends on the numbers I'm looking at I can like
estimate LTV so I know that each purchase is worth kind of depending on the audience but it's
$30 or like $70 or like higher kind of depending on different parts of the product that is
purchased that depending on the country and also device like iOS is much better so then I know
the exact numbers I don't blend this data with the rest because you might make a decision where
like oh it's $300 cost per purchase turn that all off sometimes you could do that if you're very
aggressive but then I'm taking where like 20% of it is matching our numbers exactly so it's kind of
I'm okay with incremental improvement there while crazy testing is here incremental meaning that
then taking this creative and testing 10 different headlines yeah specifically for this video it's
in the hundreds of purchases so it's not like crazy where it's like thousands of purchases from a
particular video guess we can like do them at but it's in the ballpark of hundreds of purchases
so this is where my previous answer where they knew horizontally scale it then that gets into
you replicating it where it's multiple moments of these like different hundreds of purchases that
stem from this so this is like on a scale of hundreds and then what do you do from there do you like
horizontally scale by having the same creator make multiple variations then you run ads on all of
those as well yeah it's both but it's more the example where it's the same type of video but you
test on the at side different elements of the ad so you're scaling within the ad platform platform
this is if it's different audiences different headlines different flows it goes into the app
so to you scaling means you take this winning ad and then you make variations of it sounds like
a few different levels like audiences the copy of the headline and then landing page variations
is that accurate on the audience I'm making sure that it's clear on device and countries less
on the student or interest because the algorithm is really good they find it so it's more like
broader in terms of the audience of the reach it's more about how it fits into the funnel inside the
app so that's on the audience side like kind of different countries because different countries have
different LTV goals different MRR goals and kind of things that the ad is trying to accomplish so it's
making sure that it's different countries because then this fits into are they going into a free
trial or not so this is on the at side so what are we looking at here is this the original video or
is this like a horizontal scaling yeah this is like scaling it like taking different variations but
this is showing same thing but then in US versus different countries so then it's scaling on that
first part all like different targeting and then what happens is inside the app on different flows
so I'm kind of like scaling that way I have different cost per purchase metrics scaling it on the ad
platform side knowing that it's different targeting which diversifies the risk meaning that to
scale it even more there's differences that happen inside of the app depending how we have the
different paywall once there's multiple ads going this is like different countries different
targeting it's like the same creative but then like changing like the intro or the outro this is where
like on a creative side there's like some variations just to like not fatigue the audience but
making sure that there's enough different ads and then there's hundreds of different ads at the ad
group level how do you horizontally scale that across different audiences and demographics part of
this scaling is identifying the funnel steps there's our analytics that are internal inside of the
app like our own dashboards and then what you can see on the platform there's like the issue of
attribution with attributing or not and then versus like everything we're tracking inside just our
own database and trying to confirm what I do is just making sure you're looking at all of the
different attribution types of like metrics and periods I know there's a lot of data and then like
gut feeling that if you run an ad and you have 10 purchases reported or 100 purchases what does
that actually mean are the is the real data where it's like double that so I think there's like a good
insight where it's usually like double that and then I'm doing like different lift studies where
I completely turn off ads to see how much sales go down and then I turn them back on to see how much
sales go up to get estimates of these lifts and then the same thing when I'm looking at some of these ads
time period for any ad knowing how many are coming in right away kind of like one day versus
seven day or beyond to know that at least 10% of the purchases are coming in later that aren't
relatively instant then also looking at scan versus what's other reported purchases knowing that
another over 10 to 20% of the purchases are coming in through these other attribution methods and then
I'm actually in apple connect looking at analytics like based on platform knowing that another 10 to 20
percent of purchases are coming in from spillover types of attribution that are happening like
somebody sees that ad and then they just go search for it and then they like end up like installing
and purchasing so there's all of these different attribution sources that then give me more confidence
on being able to scale out because I know what's being reported in the actual ad so this is making
sure that you have some sort of funnel step view not only like on onboarding you might know like
how many people you're dropping off at each different step but within the ads as well whether it's
as simple as setting up the columns but just seeing that order of how many people you have from
install there's like I have like hundreds of ads actually like thousands of ads I'm just kind of
showing a very really refined example from like install registration kind of different engagement
and then different paywall steps so when I make sure to see that so you know what the drop-offs are
just so when I'm looking at 20 of these looking for outliers I see which ones have higher percentage of
conversion lower drop-off and actually making custom metrics making sure that it's percentage wise
comparison as well that way it's much easier to split tested when I was talking about a tick-tock
example where there's creative but then there's many different assets with different targeting knowing
which one is low into lower percentage of drop-offs just so it's much easier to tell on what the
percentages of like from one step to the next from the install using the app different steps of the
paywall being able to measure that because that's where you end up seeing outliers like these top 10
percent where from going into the purchase there's these 10 x differences on some of the ads some
of the targeting depending on the journey they took inside of the app so there's like different
types of products and some of them start using a particular product then end up purchasing and it's
10 times higher conversion then kind of just like roaming throughout the app. Is there any outliers
stat that's really interesting here? Actually this is a better example here where I take this approach
so this was headline testing where it's the same creative so it's a constant variable so it's
the same video ad same targeting but I'm just testing just one factor in this case it's creative
and seeing just the difference it in the performance then I turned off a bind so then these
ones have a lot more ads than the ones that didn't work but it's this approach where it's like
look at these 10 ads my earlier example where I'm like even if you're spending just like a few
dollars per creative you're gonna start seeing these outliers where it goes from one click to 10 click
or a purchase comes in and some like never get a purchase and some start getting two three purchases
and then I revisited weekly to make sure that that pattern holds so it's doing this approach but for
each of your hypotheses making sure that it's here it's just the headline everything else is the same
and the same thing like with the TikTok examples where it's all kinds of different targeting different
countries but it's the same thing it's that identical creative and then they start taking different
flows and then it's repeating that but inside of the app but it's the same targeting same creative
would you consider this horizontal scaling doing the headline variations I would say this is
trying to get deeper because you found something that's working so in this case the video was successful
so now when I was like scale this video more and it's finding these headlines so this one isn't for
different audiences as soon as it gets into like different audiences it starts getting into like
different psychologies and different like value propositions which kind of feel more horizontal
here it's like going more deeper to be able to scale this but it's kind of like one word make a
difference okay I just want to try to build out a step by step process for this that sounds like
step one is organic variations small boosts on each organic variation second step is find a winner
and then you start doing deeper scaling with things like this like headline rotations and then maybe
step three now you go to different audiences and try to test stuff there I'm trying to piece together
all the different parts and try to put it into a very simple to understand framework that's
completely right the only thing is I try to move through that flow very quick meaning that within a
week I test all of that and then move on to the next layer which is repeating that same process
within the app then that expands into the app meaning that if you have different paywalls
different onboarding that flow will be different depending on what country the user is from so
if I narrow down and I find that certain countries are doing better then I take just that country and
then tracking that data in different flows different experiments inside the app within the week
that experiment starts expanding into newer flows newer experiments but it's repeating those processes
is just that is what you outlined was in the context of organic variations taking the winner of that
being able to have like different targeting and scaling it further but it gets into the app
right away yeah let's look at the app now this is more examples of variations testing and kind of
like smaller differences versus bigger like one is like social proof so there's like promising
metrics anytime you social proof but what I'm trying to do is like rather than the test itself where
it's three types of registration one is more cleaner one is warmer one is that there's like more
social proof tracking all of these metrics same thing then on paywall side where it is just
trying different variations whether it's comparison free versus a paid plan more detail versus less
detail these more like bigger variation but then within that it's finding like micro variation so it's
an aspect of social proof where I think the interesting part is certain metrics go up you have like
more engagement but less purchases in certain situations like a crap that's like we're like onto
something but the social proof is not in the right place we have to take these learnings and then
put them into micro experiment so the goal isn't specifically like to do these tests but it's to
learn from it as fast as possible to move into the next test within a week there's like all of these
new sets trying to find out the data like really quick same as on the at side there's like the process
of following of how you're trying to identify the steps of where the organic comes in paid on the
testing but I would say like the more important is trying to run through as fast as possible to like
unlock the next test same here registration page onboarding doing some variations to see how it is
leading to like more purchases more and more engagement finding the balance of those because
we actually like want testers want students to learn so we don't always look at just like the purchase
metric because sometimes engagement goes way down like all right let's find that hybrid approach
where we don't lose engagement and still getting purchases I look at a lot of assisted conversions
and I'm looking at the way certain screens assist in conversions you run an experiment during
onboarding and then at the end you have more or less purchases or more or less engagement but
sometimes there's a screen where people don't convert on that screen but it's like an assisted
conversion so making sure you're tracking that and you find these patterns that you don't see if
you're not tracking assisted conversions so I don't know like how common it is for others but
making sure that you're setting up your analytics that way you kind of like a second opinion or like a
tiebreaker if purchases are neutrally in your test look at assisted conversions that will help
deciding some of these screens helping or not so that was the example here where like social proof
have mixed findings purchases were up but in certain types of demographics or pathways but when
you look at it as a assisted conversion then it was like neutral meaning like there wasn't the
negative effect that I thought it was if you're just looking at the final conversion metric across
all users all countries back to like the organic and at-site when you're running those different
experiments from the different creatives they might lead to a different dynamics on like
it's social proof relevant for them or not but when you're looking at the assisted conversions it
kind of adds this tiebreaker that way you don't like make a decision based on just the final
data point you have to take the first principles making sure that you're measuring something but
adding on to that second order thinking and strategies to make sure that it amplifies it in these
scenarios because it gets sophisticated with the top of the final testing on the at-site and
how it actually happens within the app yeah I appreciate the super deep breakdown what are some
of the things that got you into virality because I think you've done some super mega viral like
youtube short stuff where I have like many different channels and it's figuring out like that
virality in the first split second and it's all kinds of themes like fake text messaging like
sponge bop like president head comedy video so it's all kinds of stuff that you could easily automate
use AI or like examples like this where it's oddly satisfying type of stuff where it's just like
a few seconds long but it's the first seconds that catch attention again you have to realize that
revenue is not high it was like depending like what country you're from so I feel like me figuring
that out throughout this past year there's something psychological happening of curiosity attention
and then comes e-commerce commerce I feel like just having that experience of all kinds of
different niches being able to capture attention and this like micro story telling then it's the
same thing in app got like attention from the organic content into an app and converting so this
channel did 26 million views in the last 28 days that's what the stash broader showing right
did you show us what are these videos oh yeah let's see that's the video hundreds of millions of
views over like a billion views and actually another channel I have that's like even more where
it's like just crushing stuff and like breaking stuff you have to have like other business models but
also I have over 10 of these channels things have to add up but it's like learning that viral moment
and in other topics like fake text messages right kind of different demographics so it's got
interesting how there's these weird niches like all over YouTube and TikTok right I'm being able
to like create this virality essentially it's this micro story telling that's happening there
I'm gonna ask two more questions first one is someone had an MVP or an app that doesn't have
that many downloads but you have a five thousand dollar budget what would you do to get your first
few users and start getting traction I don't think most would say this but I would try to
spread it out in as many learnings as possible as many hypotheses as possible so rather than like
putting it all into the algorithm and it working you just might be testing a piece of content or
strategy that it's just not an outlier and you're just gonna dump it all so instead think of
as many variation as possible like a hundred if you can it sounds extreme but after like 20 you're
gonna force yourself to think about what's a slightly different format angle hook and then even if it's
like a one dollar amplifier for each of those I feel like it's gonna go longer because you're gonna
get zero clicks for almost all of them but then there's gonna be one that has like 20 clicks you're
like all right what's going on is this an outlier there's something different about it right like the
viral YouTube example that I showed it's like I didn't even like think is that relevant for learning
well actually this like the strategy I'm trying next is like applying these completely other niches
into the learning niche there's like learnings in other industries and you started mixing them
you started getting virality so I would say put it into as many creative ideas as possible
diluted out because that's where the outlier will come out from like a hundred variations is insane
but it totally makes sense so you mentioned you could put as little as a dollar in to each video
is that actually how you would do it would you actually spend like a dollar on each a hundred videos
also a budget usually do just to get that tiny little boost the platforms have minimum but yes
the minimum in each of the platform and this is where I'm testing like Google YouTube Facebook
TikTok to find those outliers the same thing or similar thing in a different platform might give you
two x results but yes the minimum on each of those so it depends is like five or 20 dollars depending
on the platform that's what I would do 20 creatives the lowest on each one and then just track it
throughout the day it's not gonna go all the way down to the purchases but you're just looking
at the top of the final metric which one is getting the most clicks and that's it it's almost like
a little bit of click baity but again this is a psychological game of what's getting attention
what's telling the right story the strong hook and you're gonna find the one that's two five 10
x performance better than the rest then you dial in on that one then that one you want to
track that all the way down to the purchase make variations but most don't even get to the
finding of the outliers and they're stuck in these the worst 75% of the content creative
and they never get that virality or that that viral channel or video you kind of hear this from
like people that have been doing it for years that they have virality because they tested like 500
things it may be took them a year but tried to condense those 500 videos into a week it sounds
extreme but after you make 20 of them then you start looking at competitive tools you start having
a meditation session to inspire you or you go on a jog or you kind of talk to people you have
different team members come up with ideas you start approaching these creative ways of coming up with
the idea and that's when you find the outliers because you tested it now so that's kind of like the
more straightforward approach even though it's like a lot you kind of to get creative the other one
is something along partnerships there's so much traffic so much audiences you get like buy and
existing channel or audience or partner where it exists and your creative will already have 100
times more likely chance of success so this is kind of more like either a networking route a
partnership route or just kind of like you acquire the species of asset and it might cost you the
few hundred dollars three thousand dollars to like shortcut your way into having access to an
audience like renting the audience or buying it that will skip all of these other steps of building
it yourself to find out really quick so I would say that's the a little bit more sophisticated but
then you're kind of thinking a lot more strategically on a like investors think or VC's think or
kind of like on the enterprise level at done both and both have their own very fast growth
labors and like trying to combine them so you said 20 different creatives five dollar budget for
each one is that what you said like and that's all tiktok 20 dollar minimum on tiktok so then if we're
talking about tiktok I would go with the example where you have to like put 20 dollars in each one
but you could turn it off after it spends five dollars you could turn it off so yes this is
actually the approach where it's 20 creatives 20 dollars each turn it off halfway if you want but
now you have 20 pieces of content within hours you'll know which one is an outlier even if it's not
amazing it's better than the rest so that's what you have to go with you instantly growth hacked into
finding the one that is better than the rest it's not maybe the best one but it's like good while
the rest were bad so now you take that and make variations of that that would be like the next phase
so for tiktok you do 20 creatives 20 dollars each it would take you like a few hours to see those
results for Facebook is it different yeah I even go more extreme on Facebook you could put lower
amounts and it's just easier to duplicate and scale everything so it's the same thing but I try to
have 30 40 so in there you just learn much quicker there's kind of like attribution issues you
were trying to go down to like in this phase of growth hack don't worry about that yet it's more
about as many variations as you can but the example that I showed was the same video many headlines or
the other way just speak the same headline one that is generally working it's getting decent click
through rates but then change the video like that piece of content just to wrap it up so like 30 40
videos on Facebook and then putting as little as a dollar behind each one and you can just get
instant results there and find some outliers yeah you're gonna find right away that four or five of
those videos are much better than the rest you're gonna think is this statistically significant or
not probably not but this is directional some of them will have five 10 clicks more more than the rest
then of course you increase the budget and test that and expand it further that's super interesting
I love it it's just like super rapid it's like a really great roadmap for just super rapid testing
I think when most people are thinking about starting it's like oh let me try five ads let's try
10 ads but it's like for you it's like no 40 ads on this platform 20 ads on another platform
and just yeah you just need to experiment as fast as possible to get those outliers so yeah and the
easier part is Corbors already focused on organic just amplifying existing because you already
probably have hundreds of pieces of organic yeah super interesting okay thanks so much yeah but
this is great all right all right that was yeah great conversation uh yeah is also a member of
consumer club sponsored by super wall consumer clubs just a place where we talk about all the
big growth tactics successful app founders and operators and growth hackers yeah they've been an
active member for a while so it's great to have them on the pod and yeah we'll see you guys in the next
video thanks for listening to the super wall podcast if you're building a mobile app and want to
test launch and optimize your paywalls without shipping any new code head to super wall.com and you
can create a free account and start building today and for updates tips and behind the scenes looks
follow us on x at super wall see you next time
Podcast Summary
Key Points:
Yev is the head of growth at an Edtech app called Sizzle and has experience with YouTube shorts.
Discusses tactics for building a scalable growth engine and balancing organic and paid marketing.
Emphasizes finding tipping points and optimizing drop-off points in the user journey for growth.
Talks about the balance between organic and paid strategies, leveraging ads strategically.
Highlights the importance of analyzing creative elements for significant growth impact.
Summary:
Yev, the head of growth at Edtech app Sizzle, shares insights on building a scalable growth engine by finding tipping points and optimizing drop-off points in the user journey. He emphasizes the balance between organic and paid marketing strategies, leveraging ads strategically to amplify organic content. Yev stresses the significance of analyzing creative elements, as they have a substantial impact on growth.
By experimenting with various content and amplifying successful organic pieces with paid ads, businesses can identify high-converting creatives. Yev's approach involves focusing on directional patterns rather than best practices of data science to achieve significant growth multipliers. The key lies in understanding the nuances between transitioning from paid to organic strategies and vice versa, ultimately leading to successful growth outcomes.
FAQs
Sizzle AI is a learning app tailored to students and learners of various topics, focusing on actual learning and growth.
Yev noticed potential in Sizzle AI by analyzing user journey pathways and identifying low drop-off rates, indicating a solution to user problems.
Identifying and addressing drop-offs at every stage of the funnel, leading to 2-3X growth by focusing on high drop-off areas.
Sizzle AI leverages a strategic balance between organic and paid marketing, amplifying organic content with paid ads to optimize the funnel.
Yev focuses on testing a variety of organic content, amplifying the top 10% performers with paid ads to identify strong conversion points.
The approach involves testing multiple creators and pieces of content organically, amplifying the top performers with paid ads to leverage the strongest creative hooks.
Chat with AI
Loading...
Pro features
Go deeper with this episode
Unlock creator-grade tools that turn any transcript into show notes and subtitle files.