What's up, what's up? Welcome to hashtag growth. It's your boy Maddie B, aka the guy with the beard from the videos.

Today we're going to be talking about how to pick, plan, and execute a growth experiment.

So all the things that you need to know, a step by step, in terms of how to run a growth

experiment for all the you out there that are getting started with this or saying, maybe growth

is something that I should be thinking about.

Let's talk about what it means to make that happen.

So I want to start off with a bit of an example around activation. So let's say that we wanted to do an experiment to get people activated.

So people sign up on your website for your product,

and then they take some kind of action to become activated.

An example that I've used in the past is if it were Dropbox, someone would be activated when they

upload their first file. Or if it is Gmail, they would be activated once they send their first

email. So if you're picking out an experiment to do, you have your lever,

it's activation in this case. The first thing to know, and this is super critical, I learned this

the very hard way when I started doing growth experiments. It's that statistical significance matters.

Scary, big number, mathematical thing.

And to me, it was like, whoa, what does that exactly mean?

And how do I measure that?

To really simplify this down, if you're running an experiment and you only have a few data points,

like you could only run an experiment on 40 accounts, you're not going to get anything from it.

Any of the results that you're going to get are meaningless because there's not enough data there to say that this thing is actually caused by the changes that you made or the experiment that you ran.

Once you have a sense of statistical significance, so there are a few really great resources out there.

A.B.Testcalc.com is a good one. And basically the way to think about this is,

...