Question 1

What are the key takeaways from Crystal W's episode on Lenny's Podcast?

Accepted Answer

1. Run experiments even with tiny sample sizes - 30 data points is infinitely better than zero, and the underlying trends won't change much at larger scales. 2. Retention as a goal is too vague - constrain the problem space like a sandbox to find actionable, specific user behaviors you can actually influence. 3. Bad analytics instrumentation is the root cause of most failed analytics efforts - track rich event properties that capture the user's context, not just that an event happened. 4. Start your growth strategy rooted in reality - understand the physics of your market, product, model, and channels before changing anything, and only change one variable at a time. 5. Do things that don't scale to validate hypotheses quickly - Wizard of Oz tests, WhatsApp groups, and screenshots overlaid on apps can prove out ideas before writing a line of code.

Question 2

What does Crystal W say about growth and experimentation?

Accepted Answer

"This concept of doing things that are somewhat crazy, but validate a point, doing stuff that don't scale, especially I think is really the bread and butter of what we did at Gojek. We were insanely scrappy." - Crystal Widjaja "We ended up saying, 'We have this voucher system that we can distribute vouchers in the back end. We obviously know our driver's phone numbers. Why don't we just add them to a WhatsApp group?' We'll add a hundred drivers randomly to a WhatsApp group. We'll tell them, 'Every time you are on a ride with a customer, try to sell them this pitch.'" - Crystal Widjaja "Even if you have a sample size of 30, the data you get back, generally, does not change but its precision will. So mathematically speaking, you're going to get the same level of trends, but the precision at which you understand those trends will become more deep if you have more data. But the underlying information that you're getting out of that won't be very different at larger scales." - Crystal Widjaja

Question 3

What are Crystal W's views on growth, experimentation, data?

Accepted Answer

Crystal Widjaja: "This concept of doing things that are somewhat crazy, but validate a point, doing stuff that don't scale, especially I think is really the bread and butter of what we did at Gojek. We were insanely scrappy." Crystal Widjaja: "We ended up saying, 'We have this voucher system that we can distribute vouchers in the back end. We obviously know our driver's phone numbers. Why don't we just add them to a WhatsApp group?' We'll add a hundred drivers randomly to a WhatsApp group. We'll tell them, 'Every time you are on a ride with a customer, try to sell them this pitch.'"

Crystal W

How to scrappily hire for, measure, and unlock growth | Crystal Widjaja, Gojek and Kumu

TRANSCRIPT

Crystal W

How to scrappily hire for, measure, and unlock growth | Crystal Widjaja, Gojek and Kumu

Crystal W

How to scrappily hire for, measure, and unlock growth | Crystal Widjaja, Gojek and Kumu

TRANSCRIPT

Crystal W

How to scrappily hire for, measure, and unlock growth | Crystal Widjaja, Gojek and Kumu