#005 - Iulian Vasilisca, Glovo
In this conversation, Alexandre Suon interviews Iulian Vasilisca, a technical product manager for the Experimentation Platform at a food delivery app.
Summary
In this conversation, Alexandre Suon interviews Iulian Vasilisca, a technical product manager for the Experimentation Platform at a food delivery app. They discuss Iulian's background in experimentation, the challenges of scaling experiments, and the importance of building a robust experimentation platform. They also explore the balance between running a high volume of tests and focusing on impactful experiments. Iulian emphasizes the need for speed in experimentation while maintaining quality and highlights the role of communication and buy-in from leadership in driving experimentation adoption. They also touch on the use of psychology in formulating hypotheses and the importance of personalization in experimentation. The conversation concludes with a discussion on the placement of experimentation within an organization and the value of experimentation in informing strategic decisions.
Keywords
experimentation, scaling experiments, experimentation platform, speed vs impact, communication, leadership buy-in, psychology, personalization, organizational placement
Takeaways
Experimentation requires a balance between running a high volume of tests and focusing on impactful experiments.
Building a robust experimentation platform is crucial for scaling experiments and ensuring speed and quality.
Communication and buy-in from leadership are essential for driving experimentation adoption within an organization.
Psychology can play a role in formulating hypotheses and understanding user behavior in experimentation.
Personalization is a valuable aspect of experimentation, allowing for targeted and tailored experiences for users.
The placement of experimentation within an organization can vary, but it should have close alignment with product, engineering, and data teams.
Experimentation provides valuable insights for strategic decision-making and optimizing investments.
Titles
The Value of Personalization in Experimentation
Placement of Experimentation within an Organization
Sound Bites
"Experimentation should be on the speed side because the more ideas you test, the higher the chance of finding valid ideas that bring impact."
"Finding a champion within the company who is interested in experimentation can help drive adoption and create a snowball effect."
"A good scorecard includes the comparison between groups, the metric of interest, the delta, and whether it has a statistically significant effect."
Chapters
00:00 Introduction and Background
14:04 Speed vs Impact in Experimentation
23:38 The Importance of Scorecards
28:19 Choosing the Right Statistical Approach
36:52 The Role of Psychology in Experimentation
41:54 Experimentation for Strategic Decision-Making
