The problem
ManoMano is a DIY marketplace and one of Europe’s e-commerce unicorns. Google Shopping is its main source of traffic, with automated campaigns spending up to $1M a day, so a small gain in how that money is bid is worth millions a year.
What I built
Google Shopping bidding
The bidding model was already at v3 when I joined: a LightGBM ensemble trained on over a billion rows and 500 features, one row per day, product and device. I worked on it with a Senior Data Scientist. Its feature engine computed moving averages of past revenue in memory and crashed training whenever the data grew. I rewrote it to compute features in time chunks, so memory stays constant as the data grows, then added features (ensembles, new time windows, mixed granularities) after Data Analysis showed it would be impactful and fine-tuned the model.
Our work made the model spend more and earn more, enough to beat Target ROAS (tROAS), Google’s own bidding algorithm. In 2020, a randomized A/B test in France measured a statistically significant 7% uplift against tROAS, about $30M of extra business volume a year.
Keyword campaigns
I built the system that runs ManoMano’s Google keyword campaigns end to end. It finds keywords from Google’s APIs, ManoMano’s own search data and the business teams’ input, scores each one daily with a LightGBM revenue model, and sets budgets and parameters through the Google Ads API. New keywords are picked up every day as new products go on sale. The campaign spent about $1M a month, profitably.
Delivery-time estimates
An internal causal analysis showed delivery time drives conversion: a product that looks slow to arrive doesn’t get ordered. Comparing the promised delivery times with tracking history showed they were too pessimistic. I built a model that estimates delivery time from that history and put it into production. Delivery times dropped for 60% of products, and an A/B test measured a 3% uplift in conversion rate.
Production ML for the team
I also industrialized most of ManoMano’s ML models and coached the data scientists on DevOps and Software Engineering practices.
Results
- About +$40M a year of business volume from the bidding and marketing ML.
- A wider impact across teams: as the bridge between data science and data engineering, I helped most of ManoMano’s 10 ML models reach production, well beyond the projects I owned.
- ROI above 60× on the cost of the work.
