Evaluation - Making Data Mistakes

Making Data Mistakes

Sign in Subscribe

Evaluation

A collection of 5 posts

Make it work, make it right, make it fast

Make it work, make it right, make it fast

I first heard this phrase from Gael Varoquax [http://gael-varoquaux.info/] (one of the core scikit-learn committers) in a talk[1], and I loved the super-concentrated wisdom of it: * Make it work. First of all, get it to compile, get it to run, make sure it spits out roughly the

How to reproduce your analysis

How to reproduce your analysis

What do you do when things don’t seem to be behaving the same way now that they did before? Here are a few techniques to avoid that dread scenario.

How to Cheat at Data Science (with help from Centaurs and the Wizard of Oz)

What does it take to run a high-performing data science team? In this 15-minute video, I talk about two tools that I’ve found invaluable for doing just that: * Wizard-of-ozzing is a technique for product discovery that can be very helpful for evaluating potential problems to work on [6:00]

How to know if your recommendations algorithm is actually doing a good job

I led the team that built Channel 4’s recommender system for All 4 in 2016. It started out as a straightforward project. But after getting lost in a rabbit hole trying to devise a score for ‘provocativeness’ and ‘serendipity’, I learned the single most important lesson about data science.

How to build a model that performs at chance

How to build a model that performs at chance

I’m going to tell you about a horrible screwup. Not my first and not my last, but a happy one - because although it was excruciating, it was also instructive.