Testing Machine Learning Systems

Testing and DevOps in machine learning doesn’t receive nearly enough discussion in the current literature. So, kudos to Eric Breck, Shanqing Cai, Eric Nielsen, Michael Salib and D. Sculley at Google for their contribution ‘What’s your ML test score? A rubric for ML production systems.’  The authors define a rubric across: Features and Data; Model Development; Infrastructure; and, Monitoring. Check it out!
Also, I want to make a shout out to my favorite Data Science podcast, Linear Digressions, where I learned about this paper. Keep up the good work Ben and Katie!