Practical Consequences of Underspecification in ML

What to make of a recent popular-yet-vague paper on ML pipelines

There was a recent paper talking about Underspecification in ML. Aside from making only weak evidence for this phenomenon, the paper doesn’t actually go into much detail about how to fix it. With that in mind, I figured a short post was in order to clarify what underspecification in ML is, what it looks like, and what you can do about it.

References


Cited as:

@article{mcateer2020underspecml,
    title = "Practical Consequences of Underspecification in ML",
    author = "McAteer, Matthew",
    journal = "matthewmcateer.me",
    year = "2020",
    url = "https://matthewmcateer.me/blog/ml-underspecification/"
}

If you notice mistakes and errors in this post, don’t hesitate to contact me at [contact at matthewmcateer dot me] and I will be very happy to correct them right away! Alternatily, you can follow me on Twitter and reach out to me there.

See you in the next post 😄

I write about AI, Biotech, and a bunch of other topics. Subscribe to get new posts by email!


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

At least this isn't a full-screen popup

That'd be more annoying. Anyways, subscribe to my newsletter to get new posts by email! I write about AI, Biotech, and a bunch of other topics.


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.