Identifying Unknown Unknowns in the Open World

Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration. Himabindu Lakkaraju,. ∗. Ece Kamar,. +. Rich Caruana,. +.

[1610.09064] Identifying Unknown Unknowns in the Open World

This paper presents the first algorithmic approach to the problem of discovering unknown unknowns of predictive models.

Identifying Unknown Unknowns in the Open World: Representations ...

Citation. Lakkaraju, Himabindu, Ece Kamar, Rich Caruana, and Eric Horvitz. "Identifying Unknown Unknowns in the Open World: Representations and Policies for ...

Identifying unknown unknowns in the open world - ACM Digital Library

This paper presents the first algorithmic approach to the problem of discovering unknown unknowns of predictive models.

Identifying Unknown Unknowns in the Open World - Semantic Scholar

Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration · Himabindu Lakkaraju, Ece Kamar, +1 author. E. Horvitz ...

(PDF) Identifying Unknown Unknowns in the Open World ...

Predictive models deployed in the real world may assign incorrect labels to instances with high confidence. Such errors or unknown unknowns are rooted in ...

Identifying Unknown Unknowns in the Open World ... - dblp

Himabindu Lakkaraju, Ece Kamar, Rich Caruana, Eric Horvitz: Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided ...

Identifying 'unknown unknowns' of publication - Deloitte

The nature of competition in the modern world is changing, a reflection of how the business of business is dramatically transforming. Page 3. 3. A perspective ...

In the labyrinth of unknown unknowns - Antithesis

In many ways, searching for unknown unknowns in software is like playing an open-world video game. ... finding issues before users do. If ...

The Hidden Depths - Recognizing Unknown Knowns ... - LinkedIn

This chapter delves into the art and science of navigating the murky waters of unknown knowns & unknown unknowns - challenges and opportunities that lie beyond ...

A Coverage-Based Utility Model for Identifying Unknown Unknowns

(2017) on identifying unknown unknowns assumes that ... Identifying unknown unknowns in the open world: Representations and policies for guided exploration.

Identifying Unknown Unknowns in the Open World: Representations ...

Identifying Unknown Unknowns in the Open World: Representations and Policies for Guided Exploration. Himabindu Lakkaraju. ,. Ece Kamar 1. ,. Rich Caruana 1.

How can we know unknown unknowns?

To begin, no form of ignorance can be properly considered without explicitly tracking who is attributing it to whom. With unknown unknowns, we ...

Characterizing unknown unknowns - Project Management Institute

Finding more unknown unknowns means converting them to known unknowns so that they become manageable using project risk management. This model is designed to ...

Simple Ways to Spot Unknown Unknowns - Harvard Business Review

Will our new product succeed? What will the competition do? But the most challenging circumstances are often completely unexpected, because we ...

Finding the unknown unknowns - Medium

In more complex outages, sufficiency can lead to quite a few investigative vectors. So how do we sort through all of this? How are we supposed ...

There are unknown unknowns - Wikipedia

Known unknowns refers to "risks you are aware of, such as canceled flights", whereas unknown unknowns are risks that come from situations that are so unexpected ...

Identifying risk – Known knowns, known unknowns and unknown ...

The challenge for businesses looking to minimise risks is to better understand their known knowns and known unknowns and, most importantly, have contingencies ...

Exploratory machine learning with unknown unknowns - ScienceDirect

We attribute the unknown unknowns to the fact that the training dataset is badly advised by the incompletely perceived label space due to the insufficient ...

Iterative Human-in-the-Loop Discovery of Unknown Unknowns in ...

Identifying unknown unknowns in the open world: Representations and policies for guided exploration. In. Thirty-First AAAI Conference on Artificial ...