NeurIPS

Designing AI that understands humans’ goals better

Photo: Matti Ahlgren / Aalto University

Photo: Matti Ahlgren / Aalto University

To make a better smart assistant,  we need an AI that understands its user and does not constantly need detailed instructions

When researchers design machine learning systems, their goal is typically to automate certain functions. Instead of being fully autonomous, however, most of these systems work together with humans. In order to be truly helpful, they need to understand what goals people have.

Researchers at the Finnish Center for Artificial Intelligence (FCAI) have now taken important steps towards designing AI that understands people.

At first, the researchers taught the AI to build a model of its user - human or machine. Then, they taught it to adapt this model by following the user’s actions. In practice, the researchers developed machine learning methods which combine statistics with computation, and then tested the methods in practice and in simulations. They tested the algorithms in simple situations in order to make sure they understand what exactly happens in those situations and report about the events accurately.

In the first experiment, they designed an AI teacher for the learning AI.

‘This was difficult especially because the learning AI could decide what it wanted to learn,’ explains Samuel Kaski, the director of FCAI and professor at Aalto University. The researchers noticed that the AI learner achieved better learning results when the teacher understood what information the learner had already learned and adapted its teaching material to suit this  particular learner.

In the second experiment, human users were asked to find a particular target word by using an AI-based word-search engine. The engine presents the user one word at a time, and the user then  tells it whether the presented word is useful in finding the target word. If the user is looking for the word ‘football,’ for instance, they are likely to say that the first presented sport-related word is useful, if all the previous words have been related to food.

The results of this experiment showed that the AI could help the users in finding the target words faster if it understood that, by responding to the presented words in a certain way, the user wants to direct the AI towards the right words. In other words, the AI took into account the fact that the user is trying to teach it.

According to Professor Kaski, this topic is important, as the interaction between user and AI becomes much easier when the AI understands its user’s goals. ‘Then the human user does not need to explain in detail anymore what they expect from the AI helper.’

One of the main goals of FCAI is to develop AI that understands humans and is understandable. ‘So far, we can build AI systems that understand the users’ goals only in very simple situations, which means that designing truly helpful AI assistants calls for a lot of additional work,’ Kaski says.

The research article will be published at NeurIPS, the world’s largest and most prestigious machine learning conference that takes place in Vancouver, Canada on December 8 through December 14, 2019.

Link to the research article: https://aaltopml.github.io/machine-teaching-of-active-sequential-learners/

 

Further information

Samuel Kaski
Professor, Aalto University
Director, FCAI
Phone +358 50 3058 694
samuel.kaski@aalto.fi

Tomi Peltola
Postdoctoral Researcher, Aalto University, FCAI
Research Scientist, Curious AI
tomi@cai.fi

Finnish Center for Artificial Intelligence (FCAI) is a nationwide competence center for Artificial Intelligence in Finland, initiated by Aalto University, University of Helsinki, and VTT Technical Research Center of Finland. FCAI’s mission is to create a new type of AI that can operate with humans in the complex world and renew the Finnish industry. FCAI is one of the research flagships of the Academy of Finland.

Read also: Ten research papers from FCAI accepted to the prestigious NeurIPS conference

Ten research papers from FCAI accepted to the prestigious NeurIPS conference

Photo Matti Ahlgren / Aalto University

Photo Matti Ahlgren / Aalto University

Research conducted at the Finnish Centre for Artificial Intelligence (FCAI) is well presented at this year’s NeurIPS conference. In total, the prestigious conference has accepted ten submissions from either Aalto University or the University of Helsinki.

“Especially in European terms, we did well this year and the number of publications is within the top 10 of European academic institutions,” says Antti Honkela, Associate Professor of Computer Science at the University of Helsinki.

NeurIPS is the largest and most prestigious conference on machine learning, and it has become increasingly popular in the past years. In 2018, the main conference was sold out in under 12 minutes and therefore this year’s registration was based on a lottery.

“When I visited NeurIPS for the first time 15 years ago, there were 207 publications and less than a thousand participants. This year, the conference lasts for about the same time but there will be more than 1,400 presentations and possibly more than 12,000 participants,” says Honkela.

Over the past 32 years, the NeurIPS conference has been held at various locations around the world. This year’s conference will be held in Canada, at the Vancouver Convention Center.

Honkela and his research group wrote one of the accepted papers, which Honkela sees as a valuable acknowledgement for his group’s hard work. Researchers studied privacy in machine learning, and due to this work, they can assure that no one’s privacy will be violated by using a learning algorithm utilizing, for example, health data. Honkela and his colleagues developed a new version of Markov chain Monte Carlo, one of the most widely used Bayesian algorithms.

Their version of the algorithm assures privacy for a larger variety of models than any previously designed algorithm. “Therefore, this algorithm opens new, important possibilities for statistical inference that aims to secure privacy,” explains Honkela.

Accepted papers from FCAI (Aalto University and the University of Helsinki):

Regularizing Trajectory Optimization with Denoising Autoencoders
Rinu Boney (Aalto University) · Norman Di Palo (Italian Institute of Technology) · Mathias Berglund (Curious AI) · Alexander Ilin (Aalto University) · Juho Kannala (Aalto University) · Antti Rasmus (Curious AI) · Harri Valpola (Curious AI)

Improved Precision and Recall Metric for Assessing Generative Models
Tuomas Kynkäänniemi (Aalto University; NVIDIA) · Tero Karras (NVIDIA) · Samuli Laine (NVIDIA) · Jaakko Lehtinen (Aalto University; NVIDIA) · Timo Aila (NVIDIA)

Differentially Private Markov Chain Monte Carlo
Mikko Heikkilä (University of Helsinki) · Joonas Jälkö (Aalto University) · Onur Dikmen (Halmstad University) · Antti Honkela (University of Helsinki)

On Adversarial Mixup Resynthesis
Christopher Beckham (Mila, Polytechnique Montréal) · Sina Honari (Mila, Polytechnique Montréal) · Alex Lamb (Mila, University of Montreal) · Vikas Verma (Aalto University) · Farnoosh Ghadiri (Mila, Polytechnique Montréal) · R Devon Hjelm (Mila, University of Montreal; Microsoft Research) · Yoshua Bengio (Mila, University of Montreal) · Chris Pal (Mila, Element AI, Polytechnique Montréal)

High-Quality Self-Supervised Deep Image Denoising
Samuli Laine (NVIDIA) · Tero Karras (NVIDIA) · Jaakko Lehtinen (Aalto University; NVIDIA) · Timo Aila (NVIDIA)

Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderer
Wenzheng Chen (University of Toronto) · Huan Ling (University of Toronto; NVIDIA) · Jun Gao (University of Toronto) · Edward Smith (McGill University) · Jaakko Lehtinen (Aalto University; NVIDIA) · Alec Jacobson (University of Toronto) · Sanja Fidler (University of Toronto)

Machine Teaching of Active Sequential Learners
Tomi Peltola (Aalto University) · Mustafa Mert Çelikok (Aalto University) · Pedram Daee (Aalto University) · Samuel Kaski (Aalto University)

ODE2VAE: Deep generative second order ODEs with Bayesian neural networks
Cagatay Yildiz (Aalto University) · Markus Heinonen (Aalto University) · Harri Lähdesmäki (Aalto University)

Identifying Causal Effects via Context-specific Independence Relations
Santtu Tikka (University of Jyväskylä) · Antti Hyttinen (University of Helsinki) · Juha Karvanen (University of Jyväskylä)

Variational Bayesian Decision-making for Continuous Utilities
Tomasz Kuśmierczyk (University of Helsinki) · Joseph Sakaya (University of Helsinki) · Arto Klami (University of Helsinki)

The full list of accepted papers is available on the NeurIPS website.