IJCAI 2016 Tutorial: Belief functions for the Working scientist

Previous UAI 2015 tutorial on YouTube

All fields of Artificial Intelligence and applied science are subject to various degrees of uncertainty, caused by missing or scarce data: random sets and their subjective incarnations called belief functions naturally arise when one tries to formalize lack of data in a coherent way. This tutorial introduces to the wider AI audience the basic principles of the theory of belief functions, describes practical tools based on them and compares their performance against more classical approaches to uncertainty on cutting edge real-world problems.

The theory of belief functions, sometimes referred to as evidence theory or Dempster-Shafer theory, was first introduced by Arthur P. Dempster in the context of statistical inference, and was later developed by Glenn Shafer as a general framework for modelling epistemic uncertainty. Belief theory and the closely related random set theory form a natural framework for modelling situations in which data are missing or scarce: think of extremely rare events such as volcanic eruptions or power plant meltdowns, problems subject to huge uncertainties due to the number and complexity of the factors involved (e.g. climate change), but also the all-important issue with generalisation from small training sets in machine learning.

This tutorial is designed to introduce the principles and rationale of random sets and belief function theory to the wider AI audience, survey the key elements of the methodology and the most recent developments, make AI practitioners aware of the set of tools that have been developed for reasoning in the belief function framework on real-world problems.
Context, background and motivations
Reasoning with belief functions
Target audience
The presenter: Fabio Cuzzolin
Background reading
Reasoning with
belief functions
Target audience
Background reading

In recent years the number of papers published on the theory and application of belief functions has been booming (reaching over 1200 in 2014 alone, see the histogram below), displaying strong growth in particular in the East Asian community and among practitioners working on multi-criteria decision making, earth sciences (GIS), and sensor fusion.

Indeed, belief functions are a natural tool to cope with heavy uncertainty, lack of evidence and missing data, and extremely rare events, issues which are handled far less naturally in standard probability.
An early debate on the rationale of belief functions gave a strong contribution to the growth and success of the AI community and series of conference in the Eighties and Nineties, thanks to the contribution of scientists of the caliber of Glenn Shafer, Judea Pearl, Philippe Smets and Prakash Shenoy, among others. Ever since the wider AI and uncertainty theory community have somewhat diverged. The proposer's work has been recently directed towards going back to a closer relationships and exchange of ideas between the two groups. This was a stated aim of the recent BELIEF 2014 International Conference of which the proposer was General Chair:


which led to closer collaboration with the UAI and FUSION communities, as a promising initial result. A number of books are being published on the subject as we speak by several key researchers (including the presenter), and the impact of the belief function approach to uncertainty is growing, as attested by the growing number of (especially application) papers on the subject.

This IJCAI 2016 tutorial aims at bridging the gap between core researchers in the field and the wider AI and community, with the longer term goal of a more fruitful cross-fertilisation among these related fields. It will give non-expert AI scientists the necessary references and instruments to investigate the approach in more detail, either by themselves or with the active support of the proposer.
We see this IJCAI proposal as part of a consistent effort by the proposer directed at disseminating among AI scholars the knowledge of the existence of an array of useful tools based on belief calculus and bridging the gap between sister disciplines such as AI and uncertainty theory, which will likely occupy us for years to come.

Rationale: A mathematics of uncertainty

Understanding belief functions
Basis notions

Reasoning with belief functions
Evidence combination
Decision making

Pose estimation
Climate change


We expect participants to come from all areas of Artificial Intelligence, in the first place those directly involved with uncertainty theory, but also experts in Bayesian reasoning keen on reaching out towards alternative approaches, and practitioners from all fields of applied science, especially from those application sectors in which heavy uncertainty and missing data are a real issue (climate change, policy-making, and many others). The video of the preliminary version which appeared at UAI has so far hit 606 views.

Attendees will learn about the principles of belief function theory, its rationale (especially in comparison with Bayesian reasoning and other approaches to the representation of uncertainty), a complete set of tools for reasoning in the belief function framework (conditioning, inference, graphical models, efficient computation, decision making, regression and classification, and so on). They will be made aware of the most recent methodological developments in the field, and will acquire first-hand knowledge of how to apply these tools to significant problems in the fields of computer vision, climate change, and others. The performance of such approaches will be critically compared with those off more classical regression, classification or estimation methods to highlight the advantage of modelling lack of data explicitly.

At the end of the tutorial, the audience should walk away with a much better awareness of the widespread presence of uncertainty in all fields of science, what the possible approaches to its mathematical representation are, where do belief functions sit in this context. They will be aware of the fact that a complete battery of tools for dealing with inference, decision, regression and classification based on belief functions is available. They will be provided with online resources helping them to investigate the topic further or apply existing algorithms to their problems of choice. As a result, they might want to reconsider their approaches to their applications of interest in the light of what they have learned.

We will not assume any prior knowledge of the subject, although of course some background on basic statistical methods (as normally expected from a IJCAI audience) will be a desirable and will possibly help the audience gain the most from this tutorial. In any case, we will start from scratch when introducing the subject, and make ample use of examples to illustrate the most critical points.

The presenter

Dr Fabio Cuzzolin is the Head of the Artificial Intelligence and Vision research group at Oxford Brookes University, Oxford, UK. The group currently includes five members of staff, a KTP associate, three PhD students and four MSc students. Dr Cuzzolin is a recognised world expert in uncertainty theory and belief functions theory. He worked extensively for 15 years on the mathematical foundations of belief calculus. His main contribution there is a geometric approach to uncertainty measures, in which uncertainty measures are represented as points of a Cartesian space and there analyzed.

His work in this field has appeared or is in the process of appearing in two separate monographs, published by Springer-Verlag (The geometry of uncertainty, to appear in June 2016 under the Artificial Intelligence: Foundations, Theory, and Algorithms series):



and Lambert Academic Publishing (Visions of a generalized probability theory, September 2014):


Dr Cuzzolin was the General Chair of the 3rd International Conference on Belief Functions (BELIEF 2014) held in St. Hugh college, Oxford in September 2014, and is Guest Editor of IJAR for the Special Issue dedicated to the conference, to be released in 2016. He has served three terms as member of the Board of Directors of the Belief Functions and Applications Society (BFAS).

Dr Cuzzolin is also a senior associate member of the world-leading Torr Vision Group at Oxford University, as an expert in machine learning applications to computer vision, in particular: action recognition via discriminative deformable models, online activity recognition by deep learning, multilinear classifiers applied to gait identification and EEG classification, dimensionality reduction and metric learning for dynamical models.

He is a member of the Senior Program Committee of UAI and IJCAI's PC. He is Associate Editor of IEEE Transactions on Fuzzy Systems, the top journal in computer science by 2015 impact factor, and Guest Editor of the International Journal of Approximate Reasoning. He was previously in the editorial board of IEEE Systems Man and Cybernetics C and Elsevier’s Information Fusion journal. Cuzzolin has been in the PC of more than 60 international conferences, including UAI, IJCAI, ISIPTA, ECSQARU, BMVC, ACCV, IEEE SMC, IPMU, FLAIRS, and others.

He is currently the author of some 90 publications, including 2 monographs, an edited volume, 3 book chapters, some 20 journals papers (most of which in the top CS journals by impact factor such as IEEE Fuzzy Systems, IEEE Cybernetics, IEEE Pattern Analysis and Machine Intelligence, the International Journal of Computer Vision). His work has won several awards in recent years, including best paper at PRICAI’08 (the Pacific Rim Conference on AI), best poster at the 2012 INRIA’s Machine Learning summer school, Poster Prize at ISIPTA’11 (the International Symposium on Imprecise Probabilities and Their Applications), outstanding reviewer at BMVC’12 (the British Machine Vision Conference). In October 2012 he received the Next 10 Award, awarded to the Faculty of Technology’s top emerging researchers.

Click here for a detailed list of publications.

Background reading

  Fabio Cuzzolin
The geometry of uncertainty - The geometry of imprecise probabilities
Artificial Intelligence: Foundations, Theory, and Algorithms (http://www.springer.com/series/13900)
Springer-Verlag, June 2016 (working draft)
The geometry of uncertainty

  Fabio Cuzzolin
Visions of a generalized probability theory
Lambert Academic Publishing, September 2014
Visions of a generalized probability theory

  Glenn Shafer
A mathematical theory of evidence
Princeton University Press, April 1976
A mathematical theory of evidence

  Fabio Cuzzolin (Editor)
Proceedings of the 3rd International Conference on Belief Functions (BELIEF 2014)
Springer-Verlag, Lecture Notes in Artificial Intelligence (LNAI/LNCS)
Volume 8764, September 2014