# Accompanying code for Value-driven Hindsight Modelling

`himo_example.ipynb` contains code for the illustrative task of Section 3.2 in the [paper](https://arxiv.org/abs/2002.08329).

## Requirements and Installation

This is a Colaboratory notebook: [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepmind/deepmind_research/blob/master/himo/himo_example.ipynb)

If your runtime doesn't include [Haiku](https://github.com/deepmind/dm-haiku) and [Tree](https://github.com/deepmind/tree) please run the cell labeled "Install extra dependencies" which contains the following pip installation commands:

```!pip install dm-haiku```

```!pip install dm-tree```


## Reference
**Value-driven Hindsight Modelling** Arthur Guez, Fabio Viola, Théophane Weber, Lars Buesing, Steven Kapturowski, Doina Precup, David Silver, and Nicolas Heess
Neural Information Processing Systems 2020, URL: https://arxiv.org/abs/2002.08329