“a reference policy to make sure you don't change the model too much and sometimes a value model.”