This story has moved to /story/formalizing-learning-from-language-feedback-with-provable-guarantees/.