Come Back to What You Know