What To Forget And What To Remember