💭 Big todos for coherent longterm llm

  • Not laser focus on one task to the detriment of other easy gains, while not forgetting about its task
  • gradually degrading behavior as llm poisons its context with bad examples
  • I haven't implemented context ranking yet.
  • Want to train weights for context ranking based on graded usefulness scores