I wrote up some details of investigations of a chatbot we created in Microsoft Research using a technique of creating synthetic memories with LLMs and RAG.

Key takeaway is that it produced a bot that was perceived as more empathetic than ChatGPT with GPT-4 (and other chatbots) and allowed context to be maintained for extremely long chat conversations.