The one I asked about. It does integrate with babel. I simply didn't know to what extent.
#+BEGIN_SRC ?
A
#+END_SRC
#+BEGIN_EXAMPLE
A-response
#+END_EXAMPLE
#+BEGIN_SRC ?
B
#+END_SRC
Where if you run Ctrl-c Ctrl-C on the block it sends the conversation to chatgpt:
User: A
Assistant: A-response
User: B
This enables notebook style development if you are tinkering with a prompt and want to see how the responses cascade based on further input.
org-assistant.el and org-ai.el
org-ai.el is focused more on runtime interaction with AI
org-assistant.el is focused more on reproducible sessions via org babel
org-assistant.el supports branching conversations
org-assistant.el is not meant to be used downstream as a library for AI endpoint interactions.
In org-assistant.el, all interaction is async using org-babel, which allows for notebook style prompt development
In org-ai.el, interaction is synchronous and inline, which is better for in-editor use cases
org-ai.el supports a lot of other AI use cases like text to speech
Makes sense, I won't be changing it from the current way. I think chatgpt-shell works more idiomatically in the org way in that context so that can be an alternative for people who prefer the former variant.