For instance

https://etke.cc/help/bots/chatgpt/

This should be possible with MemGPT now -- you just have to have the application send messages to a MemGPT agent running on a server, and either replace or modify the send_message tool in MemGPT to instead send a message to the application you want the message to appear on.

@cpacker recently made a demo for how to connect a MemGPT agent to chat via a tamagotchi front-end, so that might be a helpful reference once its released (hopefully soon).

I think the question here is , could the messages endpoint implement the OpenAI chat parameters? That would allow all the available chat clients/packages out there to work out of the box.

Here

https://docs.letta.com/introduction#letta-api

it says

Letta API -> Stateful ChatCompletions API: an API designed to be a drop-in replacement for the standard ChatCompletions API

From this statement I understand that currently any Letta agent can be used as a "a drop-in replacement" in any of the existing chat clients/frontend which support the ChatCompletions API (including web apps which support ChatCompletions, Slack, Matrix or other chat bots which support the same, VS Code extensions/assistants which can connect to any OpenAI endpoint or Emacs clients which support the standard ChatCompletions API format)

Is my understanding correct?

@distributev exactly - that's the high-level idea. Basically, many frontends / client applications have been written exclusively to support the /v1/chat/completions API (e.g. voice services like VAPI or LiveKit).

That API spec is stateless (meaning there's no memory management, so the client has to pass in the full agent state at each step), unlike Letta's API which is stateful (the server maintains the agent state, and the client only has to pass in a single message).

However, it's possible to connect a Letta server to services that expect a stateless API, and still get the power of a stateful API - you basically "pretend" like you're exposing a /v1/chat/completions API but under the hood make the API stateful. This allows you to connect something like LiveKit to a Letta server to communicate with a stateful Letta agent using voice.

We're currently working on this feature and hope for it to be released in the next few weeks (possibly sooner).

"hope for it to be released in the next few weeks (possibly sooner)"

Are you referring to the LiveKit integration or the ChatCompletions API format standardization itself?

This issue is stale because it has been open for 30 days with no activity.