Skip to main content

Chat

This API lets you create a conversation with LLMs. Using this API enables you to ask questions to the model including information using the history of already asked questions and the respective answers.

Create a new conversation and use chat history to augment follow up questions​

Loading code...

You will get a response similar to:

LLM Response

First answer: The capital of France is Paris.

Second answer: The second-largest city in France is Marseille.

Chat History:

[{
  "role" : "user",
  "content" : "What is the capital of France?",
  "images" : null,
  "tool_calls" : [ ]
}, {
  "role" : "assistant",
  "content" : "The capital of France is Paris.",
  "images" : null,
  "tool_calls" : null
}, {
  "role" : "user",
  "content" : "And what is the second largest city?",
  "images" : null,
  "tool_calls" : [ ]
}, {
  "role" : "assistant",
  "content" : "The second-largest city in France is Marseille.",
  "images" : null,
  "tool_calls" : null
}]

Create a conversation where the answer is streamed​

Loading code...
LLM Response

The

The capital

The capital of

The capital of France

The capital of France is

The capital of France is Paris

The capital of France is Paris.

Using a simple Console Output Stream Handler​

Loading code...

With a Stream Handler to receive the tokens as they are generated​

Loading code...

Create a new conversation with custom system prompt​

Loading code...

You will get a response as:

LLM Response

Shhh!

Create a conversation about an image (requires a vision model)​

Loading code...

You will get a response similar to:

LLM Response

First Answer: The image shows a dog sitting on the bow of a boat that is docked in calm water. The boat has two levels, with the lower level containing seating and what appears to be an engine cover. The dog seems relaxed and comfortable on the boat, looking out over the water. The background suggests it might be late afternoon or early evening, given the warm lighting and the low position of the sun in the sky.

Second Answer: Based on the image, it's difficult to definitively determine the breed of the dog. However, the dog appears to be medium-sized with a short coat and a brown coloration, which might suggest that it is a Golden Retriever or a similar breed. Without more details like ear shape and tail length, it's not possible to identify the exact breed confidently.