Skip to content

Playground

GPUStack provides a playground UI for users to test or play with the completion API. The following is an example screenshot:

Playground Screenshot

Chat Playground

Prompts

You can adjust the prompt messages on the left side of the playground. There are three role types of prompt messages: system, user, and assistant.

  • System: Typically a predefined instruction or guidance that sets the context, defines the behavior, or imposes specific constraints on how the model should generate its responses.
  • User: The input or query provided by the user (the person interacting with the LLM).
  • Assistant: The response generated by the LLM.

Edit System Message

You can add and edit the system message at the top of the playground.

Edit User and Assistant Messages

To add a user or assistant message, click the New Message button.

To remove a user or assistant message, click the minus button at the right corner of the message.

To change the role of a message, click the User or Assistant text at the beginning of the message.

Upload Image

You can add images to the prompt by clicking the Upload Image button.

Clear Prompts

Click the Clear button to clear all the prompts.

Select Model

You can select available models in GPUStack by clicking the model dropdown at the top-right corner of the playground. Please refer to Model Management to learn about how to manage models.

Customize Parameters

You can customize completion parameters in the Parameters section.

Do Completion

You can do a completion by clicking the Submit button.

View Code

Once you've done experimenting with the prompts and parameters, you can click the View Code button to check how you can call the API with the same input by code. Code examples in curl, python, and nodejs are provided.

Compare Playground

You can compare multiple models in the playground. The following is an example screenshot:

Compare Playground Screenshot

Comparision Mode

You can choose the number of models to compare by clicking the comparison view buttons, including 2, 3, 4 and 6-model comparison.

Prompts

You can adjust the prompt messages similar to the chat playground.

Upload Image

You can add images to the prompt by clicking the Upload Image button.

Clear Prompts

Click the Clear button to clear all the prompts.

Select Model

You can select available models in GPUStack by clicking the model dropdown at the top-left corner of each model panel.

Customize Parameters

You can customize completion parameters by clicking the settings button of each model.