Playground overview¶

A playground, another type of Use Case asset, is the space for creating and interacting with LLM blueprints. LLM blueprints represent the full context for what is needed to generate a response from an LLM, captured in the LLM blueprint settings. Within the playground you compare LLM blueprint responses to determine which blueprint to use in production for solving a business problem.

You can use playgrounds with or without a vector database. Multiple playgrounds can exist in one Use Case and multiple LLM blueprints can live within a single playground.

The suggested, simplified workflow for working with playgrounds is as follows:

1. Add a playground.
2. Set the LLM blueprint configuration, including the base LLM, prompting settings, and optionally, an associated vector database.
3. Chat to test and tune the LLM blueprint; view the tracing.
4. Build additional LLM blueprints.
5. Compare LLM blueprints side-by-side.
6. Add datasets and metrics to the LLM blueprint to help evaluate responses.

Add a playground¶

To add a playground, first create a Use Case and then either:

• Click the Add Playground button.
• Select the Playground tab and click the Add playground button. This button is only available for the first playground added to a Use Case; use the Add playground dropdown for subsequent playgrounds.

When you create a playground, the playground opens with two options for creating and configuring an LLM blueprint. From the playground you have access to all the controls for creating LLM blueprints, interacting with and fine-tuning them, and saving them for comparison and potential future deployment.

Elements of a playground¶

A playground has basic navigation controls to take you to specific components:

And three major work areas:

• Chat window for sending prompts and receiving LLM responses.

• Comparison panel for working with LLM blueprints and chats.

  

• Configuration panel; when open, use the breadcrumbs to return to the comparison.

  

Once playgrounds are created, you can switch between them using the breadcrumbs dropdown:

Navigate the playground¶

On the far left, click the icons to access navigation components:

	Component	Description
	Comparison panel	Select LLM blueprints to compare and view chat history.
	Playground information	A page that displays playground summary information.
	LLM evaluation*	Configure evaluation and moderation guardrails for LLM blueprints in a playground.
	Tracing*	Accepts prompts to begin chatting with the LLM blueprint; the configuration must be saved before the entry is activated.

* Available only if LLM assessment is enabled.

Playground information¶

The Playground information tab provides basic metadata about the creator, creation and last modification dates, and number of LLM blueprints. Two tabs provide additional information:

• The Vector databases tab lists each unique VDB used in the playground. Regardless of how many LLM blueprint configurations a VDB is used in, the listing displays a single entry.

  

  For each entry, metadata reports the settings used in the VDB's configuration.

• The Deployed LLMs tab lists each deployed LLM that is part of at least one LLM blueprint configuration in the playground. Regardless of how many LLM blueprint configurations a deployed LLM is used in, the listing displays a single entry.

  

  For each entry, metadata reports creation information, deployment name, and the prompt and response column names that were defined when assigning a deployed LLM to the blueprint.

Playground information page tools¶

Use the Edit playground info button to change the name of a playground and optionally, add a description. When you add a description, it displays under the playground name at the top of the Playground information page.

Click the actions menu , located just to the left of the Edit playground info button, to open a menu and delete the playground. Alternatively, you can delete a playground from the Use Case asset listing.

Use Settings to:

• Set the columns you want to view by checking or unchecking boxes.
• Reorder columns using the arrows to the right of the column name.

• Pin columns so that they appear on far left by clicking the pin icon.