Create a chat generation Q&A application¶

You can create a chat generation Q&A application with DataRobot to explore knowledge base Q&A use cases while leveraging Generative AI to repeatedly make business decisions and showcase business value. The Q&A app offers an intuitive and responsive way to prototype, explore, and share the results of LLM models you've built. The Q&A app powers generative AI conversations backed by citations and allows you to provide feedback on responses. Additionally, you can share the app with non-DataRobot users to expand its usability.

Prepare a text generation deployment¶

To build a chat generation Q&A application, you must first prepare and configure a deployment. You need to create a deployment with a text generation target type.

Once you have created the deployment, you have the option to configure an external custom metric to collect feedback for the Q&A app's responses:

1. Access the deployment from the Console > Deployments page. Select the deployment and navigate to the Monitoring > Custom metrics tab.

   

2. Click Add new custom metric and select Add an external custom metric from the dropdown.

   

3. Configure the feedback metric as displayed in the screenshot below. When you have finished configuration, click Add custom metric.

   

4. Additionally, set up an association ID for the deployment in order to store submitted feedback (via the custom metric) with the associated prompt and response data. Without an association ID, the feedback custom metric is only able to store responses aggregated by time values.

5. After configuring the deployment with the appropriate custom metrics, note the deployment ID and custom metric ID. They are be used to build the chat generation Q&A application. To locate the custom metric ID, select the menu icon on the configured custom metric in the deployment and click Edit. The dialog box lists the metric ID.

   

Build a chat generation Q&A application¶

To build a chat generation Q&A app, use the following steps:

1. In the Registry, navigate to the Applications page and click Add > Create Chat generation Q&A template.

   

2. Select the text generation deployment configured previously, and provide the custom metric ID for the feedback metric.

   

3. After specifying a deployment and custom metric ID, click Create app. The application is added to the All applications list with the Initializing status. After it builds, you can click Open to view and use the application.

   

   Note

   You can click the action menu next to a custom application in the Applications tab to Share or Delete the application.

Use the chat generation Q&A application¶

To begin using the chat generation Q&A application, go to the Registry, locate your QA app in the Applications > All applications list, then click Open.

When the Q&A application loads, provide a prompt to initiate a chat. Allow some time for the app to run and return an answer to the prompt.

The app will respond with an answer. You can provide feedback for an application by selecting thumbs up or down for a prompt's response. Additionally, click Citations to view a dialog box that details the source(s) from which the application finds its answer to the prompt.

Manage the chat generation Q&A application¶

You can manage multiple Streamlit settings for the chat generation Q&A application. To access the settings, after opening the application, click the action menu in the top right corner.