> ## Documentation Index
> Fetch the complete documentation index at: https://koreai-content-gov.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Custom LLM Model in GenAI

The Disposition Summary (end-of-conversation summary) in Agent AI is auto-generated using a GenAI model. By default, the **OOTB Kore Summarization** model is used. You can configure your own model by creating a **Custom LLM** and selecting it for conversation summaries.

***

## Create a Custom LLM

1. Sign in to **AI for Service**.

2. Go to **Agent AI** > **Generative AI Tools** from the left navigation.

3. Select **Models Library** > **New Model** > **Custom Integration**.

   <img src="https://mintcdn.com/koreai-content-gov/Zez8tGV1FpH8bXGf/ai-for-service/agentai/configuration/custom-llm-genai/new-model-1.png?fit=max&auto=format&n=Zez8tGV1FpH8bXGf&q=85&s=29de03e9a448cab33aaaab030c7cfbae" alt="New Model" width="1895" height="383" data-path="ai-for-service/agentai/configuration/custom-llm-genai/new-model-1.png" />

4. Select **Configurations** on the Custom Integration page.

   <img src="https://mintcdn.com/koreai-content-gov/lTEIRFb39rhUrUEC/ai-for-service/agentai/configuration/custom-llm-genai/configurations-2.png?fit=max&auto=format&n=lTEIRFb39rhUrUEC&q=85&s=11778949a0702764ebf4cd9fecd8f778" alt="Configurations" width="695" height="882" data-path="ai-for-service/agentai/configuration/custom-llm-genai/configurations-2.png" />

5. Enter the following details:

   | Field                | Description                                                                   |
   | -------------------- | ----------------------------------------------------------------------------- |
   | **Integration Name** | A name identifying the provider or LLM Models group.                          |
   | **Model Name**       | The LLM name for this integration. Multiple models can use the same endpoint. |
   | **Endpoint (POST)**  | The URL to connect to the LLM via API requests.                               |

6. Select **Headers** and enter the key-value credentials:
   * **Key**: For example, `api-key`.
   * **Value**: For example, `3d4f1cOdxxxxxxxxxxxxxxx`.

7. Select the **LLM and Generative Policy guidelines** checkbox.

8. Select **Next**.

   <img src="https://mintcdn.com/koreai-content-gov/lTEIRFb39rhUrUEC/ai-for-service/agentai/configuration/custom-llm-genai/configuration-details-next-3.png?fit=max&auto=format&n=lTEIRFb39rhUrUEC&q=85&s=c7efc3421d5e751a0c0fec7b88cfa60d" alt="Configuration Details Next" width="710" height="882" data-path="ai-for-service/agentai/configuration/custom-llm-genai/configuration-details-next-3.png" />

9. Enter a JSON request body (model, prompt, or other parameters) and select **Test**.

   <img src="https://mintcdn.com/koreai-content-gov/Zez8tGV1FpH8bXGf/ai-for-service/agentai/configuration/custom-llm-genai/request-prompt-test-4.png?fit=max&auto=format&n=Zez8tGV1FpH8bXGf&q=85&s=c5a9d30c9e2aa80476e0e8bc7808df52" alt="Request Prompt Test" width="933" height="697" data-path="ai-for-service/agentai/configuration/custom-llm-genai/request-prompt-test-4.png" />

10. Select **Save**.

    <img src="https://mintcdn.com/koreai-content-gov/Zez8tGV1FpH8bXGf/ai-for-service/agentai/configuration/custom-llm-genai/connection-save-5.png?fit=max&auto=format&n=Zez8tGV1FpH8bXGf&q=85&s=242b79508e1a3c4c7f43bffe88858faa" alt="Connection Save" width="615" height="604" data-path="ai-for-service/agentai/configuration/custom-llm-genai/connection-save-5.png" />

11. Select **Create a Custom Prompt**.

    <img src="https://mintcdn.com/koreai-content-gov/Zez8tGV1FpH8bXGf/ai-for-service/agentai/configuration/custom-llm-genai/create-a-custom-prompt-6.png?fit=max&auto=format&n=Zez8tGV1FpH8bXGf&q=85&s=6789790faff9595031252ff513065ac5" alt="Create a Custom Prompt" width="609" height="389" data-path="ai-for-service/agentai/configuration/custom-llm-genai/create-a-custom-prompt-6.png" />

12. On the **Conversation Summary** page, fill in the following:

    | Field            | Description                                                                    |
    | ---------------- | ------------------------------------------------------------------------------ |
    | **Name**         | A name for the prompt. For example, *Summary Prompt*.                          |
    | **Feature**      | Select **Conversation Summary**.                                               |
    | **Choose Model** | Select the custom model you created. For example, *Custom test mode - gpt-4o*. |
    | **JSON**         | Enter your JSON content.                                                       |

    <img src="https://mintcdn.com/koreai-content-gov/Zez8tGV1FpH8bXGf/ai-for-service/agentai/configuration/custom-llm-genai/conversation-summary-page-7.png?fit=max&auto=format&n=Zez8tGV1FpH8bXGf&q=85&s=28a3b85fe41a74796ee80329c48ea94a" alt="Conversation Summary Page" width="1851" height="2075" data-path="ai-for-service/agentai/configuration/custom-llm-genai/conversation-summary-page-7.png" />

    1. Select **Test**.
    2. Enter the response path in **Text Response Path**. For example, `choices[0].message.content`.
    3. Select **Lookup Path**. The summary is generated.
    4. Select **Save**.

    <img src="https://mintcdn.com/koreai-content-gov/Zez8tGV1FpH8bXGf/ai-for-service/agentai/configuration/custom-llm-genai/lookup-path-save-8.png?fit=max&auto=format&n=Zez8tGV1FpH8bXGf&q=85&s=8c05e669d49a643016952b60a8e799ce" alt="Lookup Path Save" width="995" height="500" data-path="ai-for-service/agentai/configuration/custom-llm-genai/lookup-path-save-8.png" />

***

## Select the Custom Model

1. Sign in to **AI for Service**.
2. Go to **Agent AI** > **Generative AI Tools** > **GenAI Features**.
3. Search for `conversation summary` in the search box.
4. Select your model and prompt from the **MODEL** and **PROMPT** dropdowns.

   <img src="https://mintcdn.com/koreai-content-gov/Zez8tGV1FpH8bXGf/ai-for-service/agentai/configuration/custom-llm-genai/genai-features-model-selection-9.png?fit=max&auto=format&n=Zez8tGV1FpH8bXGf&q=85&s=488163bdfb032e145078c33532058df6" alt="GenAI Features Model Selection" width="1006" height="227" data-path="ai-for-service/agentai/configuration/custom-llm-genai/genai-features-model-selection-9.png" />

***
