# Databricks

{% hint style="info" %}
You can connect the Erathos platform to **any Databricks instance**, regardless of the cloud environment it is hosted in (AWS, Azure, or Google Cloud).
{% endhint %}

To connect to your Databricks SQL warehouse the following information is necessary: **Server Hostname**, **HTTP path** and **Catalog Name**. Furthermore, you must choose either [**Personal Access Token (PAT)**](#personal-access-token) or [**OAuth**](#oauth) as an authentication method.

The tutorial below shows you how to obtain these credentials.

## Databricks Setup 

### Create a SQL Warehouse (Optional) 

The first step is to create a new SQL Warehouse. If you already have an existing one, you can skip this step.

In the sidebar menu select **SQL Warehouse** and then click on the **Create SQL Warehouse** on the right side of the screen. A quick configuration window will be shown.

<figure><img src="https://2158418640-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FovVtDtJhcLYgikyBBku0%2Fuploads%2FR8L3AB7NJDOIMq1GGZ1B%2Fimage.png?alt=media&#x26;token=60b228b3-6954-42d3-8a9c-de88c04d32ef" alt=""><figcaption></figcaption></figure>

Name your SQL warehouse and adjust the hardware settings according to your usage needs (i.e., cluster size, auto stop, scaling). When the configuration is done, click on **Create**.

### Basic Credentials

Select the desired SQL Warehouse and navigate to the **Connection details** tab to obtain the **Server Hostname** and **HTTP path** credentials.

<figure><img src="https://2158418640-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FovVtDtJhcLYgikyBBku0%2Fuploads%2FFwLhjusWrDIS3G8W2YGs%2Fimage.png?alt=media&#x26;token=357bfc8a-7457-4a81-9bb9-657e9bf1745f" alt=""><figcaption></figcaption></figure>

Identify the **Catalog Name** by selecting **Catalog** in the left sidebar and checking the list of available catalogs at the SQL Warehouse. Choose the name of one of the available options or create a new catalog.&#x20;

After clicking on a catalog option, navigate to **Permissions** tab and confirm that the appropriate user credentials have **Data editor** privileges in the catalog (the owner of the access token or the service principal for OAuth method).

<figure><img src="https://2158418640-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FovVtDtJhcLYgikyBBku0%2Fuploads%2F3ZCxevNi0I2GBW5HfNZc%2FScreenshot%20from%202025-09-16%2018-04-03.png?alt=media&#x26;token=c808ef0c-bd36-4dcb-8b1c-cc38ee0ff78d" alt=""><figcaption></figcaption></figure>

### Personal Access Token

In the **Connection Details** tab for the chosen SQL Warehouse, select the **Create a personal access token** option to create a new **Access Token**:

<figure><img src="https://2158418640-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FovVtDtJhcLYgikyBBku0%2Fuploads%2Fg85EoHc253BiFoIygqqE%2FScreenshot%20from%202025-09-16%2018-20-07.png?alt=media&#x26;token=eb954f40-e4ff-4d1d-82ea-07e272655828" alt=""><figcaption></figcaption></figure>

Click the **Generate new token** button, name the new token for identification purposes, and specify how long before the token should expire.

**Warning**:  the token value will not be exhibited again, so confirm you have copied and pasted it somewhere safe.

<figure><img src="https://2158418640-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FovVtDtJhcLYgikyBBku0%2Fuploads%2F7fHowBOXiOzdJko4PLv2%2FScreenshot%20from%202025-09-16%2018-21-12.png?alt=media&#x26;token=da67053c-a091-4654-9aaf-9d046e755b26" alt=""><figcaption></figcaption></figure>

### OAuth

Navigate to the Databricks accounts [initial page](https://accounts.cloud.databricks.com/) and click on **User Management** in the sidebar. Then, select the **Service Principals** tab and click on the **Add service principal** button.

<figure><img src="https://2158418640-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FovVtDtJhcLYgikyBBku0%2Fuploads%2FQs4tTj8FInjxP0CszBQ5%2FScreenshot%20from%202025-09-17%2010-35-09.png?alt=media&#x26;token=d911731c-f591-4eee-ae8a-f7e6167fffcf" alt=""><figcaption></figcaption></figure>

In order to facilitate identifying the credential used for Erathos connection name it appropriately. Click on **Add service principal** to complete the creation process.&#x20;

Returning to the list of available service principals, click on your newly created one. Head to the **Credentials & secrets** tab.

<figure><img src="https://2158418640-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FovVtDtJhcLYgikyBBku0%2Fuploads%2FeBuynhsSdIrekl6CBJ8y%2FScreenshot%20from%202025-09-17%2010-36-34.png?alt=media&#x26;token=d22a1e0d-4b6d-4e92-9149-f2836e302f15" alt=""><figcaption></figcaption></figure>

Click on the **Generate secret** button at the bottom of the page to create a new pair of values for **Client ID / Client Secret**.

**Warning**: the secret value will not be exhibited again, so confirm you have copied and pasted it somewhere safe.

Next, you will need to confirm the workspace's access permissions for the new service principal. To do so, select **Workspaces** in the sidebar and click on the chosen workspace.

Navigate to **Permissions** tab and click on **Add permissions** to open a dialog window.

<figure><img src="https://2158418640-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FovVtDtJhcLYgikyBBku0%2Fuploads%2Fn79by0lFvNyo9PhYfC5Q%2FScreenshot%20from%202025-09-17%2010-42-17.png?alt=media&#x26;token=bd8c2ecd-f504-4e96-bec4-c62abdad13d0" alt=""><figcaption></figcaption></figure>

Search the service principal by typing the name you chose earlier and complete the process by selecting the level of access attributed to the principal credentials.

## Connect to Erathos

To connect Erathos to your Databricks:

1. **Create a New Destination**
   * Go to **Settings** > **Destination**.
   * Select **Databricks**.
2. **Fill Out the Form**
   * Set the **Server Hostname, HTTP path** and **Catalog Name**.
   * Choose between [Personal Access Token (PAT)](#personal-access-token) or [OAuth](#oauth) authentication method:
     * (PAT) Paste the user **Access Token** value.
     * (OAuth) Paste the service principal's **Client ID** and **Client Secret**.
3. **Complete the Setup**

{% hint style="info" %}
If you need help connecting to your Databricks, reach out to our team at <support@erathos.com>.
{% endhint %}


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.erathos.com/destinations/databricks.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.