BigQuery

Connect Erathos to BigQuery.

To connect to your Google BigQuery, we recommend creating a new service account exclusively for use by the Erathos platform.

This approach follows best practices, as it allows you to assign only the minimal roles needed for this service account and makes it easier to manage and revoke access when necessary.

If you dont have a Google BigQuery, we can host for you. Referer to Hosted by Erathos

Creating a service account

To create a service account, follow these steps:

  1. Navigate to the IAM & Admin Section

    • From the main menu, go to IAM & Admin > Service Accounts.

  2. Create a New Service Account

    • Click on the + CREATE SERVICE ACCOUNT button.

    • Provide a Name and Description for the service account to help identify its purpose, e.g., "Erathos Access Account."

  3. Set Permissions

    • On the same screen, assign roles to the service account. For minimal access, assign only the following roles needed for Erathos to connect to your BigQuery:

      • BigQuery Data Editor.

      • BigQuery Job User.

      • BigQuery Metadata Viewer.

      • BigQuery User.

    • Click Continue.

  4. Generate a Key for the Service Account

    • After creating the service account, locate it in the Service Accounts list and click on it.

    • Go to the Keys tab, click ADD KEY > Create new key.

    • Select JSON as the key type and click Create to download the key file. This file is essential for authenticating Erathos with Google BigQuery.

Connect to Erathos

To connect Erathos to your BigQuery:

  1. Create a New Destination

    • Go to Settings > Data Warehouse.

    • Select Google BigQuery.

  2. Fill Out the Form

    • Check the box for Self-hosted.

    • Upload the JSON file obtained from the previous step

    • Select the region where your data will be hosted (if unsure, we recommend using US).

  3. Complete the Setup.

If you need help connecting to your BigQuery, reach out to our team at [email protected].

Sandbox mode

BigQuery Sandbox is a free usage tier that allows you to explore BigQuery without providing billing information. However, it comes with limitations — such as restricted storage, query usage, and no access to features like DML (Data Manipulation Language) operations.

How to Disable Sandbox Mode To disable Sandbox mode, you need to enable billing for your Google Cloud project.

  1. Go to the Google Cloud Console.

  2. Open your project.

  3. Navigate to Billing and link a billing account. Once billing is enabled, your project will automatically exit Sandbox mode, unlocking full BigQuery functionality.

Enabling billing does not mean you will be charged immediately. Google Cloud offers a generous free tier for BigQuery, which includes free monthly quotas for storage and queries. As long as your usage stays within these limits, you won’t incur any charges.

Last updated