Connecting to Google BigQuery

1. Overview

Google BigQuery is a web service for querying massive datasets that take advantage of Google's infrastructure. The idea behind BigQuery is that you store your data on Google's Cloud Platform and then access that data via the BigQuery API.

This article shows you how to create a data connector in Dundas BI to extract data from your Google Developer project via the BigQuery API.

2. Setup

2.1. Developers Console Project

You need to create or use an existing project in the Google Developers Console as a first step. A project acts as a container in the Google Cloud Platform which stores information about billing and authorized users and also contains BigQuery data.

2.4. Enable Billing

Billing must be enabled for your Google project in order to load data into the project. If you don't have this set up yet, you can sign up for a Free Trial (which requires you to enter credit card information). Go to https://cloud.google.com/bigquery/ and click the Free Trial button in the top right corner to sign up.

Next, go back to the Google Developers Console for your project. Click the menu button in the top-left corner and then click Billing.

4. Notes

The Catalog Projects field can be used instead of the billed project to specify free catalogs such as publicdata,gdelt-bq,fh-bigquery (comma separated). If you specify catalog projects but you also want to include the billed project, you must add the billed project to the Catalog Projects field.

Under the Advanced options, there is a checkbox to Allow Large Results. Use this option to avoid data connector errors such as Response too large to return. But you also need to create a dataset for storing large results on the Google Cloud Platform. It is recommended to check the option to Expire new tables in one day when creating a dataset in the Google Cloud Platform.