Skip to Content
Main Content

Hiker looking out over the mountains

5 Minute Read | April 3, 2023

Why You Should Use BigQuery with GA4

A hidden benefit of GA4 is free integration with BigQuery, part of the Google Cloud Platform. Technically, BigQuery is a Structured Query Language table. But think of it as a large storage bucket where you can back up or duplicate your GA4 data.

Why Would You Want to Use BigQuery?

The backup of GA4 data is reason enough to use BigQuery. But the biggest reason is to have a data set you can analyze and segment to your heart’s content while keeping the data as long as you want.

Data Retention Settings

What? Keep the data for as long as you want?

The default setting for data retention is two months. But, in the free version of GA4, you can set retention to a maximum of 14 months. Go to GA Admin > Data Settings > Data Retention, as shown in the screenshot below.

A screenshot of the BigQuery Admin screen that shows where Data Retention settings are found.

After 14 months, you lose access to the data in the Explore section of GA4. That data will always be accessible in the standard GA4 reports, but you won’t be able to further segment and analyze data older than 14 months in an Exploration. The screenshot below shows where the date range stops.

A screenshot of the GA4 Explore section that shows when the date range for data retention stops.

That 14-month data retention setting in GA4 does not apply to BQ, however. Once the data is exported to BQ, it will stay there until you purge it.

Looker Studio Quotas

Another reason to set up BQ is to use the data with Looker Studio (previously called Google Data Studio).

When you set up a report in Looker Studio, you can choose from several different data sources, including

  1. Google Analytics
  2. BigQuery

A screenshot of Google Looker Studio data sources.

Option 1, Google Analytics, draws data from the GA4 API. Unfortunately, the GA4 API has quotas (“tokens”) on how much information you can request. If you develop a complex set of reports or share your LS reports with a group of people, you could quickly hit the quota and the reports will fail.

Active users of Looker Studio will see that 25,000 daily tokens or 5,000 hourly tokens can be used up surprisingly quickly.

A screenshot of GA4 Token Usage.

When you connect Looker Studio to BQ, however, those quotas and limitations don’t apply.

Looker Studio Speed

Speed is another advantage of using Looker Studio with BigQuery.

Reports with BQ as the data source run much faster than reports that go directly against the GA4 API.

Faster reports, no quotas, and no limitations – sounds like the ideal solution for your data visualization needs!

But I Don’t Know SQL!

You don’t need to know Structured Query Language to set up and use BQ. While it might be helpful, you don’t need SQL knowledge to run your Looker Studio reports, for example.

You can even use third-party tools, such as SuperMetrics or AnalyticsCanvas, to get an easier and cleaner front-end to the data. These tools help you build your queries through an interactive GUI, which will return cleaner queries than you could probably imagine.

Also, you can always find people with SQL chops, so help will be at hand with any gnarly analyses.

Is BigQuery Expensive?

BQ pricing can be confusing. The good news: For most small and medium-sized businesses, it’s likely to be free.

You can try BQ for free in a sandbox environment and collect up to 60 days of GA4 data, giving you an excellent idea of how much data your website throws off. This will also give you an excellent idea of the ultimate cost.

BigQuery Pricing

BQ pricing breaks down into two categories:

  • Analysis processing (i.e., running queries against your data)
  • Storage – how much data you’re storing.

Analysis Pricing

Every time you analyze your data by running a query against it, you incur cost.

There are two pricing levels – on-demand and flat-rate. Most SMBs will use on-demand; flat-rate is, in most cases, for larger enterprises.

The on-demand pricing is free for up to 1 TB of monthly queries, and $5/TB after that. Each time you run a query, you’ll see how much that particular query costs.

Here’s a fairly typical query for all the campaign, source, and medium information for a mid-sized organization. The date range is about 2.5 months.

An image showing a typical BQ query for all the campaign, source, and medium information for a mid-sized organization.

This particular query will “cost” you 301 MB of your 1 TB monthly limit, or approximately 0.3% of your monthly budget.

That’s not bad, unless you’re running a bunch of similar queries, in which case you have alternatives such as caching responses, using AnalyticsCanvas to optimize your queries, etc.  Let’s say you go wild and run 6TB worth of queries - your monthly cost for that will be $25. Won’t break the bank!

Storage Costs

Storage is the other BQ expense. You get 10 GB of storage free each month. How long it takes to get to that level depends, of course, on your traffic.

Let’s look again at that mid-sized company mentioned above.

They have a fair amount of weekly/daily traffic:

A screenshot of Google Analytics showing event counts, users, conversions and sessions.

Their average daily storage in BQ is between 50 and 60 MB. 

An image showing the average amount of daily storage being used in BigQuery.

To get to 10 GB will take about 166 days – let’s call it half a year. Every six months, they’ll use an additional 10GB of storage, which will cost all of $0.20. After five years, at this growth rate, their monthly expense will be $2. Quite a bargain!

Follow this link to get additional information on the BQ pricing model.

BigQuery Limitations

A standard GA4 account can export up to 1 million events per day to BQ. Again, this won’t be an issue for most SMBs. Even though everything in GA4 is an event, 1 million daily events is a lot. That account we looked at earlier, which showed 384 users in the last 30 minutes, had 485k events over the last week, or roughly 70k events per day. They’d have to grow massively to hit 1 million daily events.

Obviously, some websites will exceed 1 million daily events. For those sites, the GA360 paid account probably makes sense.

Next Steps

I hope I’ve made a convincing case for why you should take advantage of the free integration that GA4 offers with BQ.

To use BQ, you’ll need to set up a Google Cloud Platform account. I won’t go into the many options and permutations of this here, but the process is, in general, fairly quick.

At a minimum, set up the free Sandbox in BigQuery and start collecting your GA4 data so you can estimate how much it will actually cost.

If you have any questions about the best way to set up Google Cloud Platform, or how to integrate GA4 with BigQuery, our expert team is here to help! Don’t hesitate to reach out to us.

Authored By

Fred Pike

Fred Pike

Managing Director & GA/GTM Practice Lead

hand-drawn owl

Get Expert Tips

4051912/Blog/Why-You-Should-Use-BigQuery-with-GA45
<p>A hidden benefit of GA4 is free integration with BigQuery, part of the Google Cloud Platform. Technically, BigQuery is a Structured Query Language table. But think of it as a large storage bucket where you can back up or duplicate your GA4 data.</p> <h2>Why Would You Want to Use BigQuery?</h2> <p>The backup of GA4 data is reason enough to use BigQuery. But the biggest reason is to have a data set you can analyze and segment to your heart&rsquo;s content while keeping the data as long as you want.</p> <h2>Data Retention Settings</h2> <p>What? Keep the data for as long as you want?</p> <p>The default setting for data retention is two months. But, in the free version of GA4, you can set retention to a maximum of 14 months. Go to GA Admin &gt; Data Settings &gt; Data Retention, as shown in the screenshot below.</p> <p><img alt="A screenshot of the BigQuery Admin screen that shows where Data Retention settings are found." loading="lazy" src="/Northwoods-2020/Blogs/BigQuery-1.jpg" /></p> <p>After 14 months, you lose access to the data in the Explore section of GA4. That data will always be accessible in the standard GA4 reports, but you won&rsquo;t be able to further segment and analyze data older than 14 months in an Exploration. The screenshot below shows where the date range stops.</p> <p><img alt="A screenshot of the GA4 Explore section that shows when the date range for data retention stops." loading="lazy" src="/Northwoods-2020/Blogs/BigQuery-2.jpg?Large" /></p> <p>That 14-month data retention setting in GA4 does not apply to BQ, however. Once the data is exported to BQ, it will stay there until you purge it.</p> <h2>Looker Studio Quotas</h2> <p>Another reason to set up BQ is to use the data with Looker Studio (previously called Google Data Studio).</p> <p>When you set up a report in Looker Studio, you can choose from several different data sources, including</p> <ol> <li>Google Analytics</li> <li>BigQuery</li> </ol> <p><img alt="A screenshot of Google Looker Studio data sources." loading="lazy" src="/Northwoods-2020/Blogs/BigQuery-3.jpg" /></p> <p>Option 1, Google Analytics, draws data from the GA4 API. Unfortunately, the GA4 API has quotas (&ldquo;tokens&rdquo;) on how much information you can request. If you develop a complex set of reports or share your LS reports with a group of people, you could quickly hit the quota and the reports will fail.</p> <p>Active users of Looker Studio will see that 25,000 daily tokens or 5,000 hourly tokens can be used up surprisingly quickly.</p> <p><img alt="A screenshot of GA4 Token Usage." loading="lazy" src="/Northwoods-2020/Blogs/BigQuery-4.jpg?Large" /></p> <p>When you connect Looker Studio to BQ, however, those quotas and limitations don&rsquo;t apply.</p> <h2>Looker Studio Speed</h2> <p>Speed is another advantage of using Looker Studio with BigQuery.</p> <p>Reports with BQ as the data source run much faster than reports that go directly against the GA4 API.</p> <p>Faster reports, no quotas, and no limitations &ndash; sounds like the ideal solution for your data visualization needs!</p> <h2>But I Don&rsquo;t Know SQL!</h2> <p>You don&rsquo;t need to know Structured Query Language to set up and use BQ. While it might be helpful, you don&rsquo;t need SQL knowledge to run your Looker Studio reports, for example.</p> <p>You can even use third-party tools, such as SuperMetrics or AnalyticsCanvas, to get an easier and cleaner front-end to the data. These tools help you build your queries through an interactive GUI, which will return cleaner queries than you could probably imagine.</p> <p>Also, you can always find people with SQL chops, so help will be at hand with any gnarly analyses.</p> <h2>Is BigQuery Expensive?</h2> <p>BQ pricing can be confusing. The good news: For most small and medium-sized businesses, it&rsquo;s likely to be free.</p> <p>You can try BQ for free in a sandbox environment and collect up to 60 days of GA4 data, giving you an excellent idea of how much data your website throws off. This will also give you an excellent idea of the ultimate cost.</p> <h3>BigQuery Pricing</h3> <p>BQ pricing breaks down into two categories:</p> <ul> <li>Analysis processing (i.e., running queries against your data)</li> <li>Storage &ndash; how much data you&rsquo;re storing.</li> </ul> <h3>Analysis Pricing</h3> <p>Every time you analyze your data by running a query against it, you incur cost.</p> <p>There are two pricing levels &ndash; on-demand and flat-rate. Most SMBs will use on-demand; flat-rate is, in most cases, for larger enterprises.</p> <p>The on-demand pricing is free for up to 1 TB of monthly queries, and $5/TB after that. Each time you run a query, you&rsquo;ll see how much that particular query costs.</p> <p>Here&rsquo;s a fairly typical query for all the campaign, source, and medium information for a mid-sized organization. The date range is about 2.5 months.</p> <p><img alt="An image showing a typical BQ query for all the campaign, source, and medium information for a mid-sized organization." loading="lazy" src="/Northwoods-2020/Blogs/BigQuery-5.jpg" /></p> <p>This particular query will &ldquo;cost&rdquo; you 301 MB of your 1 TB monthly limit, or approximately 0.3% of your monthly budget.</p> <p>That&rsquo;s not bad, unless you&rsquo;re running a bunch of similar queries, in which case you have alternatives such as caching responses, using AnalyticsCanvas to optimize your queries, etc.&nbsp; Let&rsquo;s say you go wild and run 6TB worth of queries - your monthly cost for that will be $25. Won&rsquo;t break the bank!</p> <h3>Storage Costs</h3> <p>Storage is the other BQ expense. You get 10 GB of storage free each month. How long it takes to get to that level depends, of course, on your traffic.</p> <p>Let&rsquo;s look again at that mid-sized company mentioned above.</p> <p>They have a fair amount of weekly/daily traffic:</p> <p><img alt="A screenshot of Google Analytics showing event counts, users, conversions and sessions." loading="lazy" src="/Northwoods-2020/Blogs/BigQuery-6.jpg" /></p> <p><span style="font-size:11pt"><span style="line-height:115%"><span style="font-family:Arial,sans-serif">Their average daily storage in BQ is between 50 and 60 MB.&nbsp; </span></span></span></p> <p><img alt="An image showing the average amount of daily storage being used in BigQuery." loading="lazy" src="/Northwoods-2020/Blogs/BigQuery-7.jpg" /></p> <p>To get to 10 GB will take about 166 days &ndash; let&rsquo;s call it half a year. Every six months, they&rsquo;ll use an additional 10GB of storage, which will cost all of $0.20. After five years, at this growth rate, their monthly expense will be $2. Quite a bargain!</p> <p><a href="https://cloud.google.com/bigquery/pricing" linktype="3" target="_blank">Follow this link</a> to get additional information on the BQ pricing model.</p> <h2>BigQuery Limitations</h2> <p>A standard GA4 account can export up to 1 million events per day to BQ. Again, this won&rsquo;t be an issue for most SMBs. Even though everything in GA4 is an event, 1 million daily events is a lot. That account we looked at earlier, which showed 384 users in the last 30 minutes, had 485k events over the last week, or roughly 70k events per day. They&rsquo;d have to grow massively to hit 1 million daily events.</p> <p>Obviously, some websites will exceed 1 million daily events. For those sites, the GA360 paid account probably makes sense.</p> <h2>Next Steps</h2> <p>I hope I&rsquo;ve made a convincing case for why you should take advantage of the free integration that GA4 offers with BQ.</p> <p>To use BQ, you&rsquo;ll need to set up a Google Cloud Platform account. I won&rsquo;t go into the many options and permutations of this here, but the process is, in general, fairly quick.</p> <p>At a minimum, set up the free Sandbox in BigQuery and start collecting your GA4 data so you can estimate how much it will actually cost.</p> <p><em>If you have any questions about the best way to set up Google Cloud Platform, or how to integrate GA4 with BigQuery, our expert team is here to help! Don&rsquo;t hesitate to <a href="/Contact-Us" linktype="2" target="_self">reach out</a> to us.</em></p> <p><span style="font-size:11pt"><span style="line-height:115%"><span style="font-family:Arial,sans-serif"></span></span></span></p> <p><span style="font-size:11pt"><span style="line-height:115%"><span style="font-family:Arial,sans-serif"></span></span></span></p> <p><span style="font-size:11pt"><span style="line-height:115%"><span style="font-family:Arial,sans-serif"></span></span></span></p> <p><span style="font-size:11pt"><span style="line-height:115%"><span style="font-family:Arial,sans-serif"></span></span></span></p>
/Northwoods-2020/Hero-Images/Hiker-Looking-Out-Over-Mountains.pngHiker looking out over the mountainsThe backup of #GA4 data is reason enough to use #BigQuery. But the biggest reason is to have a data set you can analyze and segment to your heart’s content while keeping the data as long as you want. https://nwsdigital.me/3zj03hr @northwoods #webanalyticsFred Pike/Northwoods-2020/People/Fred-Pike.jpgMan standing in front of a log cabin with soft, warm lightinghttps://ctt.ac/LgBD9<script charset="utf-8" type="text/javascript" src="//js.hsforms.net/forms/embed/v2.js"></script><script>hbspt.forms.create({ region: "na1", portalId: "23630176", formId: "40c5bbae-05a2-42ea-94dd-1662181fd56e" });</script>/Northwoods-2023/Blog/Social-Cards/Why-You-Should-Use-BigQuery-with-GA4---Social-Card.jpg?LargeWhy You Should Use BigQuery with GA42023-04-03T00:00:00/Northwoods-2023/Blog/Social-Cards/Why-You-Should-Use-BigQuery-with-GA4---Social-Card.jpgA hidden benefit of GA4 is free integration with BigQuery, part of the Google Cloud Platform. Here's why you'll want to use it.3620311/People/Fred-PikeFredPikeManaging Director & GA/GTM Practice Lead<p>Fred Pike is Northwoods&#39; resident analytics guru and a world-renowned expert in Google Analytics and Google Tag Manager. A sought-after speaker and educator, he has led courses at industry-leading conferences, events, and organizations including Conversion XL, MeasureSummit, and SuperWeek. Fred is passionate about finding the best ways to drive website traffic and understanding user interactions. He is also an accomplished pit musician and proud owner of beloved Pekingese Xuxa, one of Northwoods&rsquo; most frequent furry visitors.</p>Fred Pike/Northwoods-2020/People/Fred-Pike.jpgFred PikeAdd-In Type - NWS Data ModulesCategory - NWS Data ModulesCommittee - NWS Data ModulesDivision - NWS Data ModulesEvent Audience - NWS Data ModulesEvent Service - NWS Data ModulesEvent Type - NWS Data ModulesLocality - NWS Data ModulesModule - NWS Data ModulesNWS Data ModulesTopic - NWS Data ModulesPackage Type - NWS Data ModulesPersonID - NWS Data ModulesFred PikeProductVersion - NWS Data ModulesRecorded Webinar TopicsRegion - NWS Data ModulesSite Display - NWS Data ModulesSkillLevel - NWS Data ModulesTopic - NWS Data ModulesVideoAudience - NWS Data ModulesVideoClassification - NWS Data ModulesVideoStatus - NWS Data ModulesTeamAll StaffLeadershipAdd-In Type - NWS Data ModulesCategory - NWS Data ModulesCommittee - NWS Data ModulesDivision - NWS Data ModulesEvent Audience - NWS Data ModulesEvent Service - NWS Data ModulesEvent Type - NWS Data ModulesLocality - NWS Data ModulesModule - NWS Data ModulesNWS Data ModulesTopic - NWS Data ModulesData & AnalyticsDigital MarketingPackage Type - NWS Data ModulesPersonID - NWS Data ModulesFred PikeProductVersion - NWS Data ModulesRecorded Webinar TopicsRegion - NWS Data ModulesSite Display - NWS Data ModulesNWS DigitalSkillLevel - NWS Data ModulesTopic - NWS Data ModulesVideoAudience - NWS Data ModulesVideoClassification - NWS Data ModulesVideoStatus - NWS Data Modules02024-04-04T11:41:16.22000