Systems | Development | Analytics | API | Testing

Want to ensure that your BigQuery environment stays cost effective and secure? In this episode of BigQuery Spotlight, we’ll examine how monitoring your data warehouse can optimize costs, help you pinpoint which queries need to be optimized, and audit both data-sharing and access. Watch to learn how BigQuery gives you the flexibility to export any of these data sources back into your data warehouse for custom reporting.

Want to become more scalable with programmatic data workflows? In this episode of BigQuery Spotlight, we’ll examine BigQuery APIs so you can manage data warehousing resources, and take action on your data, programmatically and effectively.

Data harnessed through tools such as BigQuery allow organizations to deliver personalized experiences, make data-driven business decisions, and unlock new streams of revenue. In this video, we go through the challenges of putting data into action and show how APIs can help. Watch to learn how Apigee makes it simple and easy to package your business data as APIs!

Want everyone in your organization to be able to easily find the data they need, while minimizing overall risk, and ensuring regulatory compliance? In this episode of BigQuery Spotlight, we’ll examine BigQuery data governance so you can ensure your data is secure. We’ll also go over Cloud Data Loss Prevention and an open-source framework for data quality validation.

Did you know that optimizing SQL queries can be cost efficient? In this episode of BigQuery Spotlight, we speak to some strategies for optimizing your BigQuery queries. We’ll walk through what happens behind the scenes for more complex queries, and show you specific tactics you can use to optimize your SQL. Watch to learn some great techniques on how to make your queries more performant!

How does BigQuery’s internal storage work? In this episode of BigQuery Spotlight, we share how BigQuery stores data so you can make informed decisions on how to optimize your BigQuery storage. We’ll also talk about partitioning, as well as clustering and how it allows for efficient lookups.

What are jobs in BigQuery and how does the reservation model work? In this episode of BigQuery Spotlight, we’ll review jobs, reservations, and best practices for managing workload in BigQuery. We’ll also walk you through the difference between BI Engine reservations and standard reservations, so you can decide what will work best for you.

What is a BigQuery table and how does it work? In this episode of BigQuery Spotlight, we’ll review the different types of tables in BigQuery, including managed tables, external tables, and virtual tables with logical and materialized views. We’ll also walk you through the use of views, which are virtual tables defined by a SQL query.

What are folders, projects, and datasets and how do they come together to support warehousing fundamentals like security and cost management? In this episode of BigQuery Spotlight, we’ll review the BigQuery resource model and how this resource hierarchy is reflected in the Cloud Console, where you’ll interact with and analyze your BigQuery data. Moreover, we’ll give you some helpful tips when it comes to structuring your own BigQuery resources. Watch to learn the best way to structure your BigQuery deployments!

How can you replicate data from a relational database in real time? In this video, we’ll show you you can combine Datastream with Dataflow templates to replicate data from a relational database. Watch to learn how you can use this streaming analytics service in unison with Datastream to easily replicate data from Oracle to BigQuery in real time!