Systems | Development | Analytics | API | Testing

Lightweight Batch Streaming

What’s an easy, low-cost way to batch stream data into Snowflake in near real-time? In this episode of Snowflake Bytes, Felipe Hoffa uses RSVP data from Meetup to demonstrate how you can use Google Cloud Pub/Sub and Snowpipe to do just that. Meetup publishes about 4 thousand RSVPs for events per hour that it can use to analyze what’s happening around the world. In the video, you’ll find a link to Hoffa’s blog post, which shares the code he used to create a lightweight pipeline to automatically ingest each of these files into Snowflake so that they can be queried.

Data Legends Podcast: Differentiate or Drown: Managing Modern-Day Data

What are the top three mega trends for data leaders this year (and beyond)? In this episode, we tackle cloud data platforms, the five sub disciplines of observability, and real-time machine learning. Listen to our conversation with Kevin Petrie, Vice President of Research at Eckerson Group. Hear the Answers to these Questions: Why a cloud data platform is a common destination with many routes? Which tools to standardize the different classes of observability? How the interrelationship between model observability and ML works?