Systems | Development | Analytics | API | Testing

Securely Connect to LLMs and Other External Services from Snowpark

Snowpark is the set of libraries and runtimes that enables data engineers, data scientists and developers to build data engineering pipelines, ML workflows, and data applications in Python, Java, and Scala. Functions or procedures written by users in these languages are executed inside of Snowpark’s secure sandbox environment, which runs on the warehouse.

Streaming Pipelines With Snowflake Explained In 2 Minutes

Streaming data has been historically complex and costly to work with. That's no longer the case with Snowflake's streaming capabilities. Together, Snowpipe Streaming and Dynamic Tables (in public preview) break the barrier between batch and streaming systems. Now you can build low-latency data pipelines with serverless row-set ingestion and declarative pipelines with SQL. You can easily adapt to your business requirements to change latency as a single parameter.

Sprint2Cloud: A Quicker Way to Get Through Cloud Migrations

In today’s high-velocity digital arena, businesses are thrust into the whirlwind of global events, rapid technological advancements, and the incessant push for innovation. Yet, amidst the tempest of mergers, digital acceleration, and shifting tech paradigms, charting a confident path towards cloud migration can be daunting.

How Financial Services and Insurance Streamline AI Initiatives with a Hybrid Data Platform

With the emergence of new creative AI algorithms like large language models (LLM) fromOpenAI’s ChatGPT, Google’s Bard, Meta’s LLaMa, and Bloomberg’s BloombergGPT—awareness, interest and adoption of AI use cases across industries is at an all time high. But in highly regulated industries where these technologies may be prohibited, the focus is less on off the shelf generative AI, and more on the relationship between their data and how AI can transform their business.

Design and Deployment Considerations for Deploying Apache Kafka on AWS

Various factors can impede an organization's ability to leverage Confluent Cloud, ranging from data locality considerations to stringent internal prerequisites. For instance, specific mandates might dictate that data be confined within a customer's Virtual Private Cloud (VPC), or necessitate operation within an air-gapped VPC. However, a silver lining exists even in such circumstances, as viable alternatives remain available to address these specific scenarios.

New Fivetran connector streamlines data workflows for real-time insights

In a survey by the Harvard Business Review, 87% of respondents stated their organizations would be more successful if frontline workers were empowered to make important decisions in the moment. And 86% of respondents stated that they needed better technology to enable those in-the-moment decisions. Those coveted insights live at the end of a process lovingly known as the data pipeline.

Choosing the Right ETL Tool for Google BigQuery Storage

Google BigQuery is a robust and scalable cloud-based data warehouse that allows storing and analyzing vast amounts of data. BigQuery is a natural choice if your data already exists on the Google Cloud Platform (GCP). But before you leverage the platform, you need to extract the source data, carry out transformations, and load the data into your data lake or warehouse. This is where the ETL process and the ETL tools play a significant role.