When approaching machine learning operations, the options can be overwhelming. There may be multiple solutions available for each step in the process, and the most popular (usually open source tools) may not necessarily be good or easy to use, but they are free.
Databricks’ 2023 State of Data + AI report highlights the importance of the modern data stack in leveraging AI.
Artificial intelligence (AI) has reached a tipping point in the public consciousness. Much of this has been driven by technology developments related to large language models (LLMs) and the release of generative AI tools, including ChatGPT from OpenAI. However, for enterprises shaping forward-looking AI strategy, a critical part of the conversation that needs to be addressed is the issue of private AI vs. public AI.
How BigQuery’s ML inference engine can be used to run inferences against unstructured data in BigQuery using Vertex AI pre-trained models.
00:00 - Intro
01:29 - Remotely Executing Task
06:49 - Model Repository
09:10 - Workers and Queues
17:27 - Workers on K8s
19:14 - Pipelines
31:20 - Triggerscheduler
39:05 - Github CI/CD Templates
39:36 - Outro
