Systems | Development | Analytics | API | Testing

Transforming Kong Logs for Ingestion into Your Observability Stack

As a Solutions Engineer here at Kong, one question that frequently comes across my desk is “how can I transform a Kong logging plugin message into a format that my insert-observability-stack-here understands, i.e. ELK, Loki, Splunk, etc.?” In this blog, I’m going to show you how to easily accomplish converting a Kong logging payload to the Elastic Common Schema. In order to accomplish this task, we’re going to be running Kong Gateway in Kubernetes and using two Kong plugins.

Episode 3 & 4 | Data Destination & Data Governance | Data Journey

What are data destinations? In a very abstract sense, data destination is another input along the series of process elements in a data pipeline. However, when calling out an element as the destination, it is really seen as the final destination such as a database, data lake or data warehouse. And yet, any element within the data pipeline has aspects of a final destination (and scaling challenges).

Episode 1 | Data Pipelines | Data Journey | 7 Challenges of Big Data Analytics

Where does a data journey begin? With the data pipeline. Thomas Hazel begins this 7-part series on solving the biggest data analytics challenges today by starting with the building, scaling and maintenance of data pipelines. Avoid building the Taj Mahal … every 6 months … and join the data journey with us to learn about the unique approach ChaosSearch has taken.

Data Journey | 7 Challenges of Big Data Analytics | Episode 0

How do you truly solve the challenges of today’s ever growing big data analytic needs? Join us on a data journey with ChaosSearch's CTO & Founder, Thomas Hazel as he gets technical on how to solve 7 of the biggest data challenges teams are facing - from source to insights.