Systems | Development | Analytics | API | Testing

ELK is the acronym for three open source projects where E stands for Elasticsearch, L stands for Logstash and K stands for Kibana. ELK is a robust solution for log management and data analysis. In this blog, I am going to show you how to configure ELK while working with Talend Cloud. The blog will focus on Loading Streaming Data into Amazon ES from Amazon S3.

In my experience as a digital consultant for Google Cloud’s Apigee team, I’ve found that when a technology gets classified as “middleware,” it’s often encumbered with a scarlet letter of sorts. Business leaders find it unexciting — so much so that they often resign it to the purview of technology professionals and don’t spare a second thinking about it.

You’ve likely heard of the term CI/CD pipeline. You have probably known about these practices: continuous integration, continuous delivery, and continuous deployment as well. But the uncertainty remains: What are the differences between continuous delivery and continuous deployment? Which one should you apply to your CI/CD pipeline? How are these terms related to one another? How to find out which one suits your team best?

Traditional tools for managing data integrity, such as data quality, governance and stewardship tools, were targeted at the most skilled data experts. With the advent of social networks, machine learning and smart pattern recognition technologies, these tools are getting simpler at every release. They now allow anyone with market or customer knowledge to contribute and collaborate in a data governance effort.

The answer to creating an inclusive data culture is in your hands. At Yellowfin, we firmly believe that organisations are far more successful when all their people engage with data. And whilst this has always been the goal of organisations on their journey to being “data-led”, the reality is most are still a long way off. For this to happen, all decision makers need access to insights, in a way that they can understand, not just the data analysts.