Systems | Development | Analytics | API | Testing

SQL for data exploration in a multi-Kafka world

Every enterprise is modernizing their business systems and applications to respond to real-time data. Within the next few years, we predict that most of an enterprise's data products will be built using a streaming fabric – a rich tapestry of real-time data, abstracted from the infrastructure it runs on. This streaming fabric spans not just one Apache Kafka cluster, but dozens, hundreds, maybe even thousands of them.

How to Fix the OutOfMemoryError in Java

Picture this: It's Black Friday, and you're circling a packed mall parking lot. Every space is taken, and cars are lined up waiting for spots. You keep circling, but there’s just no place to park and you run out of gas. When you see a java.lang.OutOfMemoryError it’s just like what you experienced in that overcrowded parking lot. The Java Virtual Machine (JVM) has run out of space to "park" new objects in memory. Now here's the thing about Java: it loves objects. It can't get enough of them.

Govern an Open Lakehouse with Snowflake Open Catalog, a Managed Service for Apache Polaris

To enhance security and ease operational burden, many organizations with data lakes or lakehouses want flexibility to securely integrate their tools of choice on a single copy of data. An open standard for storage format and catalog API has helped, but there’s still a need for open standards for the catalog, including a consistent way to apply security access controls to data.

Why Do You Need to Test Your MVP?

More often in today’s society of growing ‘entrepreneurs’, almost all are developing Minimum Viable Products MVPs that breathe life into their concepts. A shocking but true statistic reveals that 90% of startups fail. One big reason for this is the poor execution of a key tool in the startup world: the minimum viable product (MVP). One of the reasons for this failure is the lack of tests conducted appropriately.

Clearinghouse Alternatives for Data Integration

In the world of data management, clearinghouses often serve as intermediaries, enabling secure data transactions across different platforms and ensuring compliance with industry regulations. However, as data management needs evolve, businesses are increasingly looking for alternatives to clearinghouses that offer more flexibility, control, and advanced features.

How to Manage Your API Policies with OPA (Open Policy Agent)

APIs are essential to modern applications, but managing access and security policies can be complex. Traditional access control mechanisms can fall short when flexible, scalable, and fine-grained control over who can access specific resources is needed. This is where OPA (Open Policy Agent) steps in. OPA provides a unified framework for consistently defining and enforcing policies across microservices, APIs, Kubernetes clusters, and beyond. Consistent policy management is essential for enterprises.