Systems | Development | Analytics | API | Testing

Apache Kafka Message Compression

Apache Kafka® supports incredibly high throughput. It’s been known for feats like supporting 20 million orders per hour to get COVID tests out to US citizens during the pandemic. Kafka's approach to partitioning topics helps achieve this level of scalability. Topic partitions are the main "unit of parallelism" in Kafka. What’s a unit of parallelism? It’s like having multiple cashiers in the same store instead of one.

Technology Spotlight: Open Data Lakehouse for Private Cloud

Cloudera emphasizes the importance of trusted data for reliable AI. We've introduced Open Data Lakehouse for private cloud, incorporating Apache Iceberg for enhanced data management and security. This empowers analysts and data scientists with direct access to all data, including real-time streaming. Iceberg's capabilities reduce silos, lower storage costs, and mitigate business risks. We also focus on scalability, introducing features like snapshots and user quotas in Apache Ozone. Cloudera prioritizes enterprise readiness with Zero Downtime Upgrades and broader hardware and software support.

AWS, Qlik, and SAP Data: Turning the Lifeblood of Business into Value and Action

One of my favorite analogies is that data is the lifeblood of the business. Before you roll your eyes at me (I see it now), hear me out. At your annual physical, when you get your blood work done, think of how much information is uncovered about your overall health from a tiny vial of your blood. From those 10 CCs they extract comes back pages of information regarding your cell counts, glucose, cholesterol, and other information.

Building Airtight Data Security Architecture in Growing Businesses

In the second installment of Mavericks of Data, we have an engaging discussion with Mahesh Krishnan, CTO of Fujitsu Australia and innovator, thought leader, author, speaker, and passionate technologist who has over 30 years of experience in the IT sector. Mahesh talks about his role within Fujitsu, the recent developments and key considerations in data security, setting up data security within growing businesses and the challenges revolving around data sensitivity.

Fine-Tuning a Foundation Model for Multiple Tasks

In this video we discuss the reasons why fine-tuning is needed to create mroe contextual accurate LLMs, and the methods that you can do to accomplish this. We also give a demo of our newest Applied ML Prototype (AMP) which demonstrates how to implement LLM fine-tuning jobs that make use of the QLoRA and Accelerate implementations available in the PEFT open-source library from Huggingface and an example application that swaps the fine-tuned adapters in real time for inference targetting different tasks. Learn more at cloudera.com#ai #ml.

Telecommunications Data Monetization Strategies in 5G and beyond with Cloudera and AWS

The world is awash with data, no more so than in the telecommunications (telco) industry. With some Cloudera customers ingesting multiple petabytes of data every single day— that’s multiple thousands of terabytes!—there is the potential to understand, in great detail, how people, businesses, cities and ecosystems function.