(Quardia/Shutterstock)
Confluent, a platform that simplifies real-time information streaming and system integration, introduced the most recent model of its flagship product, Confluent Cloud, on the Present 2024, held this 12 months in Austin, TX.
The occasion was attended by information practitioners, together with builders, architects, operators, and leaders driving information purposes inside their organizations.
Companies are more and more turning to stream processing for real-time purposes in machine studying (ML), predictive upkeep, personalised suggestions, and fraud detection. This strategy permits organizations to seamlessly combine and enrich their information throughout varied features.
Apache Kafka serves as a basis for information streaming, whereas Apache Flink delivers real-time processing capabilities. Confluent builds on and integrates these applied sciences to offer a strong and full resolution for information streaming and processing.
Though Apache Flink has emerged because the de facto normal for stream processing, it continuously faces challenges with operational complexity, safety considerations, and excessive infrastructure prices.
Confluent Cloud is a managed information streaming platform that simplifies information motion between purposes, initially constructed on Apache Kafka and not too long ago expanded to incorporate help for Apache Flink.
The most recent model of Confluent Cloud introduces key options designed to simplify and safe deployments of the Apache Flink. This contains help for the Desk API, which simplifies Apache Flink for builders utilizing Java and Python, providing flexibility to match their coding preferences and undertaking wants.
The help for Desk API allows customers to streamline the coding course of through the use of their most popular Built-in Improvement Setting (IDE) with auto-completion, refactoring instruments, and compile-time checks to boost code high quality, cut back runtime points, and simplify debugging.
Assist for the Desk API is at present in open preview for testing and experimentation, with basic availability coming quickly.
The most recent improve to Confluent Cloud introduces non-public networking help for Apache Flink, enhancing the safety of information streaming operations. As information volumes develop and cloud and hybrid options develop into extra prevalent, defending in opposition to unauthorized entry and cyber threats has by no means been extra essential.
The brand new community configuration course of allows corporations to guard in-transit information and merge a number of streams inside a secured surroundings. This improve may pave the way in which for organizations in extremely regulated industries, reminiscent of healthcare corporations, to begin streaming information.
Non-public networking help is at present obtainable on AWS for enterprise and devoted clusters, with plans to develop to extra cloud platforms within the close to future.
Groups utilizing real-time information platforms like Apache Kafka typically face challenges with fragmented instruments and inefficient workflows, making it troublesome to combine information into purposes. Confluent has launched an extension for Visible Studio Code (VS) to streamline workloads and speed up growth cycles. With 54% of builders globally utilizing VS Code, this new extension guarantees to boost the event expertise by offering a extra built-in and environment friendly course of.
Key options of the extension embody simplifying matter administration, enabling built-in coding and debugging, and effectively managing cloud assets—all inside VS Code. The Confluent Extension for Visible Studio Code helps Kafka purchasers and is at present obtainable in early entry. Common availability is anticipated later in 2024.
To boost the safety of the platform, Confluent has debuted Shopper-Aspect Area Stage Encryption to safeguard most delicate information whereas assembly regulatory necessities.
Customers can encrypt particular person fields inside information streams, guaranteeing that even when unauthorized events entry the information, they won’t be able to decipher it.
Customers additionally get granular entry management to decide on which particular fields to encrypt. This function additionally reduces the price of possession by lowering the necessity for matter duplication. Shopper-Aspect Area Stage Encryption is ready to develop into typically obtainable to all Confluent Cloud prospects quickly.
Based on Stewart Bond, Analysis Vice President at Worldwide Knowledge Corp., harnessing Apache Flink’s capabilities for stream processing permits builders to construct purposes that may analyze and react to real-time information with exceptional velocity. This dramatically boosts responsiveness and improves the general consumer expertise.
“Managed Apache Flink options can get rid of the complexities of infrastructure administration whereas saving time and assets,” acknowledged Steward Bond. “Companies should search for a Flink resolution that seamlessly integrates with the instruments, programming languages, and information codecs they’re already utilizing for simple implementation into enterprise workflows.”
Associated Objects
Confluent Provides Flink, Iceberg to Hosted Kafka Service
StreamNative Expands Product Line to Strengthen Knowledge Streaming Capabilities
Confluent Expands Apache Flink Capabilities to Simplify AI and Stream Processing