Decodable Snowflake Snowpipe Streaming API connector enables low-latency ingestion and 'hands-off' experience, with potential for significant cost savings; open source Decodable dbt adapter leverages workflow management and collaboration capabilities of dbt
AUSTIN, Texas, March 28, 2023 /PRNewswire-PRWeb/ -- DATA COUNCIL AUSTIN—Decodable, the leading stream processing company, announced today that it has expanded the enterprise features of its platform with the addition of a Snowflake Streaming API connector and a dbt adapter. For data engineers, this means being able to ingest real-time data into their Snowflake cloud data warehouse, taking advantage of lower cost and reduced latency, without having to integrate with Snowflake themselves. For analytics engineers, data analysts and data scientists, it is now easier than ever to manage streaming and batch transformation simultaneously in a single workflow with dbt and Decodable. Together, these enhancements advance Decodable's mission to make stream processing simple so that every organization can successfully realize the benefits of real-time data.
**Decodable's Snowflake Snowpipe Streaming API Connector Lower Costs, Reduces Latency and Delivers a "Hands-off" Experience**
Decodable's new Snowflake Snowpipe Streaming API connector enables ingestion of real-time, streaming data directly from Apache Flink® into the Snowflake cloud data warehouse via the Decodable platform—no time-consuming integration required.
Prior to the availability of Decodable's Snowflake Snowpipe Streaming API connector, the workflow required to get streaming data into and out of Snowflake was complex, with a significant amount of ongoing overhead and labor required to maintain it. Now, Decodable makes it simple to integrate real-time stream processing with Snowflake-based data stacks. The Decodable Snowflake Snowpipe Streaming API connector is fully hands-off: all that is required of a data engineer is simply to configure the sink in Decodable.
In addition, the Decodable Snowflake Snowpipe Streaming API connector enables data scientists to to balance data ingestion latency against the cost of Snowflake warehouse usage. The streaming feature is built to handle real-time latency in a cost-effective manner, so there's no tradeoff to be made.
"Snowflake users that want to harness the power of real-time data have had poor and expensive options for data ingestion until now," said Eric Sammer, CEO of Decodable. "The Decodable Snowflake Snowpipe Streaming API connector offers data engineers a quick and super-easy way to take advantage of a lower-latency data stream, a greatly simplified workflow, and the potential for significant storage savings as well."
Decodable's Snowflake Snowpipe Streaming API connector is available today as a technology preview. Decodable will make the connector generally available (GA) in tandem with Snowflake's GA of its Streaming API (projected for June 2023).
***Create a trial account today to experience the new Decodable Snowflake Snowpipe Streaming API connector***
Learn more about the Snowflake Snowpipe Streaming API connector on the Decodable blog.
**Decodable's dbt Adapter Unifies Streaming and Batch Transformation Workflows**
Decodable's new dbt adapter brings the workflow and collaboration features of dbt to users of the Decodable Apache Flink-powered stream processing platform. Dbt introduces software engineering best practices—such as version control, testing and collaboration—into the world of data engineering. While dbt is widely adopted, it is typically used for traditional batch processing. Decodable's new dbt adapter makes it possible to manage both streaming and batch transformation in a single workflow through the dbt interface.
"Our dbt adapter makes all the workflow capabilities of dbt available to users of Decodable's streaming data platform," continued Sammer. "This means data scientists and engineers can now easily collaborate on streaming data models, queries, testing and documentation, with access and version control through Git. The bottom line is that the dbt adapter offers a smarter, easier way for data engineers to deliver powerful, real-time insights using streaming data."
Decodable is releasing its dbt adapter as open source, available for contributions and feedback from the community. To install or contribute to the dbt adapter, visit https://github.com/decodableco/dbt-decodable.
Learn more about the new dbt adapter on the Decodable blog.
"For well over a decade, the technology industry's focus has been on expanding the number of primitives as rapidly as possible," said Stephen O'Grady, principal analyst with RedMonk. "This has greatly expanded enterprises' capabilities, but simultaneously created challenges with the overall experience of using multiple disparate services together. To improve that, enterprises are increasingly demanding integrations that allow their various components of their stack to work more seamlessly together. This challenge is exactly what the recent Decodable announcements are focused on."
**About Decodable**
Decodable's mission is to make stream processing so easy that every organization can successfully realize the benefits of real-time data. Decodable's stream processing platform builds on the power of Apache Flink®, offering a fully managed service complete with a self-service developer experience, day 2 operations, a library of connectors and full enterprise integration. The company is backed by Bain Capital Ventures and Venrock. To learn more, please visit https://www.decodable.co/.
###
Media Contact
Robert Cathey, Cathey Communications for Decodable, +1 865-386-6118, [email protected]
SOURCE Cathey Communications for Decodable
Share this article