DevOps.com

  • Latest
    • Articles
    • Features
    • Most Read
    • News
    • News Releases
  • Topics
    • AI
    • Continuous Delivery
    • Continuous Testing
    • Cloud
    • Culture
    • DevSecOps
    • Enterprise DevOps
    • Leadership Suite
    • DevOps Practice
    • ROELBOB
    • DevOps Toolbox
    • IT as Code
  • Videos/Podcasts
    • DevOps Chats
    • DevOps Unbound
  • Webinars
    • Upcoming
    • On-Demand Webinars
  • Library
  • Events
    • Upcoming Events
    • On-Demand Events
  • Sponsored Communities
    • AWS Community Hub
    • CloudBees
    • IT as Code
    • Rocket on DevOps.com
    • Traceable on DevOps.com
    • Quali on DevOps.com
  • Related Sites
    • Techstrong Group
    • Container Journal
    • Security Boulevard
    • Techstrong Research
    • DevOps Chat
    • DevOps Dozen
    • DevOps TV
    • Digital Anarchist
  • Media Kit
  • About
  • AI
  • Cloud
  • Continuous Delivery
  • Continuous Testing
  • DevSecOps
  • Leadership Suite
  • Practices
  • ROELBOB
  • Low-Code/No-Code
  • IT as Code
  • More
    • Application Performance Management/Monitoring
    • Culture
    • Enterprise DevOps

Home » Latest News Releases » StreamSets Extends DataOps to Snowflake

StreamSets Extends DataOps to Snowflake

By: Deborah Schalm on January 16, 2019 2 Comments

New Partnership and StreamSets for Snowflake Bring Simple and High-Performance Data Integration to Leading Cloud-Built Data Warehouse 

Recent Posts By Deborah Schalm
  • Exabeam Reinvents Security Analytics with Fusion XDR and Fusion SIEM Cloud Products to Address Security Needs at Scale
  • New Study Reveals Importance of Optimized Strategy for the Selection, Support, and Maintenance of Open Source Software
  • Applitools Integrates With Rally for Fast and Automated Bug Management
More from Deborah Schalm
Related Posts
  • StreamSets Extends DataOps to Snowflake
  • InfluxData Announces InfluxDB Edge Data Replication
  • Database Migration from Microsoft Azure to Snowflake on AWS: Part 1
    Related Categories
  • Latest News Releases
    Related Topics
  • StreamSets
Show more
Show less

SAN FRANCISCO – January 15, 2019 – StreamSets®, provider of the industry’s first DataOps platform for modern data integration, announced today a technology partnership agreement with Snowflake, the data warehouse built for the cloud. In conjunction with the partnership, StreamSets also unveiled StreamSets for Snowflake. Now, StreamSets customers can easily create at-scale data pipelines for batch and streaming data from edge, on-premises and cloud systems directly into Snowflake, while automatically mitigating impact of data drift and ensuring data availability, quality and protection through continuous monitoring and Data SLAs.

DevOps Connect:DevSecOps @ RSAC 2022

Snowflake’s enterprise data warehouse is designed to easily amass all of their data, enabling rapid analytics that quickly make data insights available to all users, consumers and systems that need them. Snowflake customers enjoy benefits such as instant elasticity, secure data sharing and per-second pricing across multiple clouds for data analytics.

StreamSets for Snowflake greatly simplifies development of any-to-any pipelines that include Snowflake while affording continuous visibility and control over pipeline performance to ensure data availability, integrity and protection. Enterprises can use StreamSets for Snowflake to continuously flow data in real-time from relational databases, data lakes, search stores, logs, APIs and numerous other sources into Snowflake for use cases such as bulk upload/database migration, change data capture (CDC) and streaming data ingest across a hybrid multi-cloud architecture.

“As the only data warehouse built for the cloud, Snowflake brings a compelling combination of performance, scalability and simplicity to the enterprise. A data warehouse must integrate with enterprise data sources and other data platforms to form a cohesive architecture that best serves the business,” said Jobi George, vice president of business development and strategic alliances at StreamSets. “StreamSets for Snowflake helps enterprises extend their architecture to Snowflake with efficiency, performance and resilience in the face of change. Through our new partnership we look forward to extending the benefits of DataOps to Snowflake customers.”

StreamSets for Snowflake includes the following capabilities:

  • Visual pipeline designer; configuration not coding
  • High-performance synchronous and asynchronous data movement
  • Change data capture (CDC) for more efficient update of Snowflake objects
  • Automatic table creation and multi-table upload without prior schema specification
  • Data drift handling: monitors for and automatically propagates source data schema and semantic changes to Snowflake

It also includes these additional DataOps features:

  • Ability to integrate Snowflake with myriad data sources and other storage platforms, whether on premises or in the cloud
  • Ability to perform numerous pre-built or custom data transformations on data-in-motion
  • Centralized end-to-end monitoring of multi-platform dataflows with enforcement of Data SLAs for availability and quality
  • Policy-based detection and protection of sensitive data before it lands in the Snowflake data warehouse

“Our customers are continuously looking to add big data and streaming sources to the datasets in their cloud platforms,” said Walter Aldana, vice president of alliances at Snowflake. “Our partnership with StreamSets and their new StreamSets for Snowflake integration gives enterprises an efficient and reliable way to deliver all of their data, traditional or modern, into Snowflake and maximize the potential for analytic insights.”

Red Pill Analytics, an analytics services company, relies on StreamSets and Snowflake to deliver the best elements of the cloud for agile development-as-a-service and continuous delivery to its customers.

“We are excited for both StreamSets and Snowflake, who together enable our customers’ big data modernization projects,” said Stewart Bryson, CEO of Red Pill Analytics. “StreamSets’ intelligent data pipelines, now integrated with Snowflake’s unique architecture, mean our customers can accelerate insights delivery from the premier cloud-built data warehouse.” 

Availability

StreamSets for Snowflake is available immediately in StreamSets DataOps Platform version 3.7 and is included as part of a StreamSets Standard or Enterprise subscription.

About DataOps

DataOps is the application of DevOps practices to data management and integration to reduce the cycle time of data analytics, with a focus on automation, collaboration and monitoring. DataOps is essential for a data landscape marked by architectural complexity with accelerating change. DataOps is characterized by the following core capabilities:

  • Cross-platform data integration that enables flexible selection of fit-for-purpose storage and compute platforms
  • Data SLAs for continuous monitoring, measurement and enforcement of business standards for data availability, quality and protection
  • Continuous integration and delivery (CI/CD) of dataflows for agility (proactive change management)
  • Data drift resilience — automated detection and response to unexpected changes to schema and semantics (reactive change management)

About StreamSets

StreamSets built the industry’s first multi-cloud DataOps platform for modern data integration, helping enterprises to continuously flow big, streaming and traditional data to their data scientists and data-intensive applications. It uniquely handles data drift, those frequent and unexpected changes to data that break pipelines and damage data integrity. The platform combines the open source StreamSets Data Collector™ for execution of any-to-any pipelines (the data plane) with a cloud-native StreamSets Control Hub™ for the design, monitoring and performance management of multi-pipeline topologies (the control plane). Founded in 2014 by Girish Pancha, former chief product officer of Informatica, and Arvind Prabhakar, a former engineering leader at Informatica and Cloudera, StreamSets is backed by top-tier Silicon Valley venture capital firms, including Battery Ventures, New Enterprise Associates (NEA), and Accel Partners. For more information, visit www.streamsets.com.

###

Filed Under: Latest News Releases Tagged With: StreamSets

Sponsored Content
Featured eBook
The State of the CI/CD/ARA Market: Convergence

The State of the CI/CD/ARA Market: Convergence

The entire CI/CD/ARA market has been in flux almost since its inception. No sooner did we find a solution to a given problem than a better idea came along. The level of change has been intensified by increasing use, which has driven changes to underlying tools. Changes in infrastructure, such ... Read More
« New MariaDB Platform X3 Now Available in the Cloud as a Managed Service
DevOps Hiring: What Do You Need? »

TechStrong TV – Live

Click full-screen to enable volume control
Watch latest episodes and shows

Upcoming Webinars

Continuous Deployment
Monday, July 11, 2022 - 1:00 pm EDT
Using External Tables to Store and Query Data on MinIO With SQL Server 2022
Tuesday, July 12, 2022 - 11:00 am EDT
Goldilocks and the 3 Levels of Cardinality: Getting it Just Right
Tuesday, July 12, 2022 - 1:00 pm EDT

Latest from DevOps.com

Rust in Linux 5.20 | Deepfake Hiring Fraud | IBM WFH ‘New Normal’
June 30, 2022 | Richi Jennings
Moving From Lift-and-Shift to Cloud-Native
June 30, 2022 | Alexander Gallagher
The Two Types of Code Vulnerabilities
June 30, 2022 | Casey Bisson
Common RDS Misconfigurations DevSecOps Teams Should Know
June 29, 2022 | Gad Rosenthal
Quick! Define DevSecOps: Let’s Call it Development Security
June 29, 2022 | Don Macvittie

Get The Top Stories of the Week

  • View DevOps.com Privacy Policy
  • This field is for validation purposes and should be left unchanged.

Download Free eBook

The State of the CI/CD/ARA Market: Convergence
https://library.devops.com/the-state-of-the-ci/cd/ara-market

Most Read on DevOps.com

Rust in Linux 5.20 | Deepfake Hiring Fraud | IBM WFH ‘New No...
June 30, 2022 | Richi Jennings
Chip-to-Cloud IoT: A Step Toward Web3
June 28, 2022 | Nahla Davies
The Two Types of Code Vulnerabilities
June 30, 2022 | Casey Bisson
Common RDS Misconfigurations DevSecOps Teams Should Know
June 29, 2022 | Gad Rosenthal
Quick! Define DevSecOps: Let’s Call it Development Security
June 29, 2022 | Don Macvittie

On-Demand Webinars

DevOps.com Webinar ReplaysDevOps.com Webinar Replays
  • Home
  • About DevOps.com
  • Meet our Authors
  • Write for DevOps.com
  • Media Kit
  • Sponsor Info
  • Copyright
  • TOS
  • Privacy Policy

Powered by Techstrong Group, Inc.

© 2022 ·Techstrong Group, Inc.All rights reserved.