DevOps.com

  • Latest
    • Articles
    • Features
    • Most Read
    • News
    • News Releases
  • Topics
    • AI
    • Continuous Delivery
    • Continuous Testing
    • Cloud
    • Culture
    • DataOps
    • DevSecOps
    • Enterprise DevOps
    • Leadership Suite
    • DevOps Practice
    • ROELBOB
    • DevOps Toolbox
    • IT as Code
  • Videos/Podcasts
    • Techstrong.tv Podcast
    • Techstrong.tv Video Podcast
    • Techstrong.tv - Twitch
    • DevOps Unbound
  • Webinars
    • Upcoming
    • On-Demand Webinars
  • Library
  • Events
    • Upcoming Events
    • On-Demand Events
  • Sponsored Content
  • Related Sites
    • Techstrong Group
    • Container Journal
    • Security Boulevard
    • Techstrong Research
    • DevOps Chat
    • DevOps Dozen
    • DevOps TV
    • Techstrong TV
    • Techstrong.tv Podcast
    • Techstrong.tv Video Podcast
    • Techstrong.tv - Twitch
  • Media Kit
  • About
  • Sponsor
  • AI
  • Cloud
  • Continuous Delivery
  • Continuous Testing
  • DataOps
  • DevSecOps
  • DevOps Onramp
  • Platform Engineering
  • Low-Code/No-Code
  • IT as Code
  • More
    • Application Performance Management/Monitoring
    • Culture
    • Enterprise DevOps
    • ROELBOB

Home » Latest News Releases » StreamSets Extends DataOps to Snowflake

StreamSets Extends DataOps to Snowflake

By: Deborah Schalm on January 16, 2019 2 Comments

New Partnership and StreamSets for Snowflake Bring Simple and High-Performance Data Integration to Leading Cloud-Built Data Warehouse 

Recent Posts By Deborah Schalm
  • Exabeam Reinvents Security Analytics with Fusion XDR and Fusion SIEM Cloud Products to Address Security Needs at Scale
  • New Study Reveals Importance of Optimized Strategy for the Selection, Support, and Maintenance of Open Source Software
  • Applitools Integrates With Rally for Fast and Automated Bug Management
More from Deborah Schalm
Related Posts
  • StreamSets Extends DataOps to Snowflake
  • DataRobot Announces Feature Discovery Integration with Snowflake
  • SIIA Announces Business Technology Finalists for 2020 CODiE Awards
    Related Categories
  • Latest News Releases
    Related Topics
  • StreamSets
Show more
Show less

SAN FRANCISCO – January 15, 2019 – StreamSets®, provider of the industry’s first DataOps platform for modern data integration, announced today a technology partnership agreement with Snowflake, the data warehouse built for the cloud. In conjunction with the partnership, StreamSets also unveiled StreamSets for Snowflake. Now, StreamSets customers can easily create at-scale data pipelines for batch and streaming data from edge, on-premises and cloud systems directly into Snowflake, while automatically mitigating impact of data drift and ensuring data availability, quality and protection through continuous monitoring and Data SLAs.

TechStrong Con 2023Sponsorships Available

Snowflake’s enterprise data warehouse is designed to easily amass all of their data, enabling rapid analytics that quickly make data insights available to all users, consumers and systems that need them. Snowflake customers enjoy benefits such as instant elasticity, secure data sharing and per-second pricing across multiple clouds for data analytics.

StreamSets for Snowflake greatly simplifies development of any-to-any pipelines that include Snowflake while affording continuous visibility and control over pipeline performance to ensure data availability, integrity and protection. Enterprises can use StreamSets for Snowflake to continuously flow data in real-time from relational databases, data lakes, search stores, logs, APIs and numerous other sources into Snowflake for use cases such as bulk upload/database migration, change data capture (CDC) and streaming data ingest across a hybrid multi-cloud architecture.

“As the only data warehouse built for the cloud, Snowflake brings a compelling combination of performance, scalability and simplicity to the enterprise. A data warehouse must integrate with enterprise data sources and other data platforms to form a cohesive architecture that best serves the business,” said Jobi George, vice president of business development and strategic alliances at StreamSets. “StreamSets for Snowflake helps enterprises extend their architecture to Snowflake with efficiency, performance and resilience in the face of change. Through our new partnership we look forward to extending the benefits of DataOps to Snowflake customers.”

StreamSets for Snowflake includes the following capabilities:

  • Visual pipeline designer; configuration not coding
  • High-performance synchronous and asynchronous data movement
  • Change data capture (CDC) for more efficient update of Snowflake objects
  • Automatic table creation and multi-table upload without prior schema specification
  • Data drift handling: monitors for and automatically propagates source data schema and semantic changes to Snowflake

It also includes these additional DataOps features:

  • Ability to integrate Snowflake with myriad data sources and other storage platforms, whether on premises or in the cloud
  • Ability to perform numerous pre-built or custom data transformations on data-in-motion
  • Centralized end-to-end monitoring of multi-platform dataflows with enforcement of Data SLAs for availability and quality
  • Policy-based detection and protection of sensitive data before it lands in the Snowflake data warehouse

“Our customers are continuously looking to add big data and streaming sources to the datasets in their cloud platforms,” said Walter Aldana, vice president of alliances at Snowflake. “Our partnership with StreamSets and their new StreamSets for Snowflake integration gives enterprises an efficient and reliable way to deliver all of their data, traditional or modern, into Snowflake and maximize the potential for analytic insights.”

Red Pill Analytics, an analytics services company, relies on StreamSets and Snowflake to deliver the best elements of the cloud for agile development-as-a-service and continuous delivery to its customers.

“We are excited for both StreamSets and Snowflake, who together enable our customers’ big data modernization projects,” said Stewart Bryson, CEO of Red Pill Analytics. “StreamSets’ intelligent data pipelines, now integrated with Snowflake’s unique architecture, mean our customers can accelerate insights delivery from the premier cloud-built data warehouse.” 

Availability

StreamSets for Snowflake is available immediately in StreamSets DataOps Platform version 3.7 and is included as part of a StreamSets Standard or Enterprise subscription.

About DataOps

DataOps is the application of DevOps practices to data management and integration to reduce the cycle time of data analytics, with a focus on automation, collaboration and monitoring. DataOps is essential for a data landscape marked by architectural complexity with accelerating change. DataOps is characterized by the following core capabilities:

  • Cross-platform data integration that enables flexible selection of fit-for-purpose storage and compute platforms
  • Data SLAs for continuous monitoring, measurement and enforcement of business standards for data availability, quality and protection
  • Continuous integration and delivery (CI/CD) of dataflows for agility (proactive change management)
  • Data drift resilience — automated detection and response to unexpected changes to schema and semantics (reactive change management)

About StreamSets

StreamSets built the industry’s first multi-cloud DataOps platform for modern data integration, helping enterprises to continuously flow big, streaming and traditional data to their data scientists and data-intensive applications. It uniquely handles data drift, those frequent and unexpected changes to data that break pipelines and damage data integrity. The platform combines the open source StreamSets Data Collector™ for execution of any-to-any pipelines (the data plane) with a cloud-native StreamSets Control Hub™ for the design, monitoring and performance management of multi-pipeline topologies (the control plane). Founded in 2014 by Girish Pancha, former chief product officer of Informatica, and Arvind Prabhakar, a former engineering leader at Informatica and Cloudera, StreamSets is backed by top-tier Silicon Valley venture capital firms, including Battery Ventures, New Enterprise Associates (NEA), and Accel Partners. For more information, visit www.streamsets.com.

###

Filed Under: Latest News Releases Tagged With: StreamSets

« New MariaDB Platform X3 Now Available in the Cloud as a Managed Service
DevOps Hiring: What Do You Need? »

Techstrong TV – Live

Click full-screen to enable volume control
Watch latest episodes and shows

Upcoming Webinars

Achieving Complete Visibility in IT Operations, Analytics, and Security
Wednesday, February 1, 2023 - 11:00 am EST
Achieving DevSecOps: Reducing AppSec Noise at Scale
Wednesday, February 1, 2023 - 1:00 pm EST
Five Best Practices for Safeguarding Salesforce Data
Thursday, February 2, 2023 - 1:00 pm EST

Sponsored Content

The Google Cloud DevOps Awards: Apply Now!

January 10, 2023 | Brenna Washington

Codenotary Extends Dynamic SBOM Reach to Serverless Computing Platforms

December 9, 2022 | Mike Vizard

Why a Low-Code Platform Should Have Pro-Code Capabilities

March 24, 2021 | Andrew Manby

AWS Well-Architected Framework Elevates Agility

December 17, 2020 | JT Giri

Practical Approaches to Long-Term Cloud-Native Security

December 5, 2019 | Chris Tozzi

Latest from DevOps.com

Cisco AppDynamics Survey Surfaces DevSecOps Challenges
January 31, 2023 | Mike Vizard
Jellyfish Adds Tool to Visualize Software Development Workflows
January 31, 2023 | Mike Vizard
3 Performance Challenges as Chatbot Adoption Grows
January 31, 2023 | Christoph Börner
Looking Ahead, 2023 Edition
January 31, 2023 | Don Macvittie
How To Build Anti-Fragile Software Ecosystems
January 31, 2023 | Bill Doerrfeld

TSTV Podcast

On-Demand Webinars

DevOps.com Webinar ReplaysDevOps.com Webinar Replays

GET THE TOP STORIES OF THE WEEK

Most Read on DevOps.com

Microsoft Outage Outrage: Was it BGP or DNS?
January 25, 2023 | Richi Jennings
The Database of the Future: Seven Key Principles
January 25, 2023 | Nick Van Wiggerern
Don’t Hire for Product Expertise
January 25, 2023 | Don Macvittie
Harness Acquires Propelo to Surface Software Engineering Bot...
January 25, 2023 | Mike Vizard
Software Supply Chain Security Debt is Increasing: Here̵...
January 26, 2023 | Bill Doerrfeld
  • Home
  • About DevOps.com
  • Meet our Authors
  • Write for DevOps.com
  • Media Kit
  • Sponsor Info
  • Copyright
  • TOS
  • Privacy Policy

Powered by Techstrong Group, Inc.

© 2023 ·Techstrong Group, Inc.All rights reserved.