Syncsort has announced two new additions to its Syncsort Integrate family of products that help solve top-of-mind challenges highlighted by IT Practitioners in its annual Big Data survey. A new product, Ironstream® for IBM i, and greatly extended enterprise-wide CDC capabilities, help solve key data lake use cases and support some of the most daunting challenges in leveraging next-generation analytics.
Syncsort recently surveyed IT professionals working with Big Data across a wide range of industries about the top challenges their organizations faced in 2018 as they progress their modern data architecture and data lake initiatives. Their top areas of concern were moving data and performing advanced and real-time data analytics. Over 71% of respondents named the flagship industry data integration process, Extract, Transform and Load (ETL), as their most compelling data lake use case. Respondents selected advanced analytics (62%) as the second-highest priority, with real-time analytics third at 60%.
To help IT tackle these challenges, Syncsort has engineered a new Ironstream® product that delivers IBM i machine log data in real-time to Splunk for advanced analytics to support Security Information and Event Management (SIEM) and IT Operations Analytics (ITOA) initiatives. In addition, new CDC capabilities help keep data current and accurate across a wide variety of enterprise sources and targets, in real-time.
“Organizations are under intense pressure to keep data from diverse sources fresh and in sync with next generation environments like Hadoop, Spark, Splunk and Elastic for advanced analytics they can trust,” said Tendü Yoğurtçu, CTO, Syncsort. “Our new Ironstream product and resilient CDC capabilities are designed to help solve these increasingly complex challenges in a fast, efficient and secure manner, on-premise and in the cloud.”
Ironstream for IBM i
Organizations are seeking a way to access and integrate IBM i data to Splunk or other SIEM consoles such as Qradar, ArcSight, SolarWinds and LogRhythm as part of an enterprise-wide view of security and operational data. They need access to the data in real-time so they can quickly identify and resolve problems – without requiring IBM i systems expertise.
To meet these requirements, Syncsort designed Ironstream for IBM i, taking the same approach in collecting, transforming and forwarding log data as with its industry-leading Ironstream® software, which forwards z/OS log data to the Splunk and Elastic platforms. This allows IT to:
Get a better understanding of and ability to make decisions about the IT environment to help deliver IT services without delays or outages
Investigate security threats, breaches, and ensure compliance
Provide the best security tools and processes for the organization
Protect the company from security exposures that could damage the brand and the business
New CDC Capabilities
The Big Data survey also revealed that organizations require fresh, up-to-date data. More than 75% of respondents report having difficulty keeping their data lake in sync with changing data sources.
Syncsort already offers high-performance data integration capabilities that include continuous streaming capabilities to make fresh data available on-demand from disparate, enterprise-wide data sources, both on-premise and in the cloud. To keep changes to source and target data in sync, the new CDC capabilities greatly extend supported data sources and targets. Now, in addition to IBM Db2/z, DMX Change Data Capture adds IBM i, IBM Informix, Oracle, Oracle RAC, Sybase, Db2 and MS SQL Server as both sources and targets, VSAM as a source, and HDFS, Hive, Impala, Teradata, MySQL, Azure SQL, PostgreSQL and Kafka as targets.
Also, across the entire list of data sources and targets, Syncsort includes the unrivaled ability for resilient data replication so changes are available in real-time, and can’t be lost when there are system or network failures, especially critical for cloud environments.
The enhanced CDC capabilities allow organizations to:
Work with the most up-to-date information for downstream analytics
Save time and resources by designing in a graphical UI with no coding
Avoid data loss by leveraging reliable, automatic restarts from the point where connectivity was lost
Synchronize mainframe, IBM i, relational databases and other distributed data sources with Hadoop or data warehouses, on-premise or in the cloud, within seconds
Find out more about Syncsort Integrate products.