In this release we focused on connectivity improvements of CloverDX data platform. We added native connectivity to Snowflake, Parquet and implemented Kafka Message Listener to empower Kafka capabilities introduced in previous release. Further development of REST APIs included migration of Simple HTTP APIs capability into more up-to-date and consumable format, allowing Server to be more efficiently embedded in broader application landscape. Simple HTTP API will stay in the product but is now considered to be in maintenance mode and will be deprecated in some future release.
Improvements for Operations Dashboard aim for quick identification and subsequent fixes for business-critical process failures using visuals aids.
In continued effort to improve security and harden the software, we fixed 9 critical security issues found. These fixes will be backported to all currently supported versions.
Supporting new formats, known for being engineered to support structured data, 5.10 marks a steppingstone for future product focus on broader native use of hierarchical data.
CloverDX is now a Snowflake technology partner, which allowed us to bundle official driver for family of existing database components and implement efficient, native connectivity to Snowflake. New component SnowflakeBulkWriter was created to support highly efficient inserts (you can find this component in Writers category in Designer palette). On average, new SnowflakeBulkWriter is 8x faster for same data volume compared to standard DatabaseWriter’s INSERT statement.
To support data analytic use cases in Hadoop ecosystem, CloverDX 5.10 ships with two new components, ParquetReader and ParquetWriter. These components start in Incubation category where they will stay for approximately 2 releases. These components contain basic set of features which are going to be extended over incubation period.
ParquetReader: with performance in mind, developers can choose which columns to read – improving speed by minimizing unnecessary I/O operations. Works with file’s schema document, supporting metadata propagation.
ParquetWriter: using configurable mapping, serializes data streams into a Parquet file to any data target supported by other file-based components (including direct writes to HDFS and S3).
Latest improvement to the Dashboard, originally introduced in CloverDX 5.8.0, allows users to assign a severity level to each monitored resource. Higher level will manifest with more visible highlight and will be shown before alerts with lower configured severity.
Alert level helps support to identify and resolve critical issues in a timely manner.
We also made it easier to manage monitors on the Dashboard since it is now possible to add triggers to monitors directly from Alerts and Notification tab for each trigger and Data Service.
With latest release, collection of event listeners grown for Kafka Message Listener, capable detecting new arrivals into Kafka message queues. It allows to define both, specific topic(s) and topics by use of regular expressions to match them by common pattern.
Configuration which used to detect changes is subsequently passed to triggered task to do the processing.
We created a new REST API to help us address shortcomings of existing Simple HTTP API. Starting with this release, we ported most used methods from Simple HTTP API. New API is easier to use and more powerful and will be further improved in future releases.
All methods come with complete Swagger documentation with test interface and examples. It is accessible from the Server’s login page via Server REST API Catalog link.
Simple HTTP API is still supported and will not be removed anytime soon. It is now however in maintenance mode and will not be actively developed.
To help you install or upgrade to this version, we've prepared a simple checklist:
Before You Upgrade
|Release||Compatibility/Upgrade notes, Features & Fixes||Published||Download|
Platform Updates & Security
|March 30, 2021||Documentation Download CloverDX 5.10 5.10.0|