In this release we are continuing our theme of CloverDX Libraries and making significant improvement by publishing CloverDX Marketplace. CloverDX Marketplace is a curated collection of CloverDX Libraries that implement various functionality – connectors, utilities and more. We are starting with 13 libraries and will be expanding the Marketplace with more libraries over time to help you use your CloverDX more effectively.
We are introducing official CloverDX RPM repository which will allow you to deploy your CloverDX instances with a single command on compatible operating systems (launching with Red Hat Enterprise Linux and CentOS Linux).
In this release we are also adding new component to help you work with HL7® v2 data – HL7Reader. This component can be used in data validation, mapping and reporting use cases around HL7® data. The component has been designed to be robust and is capable of handling malformed or non-standard files to allowing you to process as much data as possible.
To further help with your CloverDX deployments, we are introducing a new configuration file properties allowing you to set master password programmatically. This will allow you to improve your DevOps processes and make your deployments easier and fully automated.
We've made many smaller updates on backend – we now support PostgreSQL 14, deployments to IBM Open Liberty 22 and Salesforce components can now use new API v55.2.0 and more.
And as usually, we upgraded several internal dependencies to fix various security vulnerabilities that have been discovered by our automated scans or reported to us.
CloverDX Marketplace is a public repository of high-quality libraries you can easily use in your solutions to save development time by focusing on your core use case rather than building various connectors or other commonly used subgraphs.
You can easily access the Marketplace in two different ways – via its website https://marketplace.cloverdx.com/ or directly as a Repository in CloverDX Server.
The web app allows you to quickly browse and explore Marketplace content without having to use CloverDX Server Console. You can also download all libraries and install them directly in your Server or examine their source if you'd like to know how they are implemented.
When working with CloverDX Server, you will be able to access a new built-in Repository hosted in Azure Blob. You can then install libraries from the Marketplace with just few clicks:
All libraries in the Marketplace are free to use and provided on “as is” basis. To see how they work or to improve them, you can easily access their source code. This will also help you learn how to use various CloverDX features that were used when building the libraries.
We will be adding more libraries over time, so keep checking our Tech blog for news about library releases in the Marketplace.
We continue improving Library functionality to allow you to build more powerful and useful libraries. In this release, we are adding ability to include additional objects in libraries in addition to subgraphs.
You can now package graphs, jobflows, metadata or even Data Services in your libraries. These improvements unlock interesting use cases especially when combined with the ability to create your own Repository for your organization.
For example, you can publish a set of Data Service endpoints that provide statistics of jobs running on CloverDX Server, cleverly combining internal data for its consumers like DataDog or Splunk. It is now possible to quickly install and deploy such Data Services on the Server using just few clicks.
Ability to package jobflows can be used in situations where larger frameworks are bundled within a library. For example, library may implement a Unit testing framework for CloverDX projects which you can just schedule via standard CloverDX Server automation features (Schedulers, Event Listeners) and have then run automatically, making CI/CD pipelines a smooth sailing.
Packaging metadata on the other hand opens possibility to version control data structures provided or required by your source and target applications. Metadata libraries may be a leap forward to best practice in Data Governance use cases.
Each library can now also carry its own documentation in Markdown format. When you click on such library in Server's Library module, you will be able to view the documentation giving you details of what is included in the library.
Installation of CloverDX Server is now whole lot simpler thanks to our new official RPM packages. These packages are compatible with Red Hat Enterprise Linux and CentOS Linux distributions. CloverDX Server can now be installed with default (non-production) settings using simple one-liner. Our RPM repository contains all necessary dependencies to be able to run CloverDX on an open-source stack with Apache Tomcat 9 and Eclipse Temurin JDK.
To get more information about how to install CloverDX from the RPM repository, visit our Linux packaging documentation.
We are continuing to expand our connector library and introducing a new incubation component – HL7® Reader – that will allow you to parse HL7® v2 documents. The component allows you to ingest HL7® data in many different versions – starting with v2.1 up to and including v2.9 – and convert into CloverDX variant data type (which is essentially a JSON document).
The component has been designed to be resilient and handle even malformed data since it is quite common for the files to use customized formats and deviate from the standard. Mapping HL7 data to variant will then allow you to pick the message apart and process only the parts that you need. You can implement advanced validation, data conversions, reporting and more by using functionality built into CloverDX platform.
Salesforce components use new API
We've upgraded the API that that is used by SalesforceReader and SalesforceWriter components. For the reader this means that you can, for example, use SELECT FIELDS(ALL), SELECT FIELDS(CUSTOM) and SELECT FIELDS(STANDARD) notation instead of explicitly listing fields in your SOQL.
New cloud releases
We've upgraded our AWS Marketplace and Azure Marketplace offers to PostgreSQL 14. On both platforms this change requires upgrade of the underlying template. This means that if you are running your CloverDX instances from either marketplace, you will not be able to directly upgrade. Instead, you will have to perform additional steps – detailed instructions available for each platform:
To help you install or upgrade to this version, we've prepared a simple checklist:
Before You Upgrade
|Release||Compatibility/Upgrade notes, Features & Fixes||Published||Download|
Public Marketplace and Repositories Improvements
|September 20, 2022||Documentation Download CloverDX 5.16 5.16.0|