CloverETL 4.2 improves (not only) team productivity and brings performance boost for parallel processing.
We have redesigned the internals of how Designer interacts with Server so that you can now put Server remote projects under version control. For Server Corporate, we're bringing “data partitioning” – a feature formerly available only in Cluster. It lets you run multiple parallel instances of a component at once – giving you more punch for operations that can utilize multiple CPU cores or high latency operations, such as API calls.
Designer now mirrors remote Server projects to your local disk, allowing you to easily put the local copy under version control.
With this you can manage remote Server projects under version control directly. You no longer need to keep a separate versioned local copy of the Server sandbox.
Version control operations such as pull, push, commit, merge, etc. work directly with the files in the local copy of the project, so you can use any standard version control tool, including built-in Eclipse plugins for Git and SVN. Designer then transparently synchronizes all changes to the Server sandbox.
As an effect of the previous feature, you can open and save files originating from a Server sandbox with any tool you need.
You can easily deploy a project to Server from your workspace by using Convert To Server Project shortcut. Conversely, you can disconnect a Server project to keep just the local copy or connect and sync it with another Server sandbox.
Run parts of a transformation (individual components or sequences of steps) in parallel, optimizing workflows for multiple processor cores on a single Server box.
We've made Cluster capabilities available to single Server (available in Corporate only). You can now run multiple instances of a component to increase throughput of throttled Web Service APIs, to parallelize CPU intensive operations that would otherwise run only in a single thread, or simply partition and process data on multiple disks to maximize I/O performance.
Press D to cycle between levels of detail when running data partitioning on a single Server (Corporate) or mulitple nodes (Cluster). You can check numbers of records being processed by and transfered between individual workers.
The Source tab in the main editor now supports syntax highlighting.
Amazon recommends using correspoding endpoint URLs when accessing S3 buckets hosted in specific regions. You can now select the Amazon region and CloverETL will automatically generate the right URL.
You can now draw new edge from an input port to create a new upstream component. Just click an input port, drag to a blank area and then use the Add Component dialog to create the component.
|Release||Compatibility/Upgrade notes, Features & Fixes||Published||Download|
|August 17, 2016||Download CloverETL 4.2 4.2.1|
Productivity / Version Control for Server Projects
Packaging / Versions
Under the hood
|June 08, 2016||Download CloverETL 4.2 4.2.0|