CloverETL 4.3 brings code debugging features known from programming tools to ETL developement – conditional breakpoints, expression watching and, of course, step-by-step tracing. Additionally, we're adding a powerful but simple to configure Salesforce CRM connector.
Code debugging is a productivity feature for everyone who uses code (CTL) to define logic in mappings, Reformat data manipulations, etc. You can now pause execution of your code and trace it step-by-step to easily find a misbehaved line of code or detect unhandled data anomalies that cause trouble during execution and would be otherwise hard to spot.
New Salesforce connector allows you to easily read/search and write data from- and to Salesforce CRM without having to understand or touch the underlying APIs and connection intricacies (the connector supports full range or Bulk API operations).
Tell CloverETL to pause execution of your code on a specific line in any component. You can inspect variables, dive into functions and manually advance the execution step-by-step to instantly find issues in your code.
No more trial & error runs, printing values to console log or even building debug data flows. Simply set breakpoints where CloverETL should stop execution and we'll give you full control over the code.
Milestone 2 adds Conditional Breakpoints – you can set a breakpoint to stop execution only after certain number of passes, when a given expression is true or just watch for changes of a particular value. This greatly speeds up the time it takes to find an error in code that happends only under specific conditions.
CloverETL Designer allows you to debug your code in components, e.g. Transform attributes of Reformat and Joiners, De/Normalizer code, Rollup and so on, anywhere in your transformation. Both CTL (CloverETL Transformation Language) and Java debugging is supported, giving you a unified debugging interface.
Don't worry, we're not talking about debugging some internals of the engine. We're talking about yourcode in your transformation, without exposing you to the intricate internals of CloverETL's own guts.
Read, search and write data from and to Salesforce CRM with simple to use specialized components.
Simply create a connection to Salesforce, click-and-select what you want to read or write and you're done. We're giving you simple Reader and Writer components that handle all the background complexities for you.
You could work with Salesforce before using our generic components for calling APIs and managing workflows. Now, you can forget those nuts and bolts.
CloverETL uses Salesforce Bulk API. This is excellent for working with large (and small) batches. The Standard SOAP API provides additional capabilities for advanced querying and real-time operations. However, it is not currently supported.
Learn more about the new Salesforce connector on our blog.
In Designer, you can now easily filter subjobs by status in Execution View.
Usually, you're interested only in failed or otherwise unfinished subgraphs or workers. The new filter option lets you quickly filter out what's not important.
Dedup component (deduplication) now accepts unsorted data on its input.
You need to explicitly enable this behavior by setting Sorted input = false.
In this mode, the component keeps all data in memory so be sure to use it only for data sets small enough to fit into your system's memory.
To help you install or upgrade to this version, we've prepared a simple checklist:
Before You Upgrade
|Release||Compatibility/Upgrade notes, Features & Fixes||Published||Download|
|November 09, 2016||Download CloverETL 4.3 4.3.1|
Productivity / Code Debugging
Salesforce CRM Connector
|September 07, 2016||Download CloverETL 4.3 4.3.0|