Transformation

Transformation allows you to alter the data (Optional).

For example, convert a string to a number, change a date format, combine fields to create a new field, etc.

When you have created the required transformations, if any, select Next Step to continue. Select the Save button to save your progress at any time.

Active Transformations are listed in a summary table.

Add Transformation	Opens the Transformation dialog to create a new transformation rule. The options displayed on the dialog varies depending on the type of transformation selected.
	Opens the Transformation dialog to edit the selected transformation rule.
	Deletes the selected transformation rule.
	Drag to change the order of the transformation rules.

The following transformations are available:

• Build Geocoordinates - combine separate latitude and longitude values into a single geocoordinates value.

• Combine Fields - combine fields into a list.

• Copy - convert a field into a different datatype, for example, string to double.

• Count - count the number of items in a field, for example, count the number of items in a list.

• Create Map - combine fields into a list including both the field name and value. Similar to the list feature, except it also includes the field name as a label next to the value.

• Date to String - transform a date into a string using a pattern to determine the format of the date string.

• Dictionary Mapping - lookup the value in the field in a dictionary to identify a feature value.

• Format - format a field according to a pattern, for example, format a number into a currency format.

• Has Value - Return True or False if a field contains a value.

• Parse Date String - convert a date in a string field into a date field.

• Set Value - set the value of a field.

• Dynamic Load Time - fill the specified field with the date and time the data is created.

The functions provided are based on the Java java.util.formatter.

There is one additional field that is shown when working through the Load Structure Import configuration wizard for a JSON source file, called a Reference Object. See JSON Reference Object.

Combines two fields containing latitude and longitude values of type double. (With built-in validation for latitude ranging from -90 to 90, and longitude ranging from -180 to 180).

It outputs the geo-coordinate in the defined output field using the Sintelix geocoordinate datatype.

Example:

Result::

Combine fields into a list.

Example:

Result:

The Copy transformation converts a field into a different datatype, for example, string to double.

Example:

Result:

The Count transformation counts how many items are in the selected field. Usually used to count items in a List or Map data structure.

Example:

Result:

The Create Map transformer adds field names and values to a map data structure (key: field name, value: field value) for easy lookup and outputs to the defined field with the ‘string_map’ datatype. The input values are transformed into the ‘string’ datatype and stored in the map.

Example:

Result:

Transform a date with a specified pattern into a string.

See Date Pattern Options

Example Patterns:

The following provides example patterns based on the date and time 1:30 PM 3rd August 2024.

Example 1:

Example 2:

Result:

Look up the value in the selected field using the dictionary feature’s key and replace it with the corresponding value.

Example:

Given the following dictionary:

You can create a Dictionary Mapping transformation:

Result:

Format the selected input field(s) as a string according to the defined pattern.

Example use cases:

• Format a double into a string.

• Concatenate multiple selected fields and output them as a string with additional characters.

Format structure:

You can use the Copy transformation to change a string to a double or a double to a string.

Example Patterns:

The following provides example patterns.

Example 1:

Result 1:

Example 2:

Result 2:

Return a true or false indicating if the selected field has a value.

Example:

Result:

Parse a string into a datetime using the specified pattern.

The pattern needs to match the format of the input string. For example, if the input string is 30/10/2024, then the pattern needs to be dd/MM/yyyy.

See Date Pattern Options

Example:

Result:

Set the value of the selected field as a string.

Example:

In this example, the Set Value is used to identify the source configuration.

Result:

Fill the specified field with the loading time when the data is loaded.

Example:

Result:

JSON has an additional field added to each of the transformations