Welcome Guest! Log in
Stambia versions 2.x, 3.x, S17, S18, S19 and S20 are reaching End of Support January, 15th, 2024. Please consider upgrading to the supported Semarchy xDI versions. See Global Policy Support and the Semarchy Documentation.

The Stambia User Community is moving to Semarchy! All the applicable resources have already been moved or are currently being moved to their new location. Read more…


This article describes the principal changes of Hadoop Component.

If you need further information, please consult the full changelog.

The plugin download section can be found at this page.

Note:

Stambia DI is a flexible and agile solution. It can be quickly adapted to your needs.

If you have any question, any feature request or any issue, do not hesitate to contact us.

 

This article is dedicated to Stambia DI 2020 (S20) or higher.

If you are using Stambia DI S17, S18 and S19 please refer to this article.

 

Component.Hadoop.2.2.1

Minor improvements and fixed issues

This version contains some minor improvements and fixed issues, which can be found in the complete changelog.

 

Complete changelog

The complete changelog with the list of improvements and fixed issues can be found at the following location.

 

Component.Hadoop.2.2.0

Complete changelog

The complete changelog with the list of improvements and fixed issues can be found at the following location.

 

Component.Hadoop.2.1.1

This component version is dedicated to Stambia DI S20.4.1 or higher.

Support of Stambia SQL Editor

The SQL Editor has been replaced by a tool named "Stambia Query Editor", some improvements have been made in Hadoop component to support this Stambia Query Editor.

 

Component.Hadoop.2.1.0

Support of EMF Compare

Several improvements have been made to support EMF Compare.

 

Component.Hadoop.2.0.5

Minor improvements and fixed issues

This version contains some minor improvements and fixed issues, which can be found in the complete changelog.

 

Complete changelog

The complete changelog with the list of improvements and fixed issues can be found at the following location.

 

Component.Hadoop.2.0.4

Minor improvements and fixed issues

This version contains some minor improvements and fixed issues, which can be found in the complete changelog.

 

Complete changelog

The complete changelog with the list of improvements and fixed issues can be found at the following location.

 

Component.Hadoop.2.0.3

New Template Load Salesforce to Hive

A new dedicated Template to Load data from Salesforce to Hive has been added.

It will provide a better support and optimization than the generic Templates, and handle Hive specificities when loading data from Salesforce.

 

HDFS File Connect Tool

When a connection issue happens on the "HDFS File Connect Tool", a session variable named "HDFS Error" is now published to provide a better error message.

 

Change Data Capture (CDC)

Multiple improvements have been performed to homogenize the usage of Change Data Capture (CDC) in the various Components.

Parameters have been homogenized, so that all Templates should now have the same CDC Parameters, with the same support of features.

Multiple fixes have also been performed to correct CDC issues. Refer to the changelog for the exact list of changes.

 

Complete changelog

The complete changelog with the list of improvements and fixed issues can be found at the following location.

 

Component.Hadoop.2.0.2

Sample project

The component example project can now be imported directly in the "New" menu of the Project Explorer.

 

Component.Hadoop.2.0.1

HDFS Tool

Adding a new tool: Tool HDFS File Get Properties, which allows to retrieve information about files.

For this first version it allows to retrieve the size of a remote file.

The size will be stored in the process variable “HDFS_BYTES”.

HDFS01HDFS02

 

Fixed issue about WebHDFS mode and files with space character

There was an issue when trying to manage HDFS files through WebHDFS mode, when the files has a space character in file name.

This is now fixed.

 

 

 

 

 

Articles

Suggest a new Article!