Loader Enhanced Open Source Features

Loader Enhanced Open-Source Feature: Data Import and Export

Loader is developed based on Sqoop. In addition to the Sqoop functions, Loader has the following enhanced features:

• Provides data conversion functions.
• Supports GUI-based configuration conversion.
• Imports data from an SFTP/FTP server to HDFS/OBS.
• Imports data from an SFTP/FTP server to an HBase table.
• Imports data from an SFTP/FTP server to a Phoenix table.
• Imports data from an SFTP/FTP server to a Hive table.
• Exports data from HDFS/OBS to an SFTP/FTP server.
• Exports data from an HBase table to an SFTP/FTP server.
• Exports data from a Phoenix table to an SFTP/FTP server.
• Imports data from a relational database to an HBase table.
• Imports data from a relational database to a Phoenix table.
• Imports data from a relational database to a Hive table.
• Exports data from an HBase table to a relational database.
• Exports data from a Phoenix table to a relational database.
• Imports data from an Oracle partitioned table to HDFS/OBS.
• Imports data from an Oracle partitioned table to an HBase table.
• Imports data from an Oracle partitioned table to a Phoenix table.
• Imports data from an Oracle partitioned table to a Hive table.
• Exports data from HDFS/OBS to an Oracle partitioned table.
• Exports data from HBase to an Oracle partitioned table.
• Exports data from a Phoenix table to an Oracle partitioned table.
• Imports data from HDFS to an HBase table, a Phoenix table, and a Hive table in the same cluster.
• Exports data from an HBase table and a Phoenix table to HDFS/OBS in the same cluster.
• Imports data to an HBase table and a Phoenix table by using bulkload or put list.
• Imports all types of files from an SFTP/FTP server to HDFS. The open source component Sqoop can import only text files.
• Exports all types of files from HDFS/OBS to an SFTP server. The open source component Sqoop can export only text files and SequenceFile files.
• Supports file coding format conversion during file import and export. The supported coding formats include all formats supported by Java Development Kit (JDK).
• Retains the original directory structure and file names during file import and export.
• Supports file combination during file import and export. For example, if a large number of files are to be imported, these files can be combined into n files (n can be configured).
• Supports file filtering during file import and export. The filtering rules support wildcards and regular expressions.
• Supports batch import and export of ETL tasks.
• Supports query by page and key word and group management of ETL tasks.
• Provides floating IP addresses for external components.