You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
TO IMPORT & EXPORT DATA FROM RDBMS (MYSQL,ORACLE, etc) INTO HDFS / HIVE / HBASE
Pre-requisite
Apache Hadoop
Apache Sqoop (compatible with Hadoop version)
Apache Hive (optional)
Apache HBase (optional)
Apache HCatalog (optional)
JDBC/ODBC connector
For all RDBMS, Connection URL changes and remaining all command line arguments remains same. You need to download specific JDBC/ODBC connector JAR and copy it to $SQOOP_HOME/lib
MySQL
Download mysql-connector-java.jar and place in $SQOOP_HOME/lib folder
TO IMPORT & EXPORT DATA FROM RDBMS (MYSQL,ORACLE, etc) INTO HDFS / HIVE / HBASE
Pre-requisite
Apache Hadoop
Apache Sqoop (compatible with Hadoop version)
Apache Hive (optional)
Apache HBase (optional)
Apache HCatalog (optional)
JDBC/ODBC connector
For all RDBMS, Connection URL changes and remaining all command line arguments remains same. You need to download specific JDBC/ODBC connector JAR and copy it to
$SQOOP_HOME/lib
MySQL
Download
mysql-connector-java.jar
and place in$SQOOP_HOME/lib
folderExpecting you have data in MySQL tables.
Retrieving list of Databases available in MySQL from SQOOP
Have Primary key:
No Primary key:
Have Primary key:
No Primary key:
Have Import All columns:
HBase import few columns
To HBase with Primary key:
To Hbase with no primary key:
Same for all Hive/HBase/HDFS: Because Hive tables are nothing but directories in HDFS. So you're just exporting a directory to MySQL
SQL Server
Connection URL:
Download Connector from Microsoft website
http://www.microsoft.com/en-us/download/confirmation.aspx?id=11774
Place it in
$SQOOP_HOME/lib
Oracle
Connection URL:
IBM DB2
Download the DB2Driver and place it in
$SQOOP_HOME/lib
Different Connection Strings for Different RDBMS
Database version --direct support? connect string matches
HSQLDB 1.8.0+ No
jdbc:hsqldb:*//
MySQL 5.0+ Yes
jdbc:mysql://
Oracle 10.2.0+ No
jdbc:oracle:*//
PostgreSQL 8.3+ Yes (import only)
jdbc:postgresql://
https://coderwall.com/p/kgrwwq
The text was updated successfully, but these errors were encountered: