Hadoop數據傳輸工具sqoop(四)Java遠程調用Sqoop進行數據傳輸

1、Maven配置

<dependency>
    <groupId>org.apache.sqoop</groupId>
    <artifactId>sqoop</artifactId>
    <version>1.4.5</version>
</dependency>

2、Java代碼

@Service
public class SqoopTestServiceImpl implements SqoopTestService
{
  //測試代碼
  public static void main(String[] args)
  {
    try {
        new WordCountServiceImpl().importDataFromOracle();
    } catch (Exception e){
       e.printStackTrace();
    }
  }

  @Override
  public int importDataFromOracle() {
	String[] args = new String[]{
		"--connect", "jdbc:oracle:thin:@192.168.10.12:1521:ftmsdev",
		"--username", "ftms",
		"--password", "ftms",
		"--table", "SYSTEM_USER",
		"--columns", "LOGIN_NAME,PASSWORD",
		"--split-by", "USER_ID",
		"--target-dir", "ftms/tables/system_user"
	};

	String[] expandedArgs = null;
	try {
        expandedArgs = OptionsFileUtil.expandArguments(args);
    } catch (Exception e){
       System.err.println(ex.getMessage());
	   System.err.println("Try 'sqoop help' for usage.");
    }

	com.cloudera.sqoop.tool.SqoopTool tool = (com.cloudera.sqoop.tool.SqoopTool) SqoopTool.getTool("import");
	//com.cloudera.sqoop.tool.SqoopTool tool = new ImportTool();

    Configuration conf = new Configuration();
    conf.set("fs.default.name", "hdfs://192.168.242.128:9000");//設置hadoop服務地址
	Configuration pluginConf = SqoolTool.loadPlugins(conf);

	Sqoop sqoop = new Sqoop(tool, pluginConf);
	return Sqoop.runSqoop(sqoop, expandedArgs);
  }

}


3、查看導入結果

$ hadoop dfs -ls ftms/tables
…… /user/guzicheng/ftms/tables/system_user



參考:

http://iyanlei.com/java_sqoop.html

http://blog.csdn.net/wuzhongju/article/details/8938159

《Sqoop Developer’s Guide v1.4.5》

《Sqoop User Guide (v1.4.1-incubating)》

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章