Saturday, 15 May 2010

hadoop - ERROR in ImportTsv-HBASE BULK LOAD -



hadoop - ERROR in ImportTsv-HBASE BULK LOAD -

i have hbase 0.94.0. tried doing mass import using importtsv tool. here command gave

./hadoop jar /home/ericsson/desktop/projectfiles/hbase-0.94.0/hbase-0.94.0.jar importtsv -dimporttsv.columns=hbase_row_key,a,b,c,d,e,f,g '-dimporttsv.separator=,' test1 /home/ericsson/desktop/projectfiles/inputfiles1/charginusage-m-00000

test1-my table exists in hbase. /home/ericsson/desktop/projectfiles/inputfiles1/charginusage-m-00000- directory have csv file.

i got next error:

exception in thread "main" java.lang.noclassdeffounderror: com/google/common/collect/multimap @ org.apache.hadoop.hbase.mapreduce.driver.main(driver.java:43) @ sun.reflect.nativemethodaccessorimpl.invoke0(native method) @ sun.reflect.nativemethodaccessorimpl.invoke(nativemethodaccessorimpl.java:57) @ sun.reflect.delegatingmethodaccessorimpl.invoke(delegatingmethodaccessorimpl.java:43) @ java.lang.reflect.method.invoke(method.java:616) @ org.apache.hadoop.util.runjar.main(runjar.java:156) caused by: java.lang.classnotfoundexception: com.google.common.collect.multimap @ java.net.urlclassloader$1.run(urlclassloader.java:217) @ java.security.accesscontroller.doprivileged(native method) @ java.net.urlclassloader.findclass(urlclassloader.java:205) @ java.lang.classloader.loadclass(classloader.java:321) @ java.lang.classloader.loadclass(classloader.java:266) ... 6 more

importtsv task needs google's guava library in order run. library nowadays under $hbase_home/lib/guava-.jar matter of telling hadoop fetch guava jar during execution. re-create jar hbase lib hadoop lib. more decent solution add together jar path hadoop classpath or execute hadoop task below command.

export hadoop_classpath=$hadoop_classpath:$hbase_home/lib/guava-<version>.jar

or

export hadoop_classpath=`hbase classpath ` /hadoop jar /home/ericsson/desktop/projectfiles/hbase-0.94.0/hbase-0.94.0.jar importtsv -dimporttsv.columns=hbase_row_key,a,b,c,d,e,f,g '-dimporttsv.separator=,' test1 /home/ericsson/desktop/projectfiles/inputfiles1/charginusage-m-00000*

hadoop hbase

1 comment: