amazon s3 - distcp from s3 to hadoop - file not found -

-

i getting below error file not found. well...the file exists. newbie distcp. using cloudera fyi.

 https://s3.amazonaws.com/test-development/test/201305031003_0_ubuntu.gz   ubuntu@ubuntu:~$ hadoop distcp -i 201305031003_0_ubuntu.gz s3://id:key@test-development/test/201305031003_0_ubuntu.gz 13/05/04 14:54:29 info tools.distcp: srcpaths=[201305031003_0_ubuntu.gz] 13/05/04 14:54:29 info tools.distcp: destpath=s3://id:key@test-development/test/201305031003_0_ubuntu.gz failures, global counters inaccurate; consider running -i copy failed: org.apache.hadoop.mapred.invalidinputexception: input source 201305031003_0_ubuntu.gz not exist.     @ org.apache.hadoop.tools.distcp.checksrcpath(distcp.java:641)     @ org.apache.hadoop.tools.distcp.copy(distcp.java:656)     @ org.apache.hadoop.tools.distcp.run(distcp.java:881)     @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:70)     @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:84)     @ org.apache.hadoop.tools.distcp.main(distcp.java:908)

the first param source should path s3 , path should s3n:// , not s3:// (native s3) unless you've written data s3 using s3:// (block file system)


Comments

Post a Comment

Popular posts from this blog

Perl - how to grep a block of text from a file -

-
it can in xml or text format. how in general grep block of text in perl? <track type="ws"> <range> <rangestart>0</rangestart> <rangeend>146.912</rangeend> <locationindex>0</locationindex> <propertyindex>0</propertyindex> </range> </track> <track type="ps" id="1"> <range> <rangestart>0</rangestart> <rangeend>146.912</rangeend> <locationindex>1</locationindex> <propertyindex>1</propertyindex> </range> </track> i want grep type="ps" , till </range> . one solution open file, read line line , match block. open(fh, "file.txt"); foreach $line (<fh>) { if ($line =~ m/type="cc"(.*?)<\/range>/) { print $1; } } but there more optimal solution without reading file line l
Read more

delphi - How to remove all the grips on a coolbar if I have several coolbands? -

-
Image
if set mycoolbar.fixedorder true,only grip on first band hidden. well,if use delphi 7 create vcl forms application,then put coolbar on , create 3 coolbans hold other controls,only grip , top coolbands can hidden setting mycoolbar.fixedorder:=true. i've uploaded picture make things clear. you got fixedorder property wrong. fixed property not allow bands rearranged if set true . setting property of coolbar true keep user changing bands order @ runtime, user can still move , resize bands. can give advice can do, actual solution problem, well, have wait answer. my advice use 3 coolbars in row , setting "fixedorder" property true , bandborderstyle bsnone . way grip hidden on of them. about property, it's not bug of ide, actual preference of property.
Read more

javascript - Animating array of divs; only the final element is modified -

-
this baffling me @ moment. i'm experienced programmer looking throw bit of surprise fiancee on countdown page our wedding. desired effect simulated confetti falling behind main page. setup follows: i have array of divs in javascript. each div absolutely positioned on page. have interval set updates every 50 or milliseconds. on each tick, run loop on array of divs, , calculations , update positions. problem problem having, however, though can see divs created, stored array, , modified (in case, each has slight randomized rotation) during initialization phase, once tick update position starts, div stored in whatever last slot of array gets position updated. tried hard-coding each div index testing purposes, strictly last element update position. upon printing current "left" , "top" style values each div before , after calculations shows value has been changed, no visible change noticeable. here's basic code: javascript var container;
Read more