i'm not asking how set replication factor in hadoop folder/file. know following command works flawlessly existing files & folders.
hadoop fs -setrep -r -w 3 <folder-path> i'm asking, how set replication factor, other default (which 4 in scenario), while copying data local. i'm running following command,
hadoop fs -copyfromlocal <src> <dest> when run above commands, copies data src dest path replication factor 4. want make replication factor 1 while copying data not after copying complete. bascially want this,
hadoop fs -setrep -r 1 -copyfromlocal <src> <dest> i tried it, didn't work. so, can done? or i've first copy data replication factor 4 , run setrep command?
according this post , this post (both asking different questions), command seems work:
hadoop fs -d dfs.replication=1 -copyfromlocal <src> <dest> the -d option means "use value given property."
Comments
Post a Comment