linux - what's the best way to fast copy some big file from serval servers to hunderands servers? -


there big file on serval of servers, want copy servers fast possible. below current script, there faster way this, viral distribution, example: source a, targets b c d. a->b, after b done ,then b->c , a->d (at same time) . how can improve script, sugesstion, !

#!/bin/bash  set -u  source_pool=(seq -f 10.10.10.%g 10 20)  host_ip_list=(seq -f 10.10.10.%g 21 200)     ready_flag=/tmp/ready_flag lock_flag=/tmp/lock_flag   do_lock(){     ip=$1;shift 1     ssh root@$ip "touch $lock_flag" }  do_unlock(){     ip=$1;shift 1     ssh root@$ip "rm -f $lock_flag" }  find_source(){     while true;do         source_ip in ${source_pool[@]}                     ping $source_ip -c 1 1>/dev/null 2>/dev/null             if [[ $? -ne 0 ]];then                 continue             fi                ssh root@$source_ip "ls $lock_flag" 1>/dev/null 2>/dev/null             if [[ $? -eq 0 ]];then                 continue             fi              ssh root@$source_ip "ls $ready_flag" 1>/dev/null 2>/dev/null             if [[ $? -ne 0 ]];then                 continue             fi                do_lock $source_ip             echo $source_ip             return 0         done          source_ip in ${host_ip_list[@]}                     ping $source_ip -c 1 1>/dev/null 2>/dev/null             if [[ $? -ne 0 ]];then                 continue             fi                ssh root@$source_ip "ls $lock_flag" 1>/dev/null 2>/dev/null             if [[ $? -eq 0 ]];then                 continue             fi              ssh root@$source_ip "ls $ready_flag" 1>/dev/null 2>/dev/null             if [[ $? -ne 0 ]];then                 continue             fi                do_lock $source_ip             echo $source_ip             return 0         done         sleep 3     done     return 1 }  do_scp(){     source_ip=$1;shift 1     target_ip=$1;shift 1     ssh root@$target_ip "scp root@$source_ip:~/some_big_file.tar ."      ssh root@$target_ip "touch $ready_flag"     do_unlock $source_ip }   scp_all(){     target_ip in ${host_ip_list[@]}             source_ip=$(find_source)         do_scp $source_ip $target_ip &     done }   do_wait(){         local flag=1         while [[ $flag -eq 1 ]];do                 flag=0                 ip in ${host_ip_list[@]}                                         scp_num=`ssh root@$ip  "ps -ef | grep scp | grep -v grep | wc -l" `                         if [[ $scp_num -ne 0 ]];then                                 flag=1                                 break                         fi                 done                 sleep 30         done } scp_all do_wait


Comments

Post a Comment

Popular posts from this blog

c++ - Difference between pre and post decrement in recursive function argument -

i have following sample code used pre-decrement void function(int c) { if(c == 0) { return; } else { cout << "dp" << c << endl; function(--c); cout << c << endl; return; } } this function give output input 4 : dp3 dp2 dp1 dp0 0 1 2 3 but when use post decrement void function(int c) { if(c == 0) { return; } else { cout << "dp" << c << endl; function(c--); cout << c << endl; return; } } output goes in infinite loop dp4 can explain me in detail why happens ? this happens because function(c--) called same value of c , when finishes c decremented. recursively called, hence called same value no chance of return , hit stack overflow error. assume this, int x = 1, y = 0; y = x++ result y == 1 , x == 2. if y = ++x , bot x , y 2.
Read more

php - Nothing but 'run(); ' when browsing to my local project, how do I fix this? -

i added new project. made mistake in projectname.conf file in sites-available apache2, led me reinstalling apache2. after reinstalling , re-enabling projects on every page of every project .. <body> run(); </body> .. i've run composer update, restarted service, restarted pc, checked config files, tried disabling new project. there nothing in error log, , access.log: 127.0.0.1 - - [15/may/2015:01:40:47 +0200] "get / http/1.1" 304 181 "-" "mozilla/5.0 (x11; ubuntu; linux x86_64; rv:38.0) gecko/20100101 firefox/38.0" maybe i'm forgetting apache2 reinstall? don't think did different last time installed it. looks haven't setup php correctly. take @ this great guide , maybe you're forgetting link php config apache2.
Read more

php - How can I echo out this array? -

i don't know how go grabbing data in variable , put foreach loop. class tree{ private $info = array( array('name'=>'jim','state'=>'nu','company'=>'nu','phone'=>array('cell'=>'5615111111','office'=>'5611111111'),'email'=>array('primary'=>'exs@example.com','ex@there.com')), array('name'=>'joe smith','city'=>'phoenix','phone'=>'4805551111','email'=>'jsmith@some_email.com'), array('name'=>'john doe','city'=>'chandler','company'=>'doe co.','email'=>array('jdoe@gmail.com','personal'=>'email@email.com'),'phone'=>'6025550002') ); } if you're inside of class, can access private variable using $this->variablename . example, i...
Read more