linux - Parallel Processing in While Loop -


i have .sh reading in lines .txt used parameters shell script.every 2 lines process in parallel. currently: current code read in lines in file (2 @ time) first .sh call, lines second .sh call, last .sh call

problem: need first 2 lines in first .sh, second .sh, last .sh..then loop , process next 2 lines hheeelllppp!!! :)

now:

cat xxxxx.txt | while read line; export step=${line//\"/} export step=executemodel_${step//,/_} export pov=$line  $dir"/hpm_ws_client.sh" processcalcscriptoptions  "$appname" "$pov" "$layers" "$stages" "" "$stages" "$stages" false > "$dir""/"$step"_processid.log" $dir_shell_model"/check_process_status.sh" "$dir" "$step" > "$dir""/""$step""_monitor.log" &   $dir"/hpm_ws_client.sh" processcalcscriptoptions "$appname" "$pov" "$layers" "" ""  "$stage_final" "" true > "$dir""/""$step""_processid.log" $dir"/check_process_status.sh" "$dir" "$step" > "$dir""/""$step""_monitor.log" &  $dir"/hpm_ws_client.sh" processgenealogyexecutionpaths "$appname" "$pov" "$layers" "$genpath_01" > "$dir""/""$step""_processid.log" $dir"/check_process_status.sh" "$dir" "$step" > "$dir""/""$step""_monitor.log" &  if (( ++i % 2 == 0)) echo "waiting..." wait fi done

i cannot see trying do, hope 1 of these 2 syntaxes - either reading 2 lines @ time, or loading parameters array re-using them.

so, if file.txt looks this:

line 1 line 2 line 3 line 4 line 5 line 6

example 1 - 2 reads

#!/bin/bash while read && read b;    echo $a, $b done < file.txt

output

line 1, line 2 line 3, line 4 line 5, line 6

example 2 - bash array

#!/bin/bash declare -a params while ifs=$'\n' read -r z;     params+=("${z}") done < file.txt  # print elements out (( i=0;i<${#params[@]};i++ ))    echo ${params[$i]} done

output

line 1 line 2 line 3 line 4 line 5 line 6

example 3 - gnu parallel

or, suggested in comment, use gnu parallel this

parallel -k -l2 echo {1} {2} < file.txt

output

line 1 line 2 line 3 line 4 line 5 line 6

where -k means "keep output in order" , -l2 means "take 2 lines @ time file.txt".

this has advantage that, if want run 8 scripts @ time in parallel, specify -j 8 parallel , job done.


Comments

Post a Comment

Popular posts from this blog

php - failed to open stream: HTTP request failed! HTTP/1.0 400 Bad Request -

this code i'm using find latitude , longitude of place: function coords($address){ echo $url="http://maps.googleapis.com/maps/api/geocode/json?address=".$address; $json = file_get_contents(urlencode($url)); $data = json_decode($json, true); print_r($data['results'][0]['geometry']['location']['lat']); print_r($data['results'][0]['geometry']['location']['lng']); } however returns warning: failed open stream: http request failed! http/1.0 400 bad request if use above code in simple procedure works fine not in function. note: have tried curl_init()... method produced same result? instead of encoding whole url encode address part. following code work fine $add='jamshoro phase 2'; $url="http://maps.googleapis.com/maps/api/geocode/json?address=".urlencode($add); $json = file_get_contents($url); $data = json_decode($json, true); print_r($data['r
Read more

java - How to filter a backspace keyboard input -

i have code gives message when key number pressed: txtvalueofclause.addeventfilter(keyevent.key_typed, new eventhandler<keyevent>() { @override public void handle(keyevent t) { char ar[] = t.getcharacter().tochararray(); char ch = ar[t.getcharacter().tochararray().length - 1]; if (!(ch >= '0' && ch <= '9')) { system.out.println("the char entered not number"); t.consume(); } } }); now if press on wrong button , press backspace remove it, error message. how can add backspace input if statement? i have found answer: txtvalueofclause.addeventfilter(keyevent.key_typed, new eventhandler<keyevent>() { @override public void handle(keyevent t) { char ar[] = t.getcharacter().tochararray(); char ch = ar[t.getcharacter().tochar
Read more

java - Show Soft Keyboard when EditText Appears -

i have code in android app, alert dialog , keyboard, , when dialog shown want keyboard appear. not , not sure why? here code: final alertdialog.builder alert = new alertdialog.builder(this); alert.settitle("title"); alert.setmessage("message"); final edittext input = new edittext(this); input.setinputtype(inputtype.type_class_number); alert.setview(input); input.setonfocuschangelistener(new view.onfocuschangelistener() { @override public void onfocuschange(view v, boolean hasfocus) { if (hasfocus) { log.i(tag, "in focus"); inputmethodmanager inputmethodmanager = (inputmethodmanager) getsystemservice(context.input_method_service); inputmethodmanager.showsoftinput(input, inputmethodmanager.show_implicit); } } }); but keyboard not appear though edit text in focus, , tell appear why, doesn't come up? thanks in advance.
Read more