numpy - Install the right python version for Spark -


i use python 2.7.6 on machine

$ python --version python 2.7.6

i have on machine spark 1.1.0 depended python 2.7.6. if execute:

user@user:~/bin/spark-1.1.0$ ./bin/pyspark

i 

python 2.7.6 (default, mar 22 2014, 22:59:56)  [gcc 4.8.2] on linux2 type "help", "copyright", "credits" or "license" more information. . . .

today install new pre-built version of spark 1.3.1 (i don't know why, depended python 2.7.5). if execute same command new version:

user@user:~/bin/spark-1.3.1-bin-hadoop2.6$ ./bin/pyspark

i older python version

python 2.7.5 (default, jun 18 2014, 09:37:37)  [gcc 4.6.3] on linux2 type "help", "copyright", "credits" or "license" more information. . . .

the main difference in older spark version can execute import numpy, in new 1 not.

i created next path python in .bashrc file:

export pythonpath=$pythonpath:usr/lib/python2.7

i don't find way distinguish between version 2.7.6 , 2.7.5 in python, don't know place, python 2.7.6 stored (command find missing).

i run , worked fine. "export pyspark_python=python3"


Comments

Post a Comment

Popular posts from this blog

php - failed to open stream: HTTP request failed! HTTP/1.0 400 Bad Request -

this code i'm using find latitude , longitude of place: function coords($address){ echo $url="http://maps.googleapis.com/maps/api/geocode/json?address=".$address; $json = file_get_contents(urlencode($url)); $data = json_decode($json, true); print_r($data['results'][0]['geometry']['location']['lat']); print_r($data['results'][0]['geometry']['location']['lng']); } however returns warning: failed open stream: http request failed! http/1.0 400 bad request if use above code in simple procedure works fine not in function. note: have tried curl_init()... method produced same result? instead of encoding whole url encode address part. following code work fine $add='jamshoro phase 2'; $url="http://maps.googleapis.com/maps/api/geocode/json?address=".urlencode($add); $json = file_get_contents($url); $data = json_decode($json, true); print_r($data['r...
Read more

command line - Use qwinsta in PowerShell ISE -

i trying use qwinsta , rwinsta powershell code. when try run error "the term 'qwinsta' not recognized name of cmdlet, function, script file, or operable program." need able remotely on several machines without having add .dll's or modules other machines. tried terminal services powershell module, need able put on remote machines , not able that. within powershell ise how run qwinsta? not looking parse information gather it. following code have tried (which had found on site also): function get-tssessions { param( $computername = "localhost" ) qwinsta /server:$computername | #parse output foreach-object { $_.trim() -replace "\s+","," } | #convert objects convertfrom-csv } get-tssessions -computername "localhost" | ft -autosize best have running powershell ise (x86). when run command qwinsta there same error you. of course assuming have 64-bit os. th...
Read more

java - Incorrect order of records in M-M relationship in hibernate -

Image
i have 4 records in bridge table in mysql database. using @manytomany in hibernate, accurate order of employees incorrect incorrect of projects. following required material figure out doing mistake. this source. @entity @table(name="project") public class projectbean { @id @generatedvalue @column(name="project_id") private int projectid; @column(name="title") private string projecttitle; @manytomany(mappedby="projects") private collection<employeebean> employees; public projectbean() { employees = new arraylist<employeebean>(); } //getters & setters } @entity @table(name="employee") public class employeebean { @id @generatedvalue @column(name="employee_id") private int employee_id; @column(name="first_name") private string ...
Read more