multithreading - Can I read 1 big CSV file in parallel in R? -


this question has answer here:

i have big csv file , takes ages read. can read in parallel in r using package "parallel" or related? i've tried using mclapply, not working.

based upon comment op, fread data.table package worked. here's code:

library(data.table) dt <- fread("myfile.csv")

in op's case, read in time 1.2gb file read.csv took 4-5 minutes , 14 seconds fread.


Comments

Post a Comment

Popular posts from this blog

command line - Use qwinsta in PowerShell ISE -

i trying use qwinsta , rwinsta powershell code. when try run error "the term 'qwinsta' not recognized name of cmdlet, function, script file, or operable program." need able remotely on several machines without having add .dll's or modules other machines. tried terminal services powershell module, need able put on remote machines , not able that. within powershell ise how run qwinsta? not looking parse information gather it. following code have tried (which had found on site also): function get-tssessions { param( $computername = "localhost" ) qwinsta /server:$computername | #parse output foreach-object { $_.trim() -replace "\s+","," } | #convert objects convertfrom-csv } get-tssessions -computername "localhost" | ft -autosize best have running powershell ise (x86). when run command qwinsta there same error you. of course assuming have 64-bit os. th...
Read more

java - Incorrect order of records in M-M relationship in hibernate -

Image
i have 4 records in bridge table in mysql database. using @manytomany in hibernate, accurate order of employees incorrect incorrect of projects. following required material figure out doing mistake. this source. @entity @table(name="project") public class projectbean { @id @generatedvalue @column(name="project_id") private int projectid; @column(name="title") private string projecttitle; @manytomany(mappedby="projects") private collection<employeebean> employees; public projectbean() { employees = new arraylist<employeebean>(); } //getters & setters } @entity @table(name="employee") public class employeebean { @id @generatedvalue @column(name="employee_id") private int employee_id; @column(name="first_name") private string ...
Read more

php - I want to create a website for polls/survey like this http://www.poll-maker.com/ -

but did not understand the concept of generating link & more importantly how save data in database,do save id of poll & yes/no click or done other logic. what happen polls expired? remain in database or somewhere else? please help to handle url can use curl. but have easy method. can use concept of query strings . to create new question store new question in database.give each question unique id. then after user submits questions show him link like: http://do-survey.com?question=xzxsa to store polls get question like: if(isset($_get['question'])) { $question = $_get['question']; // have question unique id manipulate database using }
Read more