job scheduling - Array jobs using R scripts -


i have r script use on our linux hpc interactive session.

the script test based on set/list of items, , runs 10,000 permutations of test using snow create cluster parrelelise permuations (to run log onto whole node , use processors available me) i.e:

cl <- makecluster(rep("localhost",10), type = "sock") shortlist <-longlist[1] test.result <- test(cl=cl, data=data, items=shortlist, permutations=10000) 

for each of items in list, test permutations takes ~3hours. have ~1500 items run either:

-make script can generate lots of r scripts, numbered sequentially , each drawing on 1-2 items, can each be submitted singly, using array job wrapper.

-or cleverer means dont have generate 750-1500 r scripts results in same.

so know how submit r script in bash script, don't know how put in way iterate through list within r script. possibly it's easy might why cant find relevant (or using wrong terminology?) pointers welcome.


Comments

Popular posts from this blog

c# - DetailsView in ASP.Net - How to add another column on the side/add a control in each row? -

javascript - firefox memory leak -

Trying to import CSV file to a SQL Server database using asp.net and c# - can't find what I'm missing -