job scheduling - Array jobs using R scripts -
i have r script use on our linux hpc interactive session.
the script test based on set/list of items, , runs 10,000 permutations of test using snow create cluster parrelelise permuations (to run log onto whole node , use processors available me) i.e:
cl <- makecluster(rep("localhost",10), type = "sock") shortlist <-longlist[1] test.result <- test(cl=cl, data=data, items=shortlist, permutations=10000)
for each of items in list, test permutations takes ~3hours. have ~1500 items run either:
-make script can generate lots of r scripts, numbered sequentially , each drawing on 1-2 items, can each be submitted singly, using array job wrapper.
-or cleverer means dont have generate 750-1500 r scripts results in same.
so know how submit r script in bash script, don't know how put in way iterate through list within r script. possibly it's easy might why cant find relevant (or using wrong terminology?) pointers welcome.
Comments
Post a Comment