2013年1月27日 星期日

PiCloud + python


  • job manager
    • job create job
      • reduce the thread acquire time, try lock/mutex times
    • job queue, job schedule, job status. job new/delete
  • watch dog
    • performance monitor  
  • scientific tools
    • numpy(math array), h5py(python hash table), pandas(big data), scipy(science), scikits(machine learning)
  • multi environments support
    • ubuntu 11.04, 12.04 for user set 
  • notebook support
  • core, memory set
    • how many cores set, and memory usage limitation
  •  performance benchmark
    • ex: PI  seep up 5 times for multi process assign to multi core by mapping table set

          num_jobs = 8
          tests_per_call = total_tests/num_jobs
      
          # argument list has 8 duplicate elements
          jids = cloud.map(monte_carlo, [tests_per_call]*num_jobs, _type='c2')
      
          # get list of all counts
          num_in_circle_list = cloud.result(jids)
  • daily run(schedule run)
  • web support
    • Django

沒有留言:

張貼留言