2012年9月24日 星期一

multiprocessing vs thread


 multiprocessing vs thread vs serial
http://eli.thegreenplace.net/2012/01/16/python-parallelizing-cpu-bound-tasks-with-multiprocessing/

http://bpgergo.blogspot.tw/2011/08/matrix-multiplication-in-python.html

http://docs.python.org/library/multiprocessing.html

http://eli.thegreenplace.net/2011/12/27/python-threads-communication-and-stopping/

https://github.com/jerkos/metms_final/blob/dfccf8c88372d193f64dbe4ac4b062a7f04609b3/controller/dialog/MetClusteringControl.py

https://github.com/dagss/joblib/blob/0cd09592930dc1dea6ae3fcd92bad65a5eff1774/joblib/test/stresstest_store.py

http://www.doughellmann.com/PyMOTW/multiprocessing/communication.html


bundle method
http://stackoverflow.com/questions/1289813/python-multiprocessing-vs-threading-for-cpu-bound-work-on-windows-and-linux

2012年9月17日 星期一

python big data analysis


http://blog.wesmckinney.com/

panda + mongodb
https://github.com/pld/bamboo/blob/master/bamboo/models/observation.py


light weight performance bench
https://github.com/pydata/vbench

http://www.youtube.com/watch?v=hnhN2_TpY8g

hdf5
http://www.hdfgroup.org/tools5app.html