Python’s multiprocessing module is the new hottness

The new multiprocessing module in Python 2.6 and 3.0 looks pretty cool. It gets around the whole, um, design for low performance where the dreaded Global Interpreter Lock (GIL) makes multithreading difficult, by making it easy to spawn python subprocesses, communicate with them, and share data. They even have a form of security on the sockets so that bad guys can’t send any data to any of the processes w/o knowing a secret key.

Note to self: explore writing a toy multi-core mapreduce with ‘import multiprocessing’…

Leave a Reply »»