Context manager used for parallel processing in a
This manager creates a a context in which a pool of Python processes will be used by any of the following methods, which all support parallel processing:
These methods, which perform market-by-market computation, will distribute their work among the processes. After the context created by the
withstatement ends, all worker processes in the pool will be terminated. Outside of this context, such methods will not use multiprocessing.
Importantly, multiprocessing will only improve speed if gains from parallelization outweigh overhead from serializing and passing data between processes. For example, if computation for a single market is very fast and there is a lot of data in each market that must be serialized and passed between processes, using multiprocessing may reduce overall speed.
processes (int) – Number of Python processes that will be created and used by any method that supports parallel processing.