do_in_parallel(_sleep(3), _sleep(8), maybe_do_something(else, and_else))
这个调用结构无论如何都不起作用,因为您将目标函数的结果传递给do_in_parallel
(您已经在调用 _sleep 等)。
相反,你需要做的是捆绑起来tasks并将这些任务传递给您的处理功能。这里的任务是一个元组,包含要调用的目标函数和一个参数元组task = (_sleep, (n,))
.
我建议你使用 ThreadPool 和apply_async
方法来处理单独的任务。
from time import sleep
from multiprocessing.dummy import Pool # .dummy.Pool is a ThreadPool
def _sleep(n):
sleep(n)
result = f'slept {n}'
print(result)
return result
def _add(a, b):
result = a + b
print(result)
return result
def do_threaded(tasks):
with Pool(len(tasks)) as pool:
results = [pool.apply_async(*t) for t in tasks]
results = [res.get() for res in results]
return results
if __name__ == '__main__':
tasks = [(_sleep, (i,)) for i in [3, 8, 3]]
# [(<function _sleep at 0x7f035f844ea0>, (3,)),
# (<function _sleep at 0x7f035f844ea0>, (8,)),
# (<function _sleep at 0x7f035f844ea0>, (3,))]
tasks += [(_add, (a, b)) for a, b in zip(range(0, 3), range(10, 13))]
print(do_threaded(tasks))
Output:
10
12
14
slept 3
slept 3
slept 8
['slept 3', 'slept 8', 'slept 3', 10, 12, 14]
Process finished with exit code 0