如何取消使用`concurrent.futures.ProcessPoolExecutor`运行的长时间运行的子进程?

时间:2017-02-19 09:24:40

标签: python python-multiprocessing python-asyncio

您可以看到完整的here

我的代码的简化版本如下:

executor = ProcessPoolExecutor(10)
try:
    coro = bot.loop.run_in_executor(executor, processUserInput, userInput)
    result = await asyncio.wait_for(coro, timeout=10.0, loop=bot.loop)
except asyncio.TimeoutError:
    result="Operation took longer than 10 seconds. Aborted."

不幸的是,当操作超时时,即使未来已被取消,该进程仍在运行。如何取消该进程/任务以使其实际停止运行?

1 个答案:

答案 0 :(得分:1)

ProcessPoolExecutor使用multiprocessing模块。而不是取消没有.terminate()子进程的事件,建议使用multiprocessing.Event来允许子进程正确退出:

import asyncio
import multiprocessing
import time
from concurrent.futures.process import ProcessPoolExecutor


def f(done):
    print("hi")

    while not done.is_set():
        time.sleep(1)
        print(".")

    print("bye")

    return 12345


async def main():
    done = manager.Event()
    fut = loop.run_in_executor(None, f, done)
    print("waiting...")
    try:
        result = await asyncio.wait_for(asyncio.shield(fut), timeout=3)
    except asyncio.TimeoutError:
        print("timeout, exiting")
        done.set()
        result = await fut
    print("got", result)

loop = asyncio.get_event_loop()
loop.set_default_executor(ProcessPoolExecutor())
manager = multiprocessing.Manager()

loop.run_until_complete(main())