我使用dask-client submit api运行多个并发dask作业。它多次遇到过这个问题。
特定工作人员的线程转储显示以下信息。
有人可以指导我解决这个问题。
ts_data = dask_df[key].values.compute()
File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/dask/base.py", line 135, in compute
(result,) = compute(self, traverse=False, **kwargs)
File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/dask/base.py", line 333, in compute
results = get(dsk, keys, **kwargs)
File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/distributed/client.py", line 1999, in get
results = self.gather(packed, asynchronous=asynchronous)
File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/distributed/client.py", line 1437, in gather
asynchronous=asynchronous)
File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/distributed/client.py", line 592, in sync
return sync(self.loop, func, *args, **kwargs)
File "/agent/miniconda3/envs/py361/lib/python3.6/site-packages/distributed/utils.py", line 252, in sync
e.wait(1000000)
File "/agent/miniconda3/envs/py361/lib/python3.6/threading.py", line 551, in wait
signaled = self._cond.wait(timeout)
File "/agent/miniconda3/envs/py361/lib/python3.6/threading.py", line 299, in wait
gotit = waiter.acquire(True, timeout)