使用 dask-gateway 创建新的 k8s dask 集群时配置调度程序和工作程序模板

时间:2021-06-21 15:22:01

标签: dask dask-distributed dask-kubernetes dask-gateway

我不清楚在使用 [dask-gateway][1] 时如何替换 dask 调度程序/工作器模板。

背景:我之前成功配置了dask-distributed & dask-kubernetes,在提交新任务时使用以下模板:

kubernetes:
  scheduler-template:
    kind: Pod
    metadata:
      labels:
        foo: bar
    spec:
      restartPolicy: Never
      containers:
      - name: dask-scheduler
        image: eu.gcr.io/foo/bar/baz:latest
        imagePullPolicy: IfNotPresent
        args:
          - dask-scheduler
          - --no-dashboard
        env:
          - name: EXTRA_PIP_PACKAGES
            value: git+https://github.com/dask/distributed pandas scikit-learn --upgrade
  worker-template:
    kind: Pod
    metadata:
      labels:
        foo: bar
    spec:
      restartPolicy: Never
      containers:
      - name: dask-worker
        image: eu.gcr.io/foo/bar/baz:latest
        imagePullPolicy: IfNotPresent
        args:
          - dask-worker
          - --nprocs
          - auto
          - --no-dashboard
          - --death-timeout
          - "60"
        env:
          - name: EXTRA_PIP_PACKAGES
            value: git+https://github.com/dask/distributed pandas scikit-learn --upgrade

有人可以帮助我更好地理解如何配置使用 dask-gateway 创建的调度程序和工作人员以使用上述配置吗? [1]:https://gateway.dask.org/install-kube.html#

0 个答案:

没有答案
相关问题