基本设置时气流非常缓慢

时间:2019-06-24 14:12:53

标签: airflow

我正在尝试使用基本教程运行气流,该教程基本上运行一个简单的约会和睡眠5。我有一台具有32 GB RAM和SSD磁盘的i7核心macOS计算机。我没有其他气流

这是日志。

airflow backfill mytest -s 2015-06-01
[2019-06-24 15:07:55,729] {__init__.py:51} INFO - Using executor SequentialExecutor
[2019-06-24 15:07:55,874] {__init__.py:305} INFO - Filling up the DagBag from /Users/sbo/airflow/dags
[2019-06-24 15:08:00,929] {base_executor.py:59} INFO - Adding to queue: ['airflow', 'run', 'mytest', 'print_date', '2015-06-01T00:00:00+00:00', '--local', '-sd', 'DAGS_FOLDER/mytest.py', '--cfg_path', '/var/folders/ns/jpbbcbds5xg2flgbymdfw0k80000gn/T/tmplgom29si']
[2019-06-24 15:08:05,886] {sequential_executor.py:45} INFO - Executing command: ['airflow', 'run', 'mytest', 'print_date', '2015-06-01T00:00:00+00:00', '--local', '-sd', 'DAGS_FOLDER/mytest.py', '--cfg_path', '/var/folders/ns/jpbbcbds5xg2flgbymdfw0k80000gn/T/tmplgom29si']
[2019-06-24 15:08:06,347] {__init__.py:51} INFO - Using executor SequentialExecutor
[2019-06-24 15:08:06,493] {__init__.py:305} INFO - Filling up the DagBag from /Users/sbo/airflow/dags/mytest.py
[2019-06-24 15:08:11,521] {cli.py:517} INFO - Running <TaskInstance: mytest.print_date 2015-06-01T00:00:00+00:00 [queued]> on host MacQuela18.local
[2019-06-24 15:08:36,699] {jobs.py:2124} INFO - [backfill progress] | finished run 0 of 1 | tasks waiting: 2 | succeeded: 1 | running: 0 | failed: 0 | skipped: 0 | deadlocked: 0 | not ready: 2
[2019-06-24 15:08:36,708] {base_executor.py:59} INFO - Adding to queue: ['airflow', 'run', 'mytest', 'sleep', '2015-06-01T00:00:00+00:00', '--local', '-sd', 'DAGS_FOLDER/mytest.py', '--cfg_path', '/var/folders/ns/jpbbcbds5xg2flgbymdfw0k80000gn/T/tmpjy9t4vb0']
[2019-06-24 15:08:36,719] {base_executor.py:59} INFO - Adding to queue: ['airflow', 'run', 'mytest', 'templated', '2015-06-01T00:00:00+00:00', '--local', '-sd', 'DAGS_FOLDER/mytest.py', '--cfg_path', '/var/folders/ns/jpbbcbds5xg2flgbymdfw0k80000gn/T/tmp8caqdpg_']
[2019-06-24 15:08:36,725] {sequential_executor.py:45} INFO - Executing command: ['airflow', 'run', 'mytest', 'sleep', '2015-06-01T00:00:00+00:00', '--local', '-sd', 'DAGS_FOLDER/mytest.py', '--cfg_path', '/var/folders/ns/jpbbcbds5xg2flgbymdfw0k80000gn/T/tmpjy9t4vb0']
[2019-06-24 15:08:37,259] {__init__.py:51} INFO - Using executor SequentialExecutor
[2019-06-24 15:08:37,442] {__init__.py:305} INFO - Filling up the DagBag from /Users/sbo/airflow/dags/mytest.py
[2019-06-24 15:08:42,473] {cli.py:517} INFO - Running <TaskInstance: mytest.sleep 2015-06-01T00:00:00+00:00 [queued]> on host MacQuela18.local
[2019-06-24 15:09:07,621] {sequential_executor.py:45} INFO - Executing command: ['airflow', 'run', 'mytest', 'templated', '2015-06-01T00:00:00+00:00', '--local', '-sd', 'DAGS_FOLDER/mytest.py', '--cfg_path', '/var/folders/ns/jpbbcbds5xg2flgbymdfw0k80000gn/T/tmp8caqdpg_']
[2019-06-24 15:09:08,080] {__init__.py:51} INFO - Using executor SequentialExecutor
[2019-06-24 15:09:08,227] {__init__.py:305} INFO - Filling up the DagBag from /Users/sbo/airflow/dags/mytest.py
[2019-06-24 15:09:13,254] {cli.py:517} INFO - Running <TaskInstance: mytest.templated 2015-06-01T00:00:00+00:00 [queued]> on host MacQuela18.local
[2019-06-24 15:09:38,403] {__init__.py:4854} INFO - Marking run <DagRun mytest @ 2015-06-01T00:00:00+00:00: backfill_2015-06-01T00:00:00+00:00, externally triggered: False> successful
[2019-06-24 15:09:38,406] {jobs.py:2124} INFO - [backfill progress] | finished run 1 of 1 | tasks waiting: 0 | succeeded: 3 | running: 0 | failed: 0 | skipped: 0 | deadlocked: 0 | not ready: 0
[2019-06-24 15:09:38,406] {jobs.py:2495} INFO - Backfill done. Exiting.

完成执行几乎需要两分钟。这是预期的吗?

0 个答案:

没有答案