如何在端口80上运行airflow webserver

时间:2017-08-30 07:01:04

标签: webserver apache-airflow

当我将气流网络服务器设置为在端口80上运行时,该服务未执行并因以下错误而失败:

...
[2017-08-30 06:26:35,286] {__init__.py:57} INFO - Using executor CeleryExecutor
[2017-08-30 06:26:35,421] {driver.py:120} INFO - Generating grammar tables from /usr/lib/python3.5/lib2to3/Grammar.txt
[2017-08-30 06:26:35,463] {driver.py:120} INFO - Generating grammar tables from /usr/lib/python3.5/lib2to3/PatternGrammar.txt
[2017-08-30 06:26:35 +0000] [9401] [INFO] Starting gunicorn 19.3.0
[2017-08-30 06:26:35 +0000] [9401] [ERROR] Retrying in 1 second.
[2017-08-30 06:26:36 +0000] [9401] [ERROR] Retrying in 1 second.
[2017-08-30 06:26:37 +0000] [9401] [ERROR] Retrying in 1 second.
[2017-08-30 06:26:38 +0000] [9401] [ERROR] Retrying in 1 second.
[2017-08-30 06:26:39 +0000] [9401] [ERROR] Retrying in 1 second.
[2017-08-30 06:26:40 +0000] [9401] [ERROR] Can't connect to ('0.0.0.0', 80)
...

在AWS上托管的Ubuntu 16.04上使用systemd。如果在端口8080上运行,整个设置运行良好。

相关配置部分:

$ grep web_server_port /home/ubuntu/airflow/airflow.cfg
web_server_port = 80

服务配置:

$ cat /usr/lib/systemd/system/airflow-webserver.service 
[Unit]
Description=Airflow webserver daemon
After=network.target postgresql.service mysql.service redis.service rabbitmq-server.service
Wants=postgresql.service mysql.service redis.service rabbitmq-server.service

[Service]
User=ubuntu
Group=ubuntu
Type=simple
ExecStart=/usr/local/bin/airflow webserver --pid /home/ubuntu/airflow/webserver.pid
Restart=on-failure
RestartSec=5s
PrivateTmp=true

[Install]
WantedBy=multi-user.target

1 个答案:

答案 0 :(得分:0)

问题是端口80只能由root用户使用。解决问题所需的/usr/lib/systemd/system/airflow-webserver.service中唯一的变化是:

  • 删除UserGroup:root是默认值
  • 设置airflow home环境变量:因为服务在/root/airflow
  • 中寻找气流

新服务配置:

$ cat /usr/lib/systemd/system/airflow-webserver.service 
[Unit]
Description=Airflow webserver daemon
After=network.target postgresql.service mysql.service redis.service rabbitmq-server.service
Wants=postgresql.service mysql.service redis.service rabbitmq-server.service

[Service]
Environment=AIRFLOW_HOME=/home/ubuntu/airflow
Type=simple
ExecStart=/usr/local/bin/airflow webserver --pid /home/ubuntu/airflow/webserver.pid
Restart=on-failure
RestartSec=5s
PrivateTmp=true

[Install]
WantedBy=multi-user.target