Skip to content

Instantly share code, notes, and snippets.

@jlewi

jlewi/gist:b54391a8d684098550ee3e5ea23c8dcf

Created January 10, 2018 11:31
Show Gist options
  • Save jlewi/b54391a8d684098550ee3e5ea23c8dcf to your computer and use it in GitHub Desktop.
Save jlewi/b54391a8d684098550ee3e5ea23c8dcf to your computer and use it in GitHub Desktop.
Download ZIP
Latest failure
Raw
gistfile1.txt
Airflow
DAGs
Data Profiling
Browse
Admin
Docs
About
11:31 UTC
OnOff DAG: tf_k8s_tests schedule: None
Graph View
Tree View
Task Duration
Task Tries
Landing Times
Gantt
Details
Code
Refresh
Task Instance: build_images
2018-01-10 08:34:47
Task Instance Details
Rendered Template
Log
XCom
Log by attempts
1
2
*** Reading local log.
[2018-01-10 08:35:04,112] {cli.py:379} INFO - Running on host airflow-2497854871-0dr9k
[2018-01-10 08:35:04,171] {models.py:1173} INFO - Dependencies all met for <TaskInstance: tf_k8s_tests.build_images 2018-01-10 08:34:47 [queued]>
[2018-01-10 08:35:04,194] {models.py:1173} INFO - Dependencies all met for <TaskInstance: tf_k8s_tests.build_images 2018-01-10 08:34:47 [queued]>
[2018-01-10 08:35:04,194] {models.py:1383} INFO -
--------------------------------------------------------------------------------
Starting attempt 1 of 2
--------------------------------------------------------------------------------
[2018-01-10 08:35:04,220] {models.py:1404} INFO - Executing <Task(PythonOperator): build_images> on 2018-01-10 08:34:47
[2018-01-10 08:35:04,221] {base_task_runner.py:115} INFO - Running: ['bash', '-c', u'airflow run tf_k8s_tests build_images 2018-01-10T08:34:47 --job_id 3373 --raw -sd DAGS_FOLDER/e2e_tests_dag.py']
[2018-01-10 08:35:07,318] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:07,318] {__init__.py:45} INFO - Using executor LocalExecutor
[2018-01-10 08:35:07,463] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:07,463] {models.py:189} INFO - Filling up the DagBag from /usr/local/airflow/dags/e2e_tests_dag.py
[2018-01-10 08:35:07,467] {base_task_runner.py:98} INFO - Subtask: /usr/local/lib/python2.7/site-packages/apache_airflow-1.9.0rc2-py2.7.egg/airflow/utils/helpers.py:351: DeprecationWarning: Importing PythonOperator directly from <module 'airflow.operators' from '/usr/local/lib/python2.7/site-packages/apache_airflow-1.9.0rc2-py2.7.egg/airflow/operators/__init__.pyc'> has been deprecated. Please import from '<module 'airflow.operators' from '/usr/local/lib/python2.7/site-packages/apache_airflow-1.9.0rc2-py2.7.egg/airflow/operators/__init__.pyc'>.[operator_module]' instead. Support for direct imports will be dropped entirely in Airflow 2.0.
[2018-01-10 08:35:07,468] {base_task_runner.py:98} INFO - Subtask: DeprecationWarning)
[2018-01-10 08:35:08,186] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,185] {e2e_tests_dag.py:176} INFO - dag_id: tf_k8s_tests
[2018-01-10 08:35:08,187] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,187] {e2e_tests_dag.py:177} INFO - run_id: 2018-01-10T08:34:47
[2018-01-10 08:35:08,209] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,209] {e2e_tests_dag.py:180} INFO - Using run_dir=/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47
[2018-01-10 08:35:08,229] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,229] {e2e_tests_dag.py:183} INFO - Using src_dir=/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s
[2018-01-10 08:35:08,231] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,231] {e2e_tests_dag.py:186} INFO - gcs_path gs://mlkube-testing-airflow/runs/tf_k8s_tests/2018-01-10T08_34_47
[2018-01-10 08:35:08,232] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,232] {e2e_tests_dag.py:191} INFO - conf={u'PULL_NUMBER': u'273', u'PULL_BASE_SHA': u'9c93d5fe62e1b727039ac3ecb634488653cd1a48', u'ARTIFACTS_PATH': u'gs://kubernetes-jenkins/pr-logs/pull/tensorflow_k8s/273/tf-k8s-presubmit/337/artifacts', u'PULL_PULL_SHA': u'0bf06816f2f40c6720964260d06e39bb020af397'}
[2018-01-10 08:35:08,233] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,232] {e2e_tests_dag.py:193} INFO - artifacts_path gs://kubernetes-jenkins/pr-logs/pull/tensorflow_k8s/273/tf-k8s-presubmit/337/artifacts
[2018-01-10 08:35:08,233] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,233] {e2e_tests_dag.py:83} INFO - Removing /opt/tensorflow_k8s from PYTHONPATH
[2018-01-10 08:35:08,249] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,248] {e2e_tests_dag.py:104} INFO - Using util located at /opt/tensorflow_k8s/py/util.pyc
[2018-01-10 08:35:08,251] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,249] {util.py:36} INFO - Running: python -m py.release build --src_dir=/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s --build_info_path=gs://mlkube-testing-airflow/runs/tf_k8s_tests/2018-01-10T08_34_47/build_info.yaml --releases_path=gs://mlkube-testing-airflow/runs/tf_k8s_tests/2018-01-10T08_34_47 --project=mlkube-testing
[2018-01-10 08:35:08,251] {base_task_runner.py:98} INFO - Subtask: cwd=None
[2018-01-10 08:35:08,252] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:35:08,250] {util.py:46} INFO - Running: Environment:
[2018-01-10 08:35:08,252] {base_task_runner.py:98} INFO - Subtask: AIRFLOW_PORT=tcp://10.63.240.90:80
[2018-01-10 08:35:08,253] {base_task_runner.py:98} INFO - Subtask: AIRFLOW_PORT_80_TCP=tcp://10.63.240.90:80
[2018-01-10 08:35:08,254] {base_task_runner.py:98} INFO - Subtask: AIRFLOW_PORT_80_TCP_ADDR=10.63.240.90
[2018-01-10 08:35:08,254] {base_task_runner.py:98} INFO - Subtask: AIRFLOW_PORT_80_TCP_PORT=80
[2018-01-10 08:35:08,255] {base_task_runner.py:98} INFO - Subtask: AIRFLOW_PORT_80_TCP_PROTO=tcp
[2018-01-10 08:35:08,256] {base_task_runner.py:98} INFO - Subtask: AIRFLOW_SERVICE_HOST=10.63.240.90
[2018-01-10 08:35:08,258] {base_task_runner.py:98} INFO - Subtask: AIRFLOW_SERVICE_PORT=80
[2018-01-10 08:35:08,258] {base_task_runner.py:98} INFO - Subtask: CLOUDSDK_CORE_DISABLE_PROMPTS=1
[2018-01-10 08:35:08,258] {base_task_runner.py:98} INFO - Subtask: DEBIAN_FRONTEND=noninteractive
[2018-01-10 08:35:08,259] {base_task_runner.py:98} INFO - Subtask: DECK_PORT=tcp://10.63.247.198:80
[2018-01-10 08:35:08,259] {base_task_runner.py:98} INFO - Subtask: DECK_PORT_80_TCP=tcp://10.63.247.198:80
[2018-01-10 08:35:08,260] {base_task_runner.py:98} INFO - Subtask: DECK_PORT_80_TCP_ADDR=10.63.247.198
[2018-01-10 08:35:08,260] {base_task_runner.py:98} INFO - Subtask: DECK_PORT_80_TCP_PORT=80
[2018-01-10 08:35:08,261] {base_task_runner.py:98} INFO - Subtask: DECK_PORT_80_TCP_PROTO=tcp
[2018-01-10 08:35:08,261] {base_task_runner.py:98} INFO - Subtask: DECK_SERVICE_HOST=10.63.247.198
[2018-01-10 08:35:08,262] {base_task_runner.py:98} INFO - Subtask: DECK_SERVICE_PORT=80
[2018-01-10 08:35:08,262] {base_task_runner.py:98} INFO - Subtask: GOOGLE_APPLICATION_CREDENTIALS=/var/secrets/google/key.json
[2018-01-10 08:35:08,263] {base_task_runner.py:98} INFO - Subtask: GOPATH=/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/go
[2018-01-10 08:35:08,263] {base_task_runner.py:98} INFO - Subtask: GPG_KEY=C01E1CAD5EA2C4F0B8E3571504C367C218ADD4FF
[2018-01-10 08:35:08,263] {base_task_runner.py:98} INFO - Subtask: HOME=/usr/local/airflow
[2018-01-10 08:35:08,264] {base_task_runner.py:98} INFO - Subtask: HOOK_PORT=tcp://10.63.245.64:8888
[2018-01-10 08:35:08,264] {base_task_runner.py:98} INFO - Subtask: HOOK_PORT_8888_TCP=tcp://10.63.245.64:8888
[2018-01-10 08:35:08,264] {base_task_runner.py:98} INFO - Subtask: HOOK_PORT_8888_TCP_ADDR=10.63.245.64
[2018-01-10 08:35:08,265] {base_task_runner.py:98} INFO - Subtask: HOOK_PORT_8888_TCP_PORT=8888
[2018-01-10 08:35:08,265] {base_task_runner.py:98} INFO - Subtask: HOOK_PORT_8888_TCP_PROTO=tcp
[2018-01-10 08:35:08,265] {base_task_runner.py:98} INFO - Subtask: HOOK_SERVICE_HOST=10.63.245.64
[2018-01-10 08:35:08,266] {base_task_runner.py:98} INFO - Subtask: HOOK_SERVICE_PORT=8888
[2018-01-10 08:35:08,266] {base_task_runner.py:98} INFO - Subtask: HOSTNAME=airflow-2497854871-0dr9k
[2018-01-10 08:35:08,267] {base_task_runner.py:98} INFO - Subtask: KUBERNETES_PORT=tcp://10.63.240.1:443
[2018-01-10 08:35:08,267] {base_task_runner.py:98} INFO - Subtask: KUBERNETES_PORT_443_TCP=tcp://10.63.240.1:443
[2018-01-10 08:35:08,267] {base_task_runner.py:98} INFO - Subtask: KUBERNETES_PORT_443_TCP_ADDR=10.63.240.1
[2018-01-10 08:35:08,268] {base_task_runner.py:98} INFO - Subtask: KUBERNETES_PORT_443_TCP_PORT=443
[2018-01-10 08:35:08,268] {base_task_runner.py:98} INFO - Subtask: KUBERNETES_PORT_443_TCP_PROTO=tcp
[2018-01-10 08:35:08,268] {base_task_runner.py:98} INFO - Subtask: KUBERNETES_SERVICE_HOST=10.63.240.1
[2018-01-10 08:35:08,269] {base_task_runner.py:98} INFO - Subtask: KUBERNETES_SERVICE_PORT=443
[2018-01-10 08:35:08,269] {base_task_runner.py:98} INFO - Subtask: KUBERNETES_SERVICE_PORT_HTTPS=443
[2018-01-10 08:35:08,270] {base_task_runner.py:98} INFO - Subtask: LANG=en_US.UTF-8
[2018-01-10 08:35:08,270] {base_task_runner.py:98} INFO - Subtask: LANGUAGE=en_US.UTF-8
[2018-01-10 08:35:08,270] {base_task_runner.py:98} INFO - Subtask: LC_ALL=en_US.UTF-8
[2018-01-10 08:35:08,271] {base_task_runner.py:98} INFO - Subtask: LC_CTYPE=en_US.UTF-8
[2018-01-10 08:35:08,271] {base_task_runner.py:98} INFO - Subtask: LC_MESSAGES=en_US.UTF-8
[2018-01-10 08:35:08,271] {base_task_runner.py:98} INFO - Subtask: PATH=/google-cloud-sdk/bin:/workspace:/usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/local/go/bin
[2018-01-10 08:35:08,272] {base_task_runner.py:98} INFO - Subtask: POSTGRES_HOST=localhost
[2018-01-10 08:35:08,272] {base_task_runner.py:98} INFO - Subtask: PWD=/usr/local/airflow
[2018-01-10 08:35:08,272] {base_task_runner.py:98} INFO - Subtask: PYTHONPATH=:/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s
[2018-01-10 08:35:08,273] {base_task_runner.py:98} INFO - Subtask: PYTHON_PIP_VERSION=9.0.1
[2018-01-10 08:35:08,273] {base_task_runner.py:98} INFO - Subtask: PYTHON_VERSION=2.7.14
[2018-01-10 08:35:08,273] {base_task_runner.py:98} INFO - Subtask: SHLVL=2
[2018-01-10 08:35:08,274] {base_task_runner.py:98} INFO - Subtask: SRC_DIR=/var/lib/data/runs
[2018-01-10 08:35:08,274] {base_task_runner.py:98} INFO - Subtask: TERM=linux
[2018-01-10 08:35:08,274] {base_task_runner.py:98} INFO - Subtask: _=/usr/local/bin/airflow
[2018-01-10 08:37:11,771] {base_task_runner.py:98} INFO - Subtask: [2018-01-10 08:37:11,771] {util.py:74} INFO - Subprocess output:
[2018-01-10 08:37:11,772] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:35:10|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py|320| Use --src_dir=/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s
[2018-01-10 08:37:11,773] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:35:10|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py|329| /var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/go/src/github.com/tensorflow/k8s does not exist.
[2018-01-10 08:37:11,773] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:35:10|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py|336| Creating symbolic link /var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/go/src/github.com/tensorflow/k8s pointing to /var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s
[2018-01-10 08:37:11,773] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:35:10|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py|359| vendor directory exists; not installing go dependencies.
[2018-01-10 08:37:11,774] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:35:10|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py|126| context_dir: /tmp/tmpTfJobCrdContextv5QCyl
[2018-01-10 08:37:11,774] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:35:10|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|35| Running: go install -ldflags -X github.com/tensorflow/k8s/version.GitSHA=0bf0681 github.com/tensorflow/k8s/cmd/tf_operator
[2018-01-10 08:37:11,775] {base_task_runner.py:98} INFO - Subtask: cwd=None
[2018-01-10 08:37:11,775] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:00|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|64| Subprocess output:
[2018-01-10 08:37:11,775] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,776] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:00|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|35| Running: go install github.com/tensorflow/k8s/cmd/tf_operator
[2018-01-10 08:37:11,776] {base_task_runner.py:98} INFO - Subtask: cwd=None
[2018-01-10 08:37:11,777] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:01|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|64| Subprocess output:
[2018-01-10 08:37:11,777] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,777] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:01|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|35| Running: go install github.com/tensorflow/k8s/test/e2e
[2018-01-10 08:37:11,778] {base_task_runner.py:98} INFO - Subtask: cwd=None
[2018-01-10 08:37:11,778] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:05|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|64| Subprocess output:
[2018-01-10 08:37:11,778] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,779] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:05|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|35| Running: go install github.com/tensorflow/k8s/dashboard/backend
[2018-01-10 08:37:11,779] {base_task_runner.py:98} INFO - Subtask: cwd=None
[2018-01-10 08:37:11,780] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:11|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|64| Subprocess output:
[2018-01-10 08:37:11,780] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,781] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:11|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|35| Running: yarn --cwd /var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/dashboard/frontend install
[2018-01-10 08:37:11,781] {base_task_runner.py:98} INFO - Subtask: cwd=None
[2018-01-10 08:37:11,781] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:35|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|64| Subprocess output:
[2018-01-10 08:37:11,782] {base_task_runner.py:98} INFO - Subtask: yarn install v1.3.2
[2018-01-10 08:37:11,782] {base_task_runner.py:98} INFO - Subtask: [1/4] Resolving packages...
[2018-01-10 08:37:11,783] {base_task_runner.py:98} INFO - Subtask: [2/4] Fetching packages...
[2018-01-10 08:37:11,783] {base_task_runner.py:98} INFO - Subtask: info [email protected]: The platform "linux" is incompatible with this module.
[2018-01-10 08:37:11,783] {base_task_runner.py:98} INFO - Subtask: info "[email protected]" is an optional dependency and failed compatibility check. Excluding it from installation.
[2018-01-10 08:37:11,784] {base_task_runner.py:98} INFO - Subtask: info [email protected]: The platform "linux" is incompatible with this module.
[2018-01-10 08:37:11,784] {base_task_runner.py:98} INFO - Subtask: info "[email protected]" is an optional dependency and failed compatibility check. Excluding it from installation.
[2018-01-10 08:37:11,785] {base_task_runner.py:98} INFO - Subtask: [3/4] Linking dependencies...
[2018-01-10 08:37:11,785] {base_task_runner.py:98} INFO - Subtask: [4/4] Building fresh packages...
[2018-01-10 08:37:11,785] {base_task_runner.py:98} INFO - Subtask: Done in 23.66s.
[2018-01-10 08:37:11,786] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,786] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:36:35|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|35| Running: yarn --cwd /var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/dashboard/frontend build
[2018-01-10 08:37:11,787] {base_task_runner.py:98} INFO - Subtask: cwd=None
[2018-01-10 08:37:11,787] {base_task_runner.py:98} INFO - Subtask: INFO|2018-01-10T08:37:11|/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/util.py|64| Subprocess output:
[2018-01-10 08:37:11,787] {base_task_runner.py:98} INFO - Subtask: yarn run v1.3.2
[2018-01-10 08:37:11,788] {base_task_runner.py:98} INFO - Subtask: $ react-scripts build
[2018-01-10 08:37:11,788] {base_task_runner.py:98} INFO - Subtask: Creating an optimized production build...
[2018-01-10 08:37:11,788] {base_task_runner.py:98} INFO - Subtask: Compiled successfully.
[2018-01-10 08:37:11,789] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,789] {base_task_runner.py:98} INFO - Subtask: File sizes after gzip:
[2018-01-10 08:37:11,790] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,790] {base_task_runner.py:98} INFO - Subtask: 127.05 KB build/static/js/main.7154f589.js
[2018-01-10 08:37:11,790] {base_task_runner.py:98} INFO - Subtask: 137 B build/static/css/main.e1b6790e.css
[2018-01-10 08:37:11,791] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,791] {base_task_runner.py:98} INFO - Subtask: The project was built assuming it is hosted at the server root.
[2018-01-10 08:37:11,792] {base_task_runner.py:98} INFO - Subtask: To override this, specify the homepage in your package.json.
[2018-01-10 08:37:11,792] {base_task_runner.py:98} INFO - Subtask: For example, add this to build it for GitHub Pages:
[2018-01-10 08:37:11,792] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,793] {base_task_runner.py:98} INFO - Subtask: "homepage" : "http://myname.github.io/myapp",
[2018-01-10 08:37:11,793] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,794] {base_task_runner.py:98} INFO - Subtask: The build folder is ready to be deployed.
[2018-01-10 08:37:11,794] {base_task_runner.py:98} INFO - Subtask: You may serve it with a static server:
[2018-01-10 08:37:11,794] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,795] {base_task_runner.py:98} INFO - Subtask: yarn global add serve
[2018-01-10 08:37:11,795] {base_task_runner.py:98} INFO - Subtask: serve -s build
[2018-01-10 08:37:11,795] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,796] {base_task_runner.py:98} INFO - Subtask: Done in 35.34s.
[2018-01-10 08:37:11,796] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,796] {base_task_runner.py:98} INFO - Subtask: Traceback (most recent call last):
[2018-01-10 08:37:11,797] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/runpy.py", line 174, in _run_module_as_main
[2018-01-10 08:37:11,797] {base_task_runner.py:98} INFO - Subtask: "__main__", fname, loader, pkg_name)
[2018-01-10 08:37:11,797] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/runpy.py", line 72, in _run_code
[2018-01-10 08:37:11,798] {base_task_runner.py:98} INFO - Subtask: exec code in run_globals
[2018-01-10 08:37:11,798] {base_task_runner.py:98} INFO - Subtask: File "/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py", line 682, in <module>
[2018-01-10 08:37:11,798] {base_task_runner.py:98} INFO - Subtask: main()
[2018-01-10 08:37:11,799] {base_task_runner.py:98} INFO - Subtask: File "/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py", line 679, in main
[2018-01-10 08:37:11,799] {base_task_runner.py:98} INFO - Subtask: args.func(args)
[2018-01-10 08:37:11,800] {base_task_runner.py:98} INFO - Subtask: File "/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py", line 363, in build
[2018-01-10 08:37:11,800] {base_task_runner.py:98} INFO - Subtask: build_and_push(go_dir, args.src_dir, args)
[2018-01-10 08:37:11,801] {base_task_runner.py:98} INFO - Subtask: File "/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py", line 382, in build_and_push
[2018-01-10 08:37:11,801] {base_task_runner.py:98} INFO - Subtask: build_info_path=args.build_info_path)
[2018-01-10 08:37:11,801] {base_task_runner.py:98} INFO - Subtask: File "/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py", line 228, in build_and_push_artifacts
[2018-01-10 08:37:11,802] {base_task_runner.py:98} INFO - Subtask: build_info = build_operator_image(src_dir, registry, project=gcb_project)
[2018-01-10 08:37:11,802] {base_task_runner.py:98} INFO - Subtask: File "/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/py/release.py", line 168, in build_operator_image
[2018-01-10 08:37:11,803] {base_task_runner.py:98} INFO - Subtask: shutil.copyfile(src_path, dest_path)
[2018-01-10 08:37:11,803] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/shutil.py", line 96, in copyfile
[2018-01-10 08:37:11,803] {base_task_runner.py:98} INFO - Subtask: with open(src, 'rb') as fsrc:
[2018-01-10 08:37:11,804] {base_task_runner.py:98} INFO - Subtask: IOError: [Errno 2] No such file or directory: '/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s/build/images/tf_operator/Dockerfile'
[2018-01-10 08:37:11,804] {base_task_runner.py:98} INFO - Subtask:
[2018-01-10 08:37:11,808] {base_task_runner.py:98} INFO - Subtask: Traceback (most recent call last):
[2018-01-10 08:37:11,809] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/bin/airflow", line 4, in <module>
[2018-01-10 08:37:11,809] {base_task_runner.py:98} INFO - Subtask: __import__('pkg_resources').run_script('apache-airflow==1.9.0rc2', 'airflow')
[2018-01-10 08:37:11,810] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 750, in run_script
[2018-01-10 08:37:11,810] {base_task_runner.py:98} INFO - Subtask: self.require(requires)[0].run_script(script_name, ns)
[2018-01-10 08:37:11,811] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/site-packages/pkg_resources/__init__.py", line 1527, in run_script
[2018-01-10 08:37:11,812] {base_task_runner.py:98} INFO - Subtask: exec(code, namespace, namespace)
[2018-01-10 08:37:11,812] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/site-packages/apache_airflow-1.9.0rc2-py2.7.egg/EGG-INFO/scripts/airflow", line 27, in <module>
[2018-01-10 08:37:11,813] {base_task_runner.py:98} INFO - Subtask: args.func(args)
[2018-01-10 08:37:11,813] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/site-packages/apache_airflow-1.9.0rc2-py2.7.egg/airflow/bin/cli.py", line 397, in run
[2018-01-10 08:37:11,814] {base_task_runner.py:98} INFO - Subtask: pool=args.pool,
[2018-01-10 08:37:11,814] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/site-packages/apache_airflow-1.9.0rc2-py2.7.egg/airflow/utils/db.py", line 50, in wrapper
[2018-01-10 08:37:11,814] {base_task_runner.py:98} INFO - Subtask: result = func(*args, **kwargs)
[2018-01-10 08:37:11,815] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/site-packages/apache_airflow-1.9.0rc2-py2.7.egg/airflow/models.py", line 1469, in _run_raw_task
[2018-01-10 08:37:11,815] {base_task_runner.py:98} INFO - Subtask: result = task_copy.execute(context=context)
[2018-01-10 08:37:11,815] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/site-packages/apache_airflow-1.9.0rc2-py2.7.egg/airflow/operators/python_operator.py", line 89, in execute
[2018-01-10 08:37:11,816] {base_task_runner.py:98} INFO - Subtask: return_value = self.execute_callable()
[2018-01-10 08:37:11,816] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/site-packages/apache_airflow-1.9.0rc2-py2.7.egg/airflow/operators/python_operator.py", line 94, in execute_callable
[2018-01-10 08:37:11,817] {base_task_runner.py:98} INFO - Subtask: return self.python_callable(*self.op_args, **self.op_kwargs)
[2018-01-10 08:37:11,817] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/airflow/dags/e2e_tests_dag.py", line 211, in build_images
[2018-01-10 08:37:11,817] {base_task_runner.py:98} INFO - Subtask: run(ti, args, use_print=True, dryrun=dryrun, env=newenv)
[2018-01-10 08:37:11,818] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/airflow/dags/e2e_tests_dag.py", line 105, in run
[2018-01-10 08:37:11,818] {base_task_runner.py:98} INFO - Subtask: util.run(*extra_args, **kwargs)
[2018-01-10 08:37:11,818] {base_task_runner.py:98} INFO - Subtask: File "/opt/tensorflow_k8s/py/util.py", line 58, in run
[2018-01-10 08:37:11,819] {base_task_runner.py:98} INFO - Subtask: stderr=subprocess.STDOUT).decode("utf-8")
[2018-01-10 08:37:11,819] {base_task_runner.py:98} INFO - Subtask: File "/usr/local/lib/python2.7/subprocess.py", line 219, in check_output
[2018-01-10 08:37:11,819] {base_task_runner.py:98} INFO - Subtask: raise CalledProcessError(retcode, cmd, output=output)
[2018-01-10 08:37:11,820] {base_task_runner.py:98} INFO - Subtask: subprocess.CalledProcessError: Command '['python', '-m', 'py.release', 'build', u'--src_dir=/var/lib/data/runs/tf_k8s_tests/2018-01-10T08_34_47/tensorflow_k8s', u'--build_info_path=gs://mlkube-testing-airflow/runs/tf_k8s_tests/2018-01-10T08_34_47/build_info.yaml', u'--releases_path=gs://mlkube-testing-airflow/runs/tf_k8s_tests/2018-01-10T08_34_47', '--project=mlkube-testing']' returned non-zero exit status 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment