I followed the installation guide to set up 2 agent hosts (each has 10 agents running) and install Cluster Manager and eMake on my laptop. Tried the sample moxie project to make sure distributed build can work.
Then I referenced to this document to try to accelerate AOSP (Android 10) build
https://docs.cloudbees.com/docs/cloudbees-build-acceleration/11.3/emake-user-guide/android-performance
but failed not too long after issuing emake command, don't know the exact failure reason.
issued command: emake --emake-cm=localhost --emake-android-version=10.0.0
failure message: please see the captured running log at the end of this article.
thanks for any help.
Starting build: 34
EADROID_ANDROIDP=$(cat /proc/$PPID/cmdline | tr '\000' '\n' | head -n 1 | sed 's#/64/bin/.*##')/conf/types/android/10.0.0; $EADROID_ANDROIDP/soong_ui.bash.partial
EC_SOONG_UI:PARTIAL - preparing soong_ui (should execute on an agent)
EADROID_ANDROIDP=$(cat /proc/$PPID/cmdline | tr '\000' '\n' | head -n 1 | sed 's#/64/bin/.*##')/conf/types/android/10.0.0; $EADROID_ANDROIDP/soong_ui.bash --generate-only --make-mode
EC_SOONG_UI.BASH: running soong ui binary (should be runlocal)
10:20:42 EC_SOONG_UI: generate only
============================================
PLATFORM_VERSION_CODENAME=REL
PLATFORM_VERSION=10
TARGET_PRODUCT=aosp_arm
TARGET_BUILD_VARIANT=eng
TARGET_BUILD_TYPE=release
TARGET_ARCH=arm
TARGET_ARCH_VARIANT=armv7-a-neon
TARGET_CPU_VARIANT=generic
HOST_ARCH=x86_64
HOST_2ND_ARCH=x86
HOST_OS=linux
HOST_OS_EXTRA=Linux-5.4.0-56-generic-x86_64-Ubuntu-20.04.1-LTS
HOST_CROSS_OS=windows
HOST_CROSS_ARCH=x86
HOST_CROSS_2ND_ARCH=x86_64
HOST_BUILD_TYPE=release
BUILD_ID=QP1A.190711.019
OUT_DIR=out
============================================
[100% 1/1] out/soong/.minibootstrap/minibp out/soong/.bootstrap/build.ninja
[ 1% 2/135] compile out/soong/.bootstrap/blueprint-deptools/pkg/github.com/google/blueprint/deptools.a
> [ 2% 3/135] compile out/soong/.bootstrap/gotestmain/obj/gotestmain.a
[ 2% 4/135] compile out/soong/.bootstrap/blueprint-proptools/pkg/
github.com/google/blueprint/proptools.a
> [ 3% 5/135] compile out/soong/.bootstrap/blueprint-parser/pkg/
github.com/google/blueprint/parser.a
> [ 4% 6/135] compile out/soong/.bootstrap/blueprint-pathtools/pkg/
github.com/google/blueprint/pathtools.a
> [ 5% 7/135] compile out/soong/.bootstrap/gotestrunner/obj/gotestrunner.a
[ 5% 8/135] compile out/soong/.bootstrap/blueprint-pathtools/test/
github.com/google/blueprint/pathtools.a
> [ 6% 9/135] compile out/soong/.bootstrap/blueprint-parser/test/
github.com/google/blueprint/parser.a
> [ 7% 10/135] compile out/soong/.bootstrap/loadplugins/obj/loadplugins.a
[ 8% 11/135] compile out/soong/.bootstrap/blueprint-proptools/test/
github.com/google/blueprint/proptools.a
> [ 8% 12/135] compile out/soong/.bootstrap/soong-env/pkg/android/soong/env.a
[ 9% 13/135] compile out/soong/.bootstrap/soong-shared/pkg/android/soong/shared.a
[ 10% 14/135] compile out/soong/.bootstrap/soong_env/obj/soong_env.a
[ 11% 15/135] link out/soong/.bootstrap/gotestrunner/obj/a.out
[ 11% 16/135] link out/soong/.bootstrap/gotestmain/obj/a.out
[ 12% 17/135] cp out/soong/.bootstrap/bin/gotestrunner
[ 13% 18/135] cp out/soong/.bootstrap/bin/gotestmain
[ 14% 19/135] gotestmain out/soong/.bootstrap/blueprint/test/test.go
[ 14% 20/135] gotestmain out/soong/.bootstrap/blueprint-bootstrap-bpdoc/test/test.go
[ 15% 21/135] gotestmain out/soong/.bootstrap/blueprint-parser/test/test.go
[ 16% 22/135] gotestmain out/soong/.bootstrap/blueprint-pathtools/test/test.go
[ 17% 23/135] link out/soong/.bootstrap/loadplugins/obj/a.out
[ 17% 24/135] gotestmain out/soong/.bootstrap/blueprint-proptools/test/test.go
[ 18% 25/135] compile out/soong/.bootstrap/blueprint-parser/test/test.a
[ 19% 26/135] compile out/soong/.bootstrap/blueprint-pathtools/test/test.a
[ 20% 27/135] compile out/soong/.bootstrap/blueprint-proptools/test/test.a
[ 20% 28/135] link out/soong/.bootstrap/soong_env/obj/a.out
[ 21% 29/135] cp out/soong/.bootstrap/bin/loadplugins
[ 22% 30/135] compile out/soong/.bootstrap/blueprint/pkg/
github.com/google/blueprint.a
> [ 22% 31/135] gotestmain out/soong/.bootstrap/soong-android/test/test.go
[ 23% 32/135] compile out/soong/.bootstrap/blueprint/test/
github.com/google/blueprint.a
> [ 24% 33/135] compile out/soong/.bootstrap/blueprint/test/test.a
[ 25% 34/135] compile out/soong/.bootstrap/blueprint-bootstrap-bpdoc/pkg/
github.com/google/blueprint/bootstrap/bpdoc.a
> [ 25% 35/135] compile out/soong/.bootstrap/blueprint-bootstrap-bpdoc/test/
github.com/google/blueprint/bootstrap/bpdoc.a
> [ 26% 36/135] link out/soong/.bootstrap/blueprint-parser/test/test
[ 27% 37/135] compile out/soong/.bootstrap/blueprint-bootstrap-bpdoc/test/test.a
[ 28% 38/135] link out/soong/.bootstrap/blueprint-pathtools/test/test
[ 28% 39/135] test
github.com/google/blueprint/parser
> [ 29% 40/135] compile out/soong/.bootstrap/soong/pkg/android/soong.a
[ 30% 41/135] link out/soong/.bootstrap/blueprint-proptools/test/test
[ 31% 42/135] test
github.com/google/blueprint/pathtools
> [ 31% 43/135] test
github.com/google/blueprint/proptools
> [ 32% 44/135] gotestmain out/soong/.bootstrap/soong-apex/test/test.go
[ 33% 45/135] gotestmain out/soong/.bootstrap/soong-cc/test/test.go
[ 34% 46/135] gotestmain out/soong/.bootstrap/soong-cc-config/test/test.go
[ 34% 47/135] gotestmain out/soong/.bootstrap/soong-genrule/test/test.go
[ 35% 48/135] gotestmain out/soong/.bootstrap/soong-dexpreopt/test/test.go
[ 36% 49/135] gotestmain out/soong/.bootstrap/soong-java/test/test.go
[ 37% 50/135] gotestmain out/soong/.bootstrap/soong-sysprop/test/test.go
[ 37% 51/135] gotestmain out/soong/.bootstrap/soong-python/test/test.go
[ 38% 52/135] create out/soong/.bootstrap/soong_build/gen/plugin.go
[ 39% 53/135] cp out/soong/.bootstrap/bin/soong_env
[ 40% 54/135] gotestmain out/soong/.bootstrap/soong-xml/test/test.go
[ 40% 55/135] compile out/soong/.bootstrap/blueprint-bootstrap/pkg/
github.com/google/blueprint/bootstrap.a
> [ 41% 56/135] link out/soong/.bootstrap/blueprint/test/test
[ 42% 57/135] test
github.com/google/blueprint
> [ 42% 58/135] link out/soong/.bootstrap/blueprint-bootstrap-bpdoc/test/test
[ 43% 59/135] test
github.com/google/blueprint/bootstrap/bpdoc
> [ 44% 60/135] compile out/soong/.bootstrap/soong-android/pkg/android/soong/android.a
[ 45% 61/135] compile out/soong/.bootstrap/kernel-config-soong-rules/pkg/android/soong/kernel/configs.a
[ 45% 62/135] compile out/soong/.bootstrap/soong-android/test/android/soong/android.a
[ 46% 63/135] compile out/soong/.bootstrap/soong-dexpreopt/pkg/android/soong/dexpreopt.a
[ 47% 64/135] compile out/soong/.bootstrap/soong-android/test/test.a
[ 48% 65/135] compile out/soong/.bootstrap/soong-genrule/test/android/soong/genrule.a
[ 48% 66/135] compile out/soong/.bootstrap/soong-cc-config/test/android/soong/cc/config.a
[ 49% 67/135] compile out/soong/.bootstrap/soong-dexpreopt/test/android/soong/dexpreopt.a
[ 50% 68/135] compile out/soong/.bootstrap/soong-cc-config/pkg/android/soong/cc/config.a
[ 51% 69/135] compile out/soong/.bootstrap/soong-cc-config/test/test.a
[ 51% 70/135] compile out/soong/.bootstrap/soong-genrule/test/test.a
[ 52% 71/135] compile out/soong/.bootstrap/soong-dexpreopt/test/test.a
[ 53% 72/135] compile out/soong/.bootstrap/soong-genrule/pkg/android/soong/genrule.a
[ 54% 73/135] compile out/soong/.bootstrap/soong-bpf/pkg/android/soong/bpf.a
[ 54% 74/135] compile out/soong/.bootstrap/soong-fs_config/pkg/android/soong/fs_config.a
[ 55% 75/135] compile out/soong/.bootstrap/soong-java-config/pkg/android/soong/java/config.a
[ 56% 76/135] compile out/soong/.bootstrap/soong-java-config-error_prone/pkg/android/soong/java/config/error_prone.a
[ 57% 77/135] compile out/soong/.bootstrap/soong-libchrome/pkg/android/soong/external/libchrome.a
[ 57% 78/135] compile out/soong/.bootstrap/soong-phony/pkg/android/soong/phony.a
[ 58% 79/135] compile out/soong/.bootstrap/soong-selinux/pkg/android/soong/selinux.a
[ 59% 80/135] compile out/soong/.bootstrap/soong-ca-certificates/pkg/android/soong/system/ca-certificates.a
[ 60% 81/135] compile out/soong/.bootstrap/soong-tradefed/pkg/android/soong/tradefed.a
[ 60% 82/135] compile out/soong/.bootstrap/soong-wayland-protocol-codegen/pkg/android/soong/external/wayland-protocol.a
[ 61% 83/135] link out/soong/.bootstrap/soong-genrule/test/test
[ 62% 84/135] link out/soong/.bootstrap/soong-cc-config/test/test
[ 62% 85/135] link out/soong/.bootstrap/soong-android/test/test
[ 63% 86/135] link out/soong/.bootstrap/soong-dexpreopt/test/test
[ 64% 87/135] test android/soong/android
[ 65% 88/135] test android/soong/cc/config
[ 65% 89/135] compile out/soong/.bootstrap/soong-xml/test/android/soong/xml.a
[ 66% 90/135] test android/soong/dexpreopt
[ 67% 91/135] compile out/soong/.bootstrap/soong-python/pkg/android/soong/python.a
[ 68% 92/135] test android/soong/genrule
[ 68% 93/135] compile out/soong/.bootstrap/soong-python/test/android/soong/python.a
[ 69% 94/135] compile out/soong/.bootstrap/soong-xml/test/test.a
[ 70% 95/135] compile out/soong/.bootstrap/soong-python/test/test.a
[ 71% 96/135] compile out/soong/.bootstrap/soong-xml/pkg/android/soong/xml.a
[ 71% 97/135] compile out/soong/.bootstrap/vintf-compatibility-matrix-soong-rules/pkg/android/soong/vintf-compatibility-matrix.a
[ 72% 98/135] link out/soong/.bootstrap/soong-python/test/test
[ 73% 99/135] test android/soong/python
[ 74% 100/135] link out/soong/.bootstrap/soong-xml/test/test
[ 74% 101/135] test android/soong/xml
[ 75% 102/135] compile out/soong/.bootstrap/soong-cc/test/android/soong/cc.a
[ 76% 103/135] compile out/soong/.bootstrap/soong-cc/test/test.a
[ 77% 104/135] compile out/soong/.bootstrap/soong-cc/pkg/android/soong/cc.a
[ 77% 105/135] compile out/soong/.bootstrap/soong-fluoride/pkg/android/soong/fluoride.a
[ 78% 106/135] compile out/soong/.bootstrap/soong-clang-prebuilts/pkg/android/soong/prebuilts/clang/host/linux-x86/clangprebuilts.a
[ 79% 107/135] compile out/soong/.bootstrap/soong-clang/pkg/android/soong/external/clang.a
[ 80% 108/135] compile out/soong/.bootstrap/soong-sanitizer_status/pkg/android/soong/security/santizers_status.a
[ 80% 109/135] compile out/soong/.bootstrap/soong-llvm/pkg/android/soong/external/llvm.a
[ 81% 110/135] link out/soong/.bootstrap/soong-cc/test/test
[ 82% 111/135] compile out/soong/.bootstrap/soong-java/pkg/android/soong/java.a
[ 82% 112/135] compile out/soong/.bootstrap/aidl-soong-rules/pkg/android/soong/aidl.a
[ 83% 113/135] compile out/soong/.bootstrap/hidl-soong-rules/pkg/android/soong/hidl.a
[ 84% 114/135] compile out/soong/.bootstrap/soong-java/test/android/soong/java.a
[ 85% 115/135] compile out/soong/.bootstrap/soong-java/test/test.a
[ 85% 116/135] compile out/soong/.bootstrap/soong-apex/pkg/android/soong/apex.a
[ 86% 117/135] compile out/soong/.bootstrap/soong-suite-harness/pkg/android/soong/suite_harness.a
[ 87% 118/135] compile out/soong/.bootstrap/soong-apex/test/android/soong/apex.a
[ 88% 119/135] compile out/soong/.bootstrap/soong-sysprop/test/android/soong/sysprop.a
[ 88% 120/135] compile out/soong/.bootstrap/soong-sysprop/test/test.a
[ 89% 121/135] compile out/soong/.bootstrap/soong-apex/test/test.a
[ 90% 122/135] compile out/soong/.bootstrap/soong-art/pkg/android/soong/art.a
[ 91% 123/135] compile out/soong/.bootstrap/soong-sysprop/pkg/android/soong/sysprop.a
[ 91% 124/135] compile out/soong/.bootstrap/xsdc-soong-rules/pkg/android/soong/xsdc.a
[ 92% 125/135] compile out/soong/.bootstrap/soong_build/obj/soong_build.a
[ 93% 126/135] link out/soong/.bootstrap/soong-apex/test/test
[ 94% 127/135] link out/soong/.bootstrap/soong-sysprop/test/test
[ 94% 128/135] link out/soong/.bootstrap/soong-java/test/test
[ 95% 129/135] link out/soong/.bootstrap/soong_build/obj/a.out
[ 96% 130/135] test android/soong/cc
[ 97% 131/135] test android/soong/java
[ 97% 132/135] test android/soong/sysprop
[ 98% 133/135] test android/soong/apex
[ 99% 134/135] cp out/soong/.bootstrap/bin/soong_build
[100% 135/135] out/soong/.bootstrap/bin/soong_build out/soong/build.ninja
10:22:02 runKatiCleanSpec: build/make/core/
cleanbuild.mk: out/soong/make_vars-aosp_arm.mk
10:22:02 runKatiBuild: [--writable out/ -f build/make/core/main.mk --werror_implicit_rules --werror_overriding_commands --werror_real_to_phony --werror_phony_looks_real --werror_writable SOONG_MAKEVARS_MK=out/soong/make_vars-aosp_arm.mk SOONG_ANDROID_MK=out/soong/Android-aosp_arm.mk TARGET_DEVICE_DIR=build/target/board/generic KATI_PACKAGE_MK_DIR=out/target/product/generic/obj/CONFIG/kati_packaging]
10:22:02 runKatiPackage: [--writable out/dist/ --werror_writable --werror_implicit_rules --werror_overriding_commands --werror_real_to_phony --werror_phony_looks_real -f build/make/packaging/main.mk KATI_PACKAGE_MK_DIR=out/target/product/generic/obj/CONFIG/kati_packaging]
10:22:02 EC_SOONG: No ninja file symlink to remove:
10:22:02 EC_SOONG: No env symlink to remove:
10:22:02 EC_SOONG: Not running ninja
bash out/kati-cleanspec.sh
out/kati-cleanspec.sh: line 19: 25426 Illegal instruction (core dumped) /opt/ecloud/i686_Linux/conf/types/android/10.0.0/eckati --ninja --ninja_dir=out --ninja_suffix=-aosp_arm-cleanspec --no_ninja_prelude --regen --regen_debug --ignore_optional_include=out/%.P --detect_android_echo --color_warnings --gen_all_targets --use_find_emulator --werror_find_emulator --no_builtin_rules --werror_suffix_rules --warn_real_to_phony --warn_phony_looks_real --top_level_phony --kati_stats --werror_writable --werror_implicit_rules --werror_overriding_commands --werror_real_to_phony --werror_phony_looks_real -f build/make/core/cleanbuild.mk SOONG_MAKEVARS_MK=out/soong/make_vars-aosp_arm.mk TARGET_DEVICE_DIR=build/target/board/generic
make: *** [ea_run_kati] Error 132
Finished build: 34 Duration: 1:26 (m:s) Cluster availability: 100%
Answer by eric melski · Dec 15, 2020 at 10:51 PM
Answer by jinkailau · Dec 18, 2020 at 05:16 AM
Does ElectricAccelerator work with Xeon Phi? 1 Answer
Is there a sample SLA for build acceleration as a service? 1 Answer
Why is my build serialized even when projects are broken apart? 1 Answer
What are common reasons for build failures? 1 Answer
The Cluster Manager reports that a build timed out. 1 Answer
Electric Cloud powers Continuous Delivery, helping organizations developing deliver better software faster by automating and accelerating build, test, and deployment processes at scale. Industry leaders like Qualcomm, SpaceX, Cisco, GE, Gap, and E*TRADE use Electric Cloud solutions to boost DevOps productivity and Agile throughput.