Hi Ruben!
Enabling RBE once you have a remote execution cluster running requires
approximately these steps:
source build/make/rbesetup.sh
ulimit -n 20000
export RBE_service=<hostname>:<port, typically 443>
export RBE_tls_ca_cert=certificate.crt <-- depends on what TLS cert is
in use on the service
export RBE_use_rpc_credentials=false <-- depends on how you do client
authentication
export RBE_JAVA_POOL=default
export RBE_METALAVA_POOL=default
export RBE_ABI_DUMPER=1
export RBE_ABI_LINKER=1
export RBE_CLANG_TIDY=1
export RBE_CXX_LINKS=1
export RBE_D8=1
export RBE_JAVAC=1
export RBE_METALAVA=1
export RBE_R8=1
export RBE_SIGNAPK=1
export RBE_TURBINE=1
export RBE_ZIP=1
export RBE_ABI_DUMPER_EXEC_STRATEGY=remote_local_fallback
export RBE_ABI_LINKER_EXEC_STRATEGY=remote_local_fallback
export RBE_CXX_EXEC_STRATEGY=remote_local_fallback
export RBE_CXX_LINKS_EXEC_STRATEGY=remote_local_fallback
export RBE_CLANG_TIDY_EXEC_STRATEGY=remote_local_fallback
export RBE_D8_EXEC_STRATEGY=remote
export RBE_JAR_EXEC_STRATEGY=remote_local_fallback
export RBE_JAVAC_EXEC_STRATEGY=remote
export RBE_SIGNAPK_EXEC_STRATEGY=remote_local_fallback
export RBE_TURBINE_EXEC_STRATEGY=remote_local_fallback
export RBE_R8_EXEC_STRATEGY=remote
export RBE_ZIP_EXEC_STRATEGY=remote_local_fallback
export RBE_METALAVA_EXEC_STRATEGY=remote_local_fallback
You can also adjust the number of remote actions like so:
export NINJA_REMOTE_NUM_JOBS=8
You may need to run a Docker registry, or you can pull images from GCR.
And then you can use the `m` tool as usual
mmma external/sqlite/
m
Hope that helps,
-- Ulf
*EngFlow GmbH*
Fischerweg 51, 82194 Gröbenzell, Germany
Amtsgericht München, HRB 255664
Geschäftsführer (Managing Director): Ulf Adams
https://www.engflow.com
On Tue, 18 May 2021 at 22:48, Ruben Wu <[email protected]> wrote:
> Thanks for the info, Dan! Is there a place I can reference on how to turn
> on RBE on Android 11/12? I understand a remote build execution
> engine/service is needed, but how do I configure Android 11 to send jobs to
> that service?
>
> Thanks,
> Ruben
>
> On Friday, May 14, 2021 at 5:40:44 PM UTC-5 Dan Willemsen wrote:
>
>> While I understand goma support is being deprecated/removed on AOSP
>>> master, is there a way to still be able to use Goma on Android 12 since I
>>> already have a goma client and server setup to work with Android 10.
>>>
>>
>> No, it was removed before Android 12 was branched, so it's not in Android
>> 12 either. You could always attempt to revert those removals in your own
>> tree, but I don't know how complex that could be. RBE works with
>> significantly more of the build actions than GOMA ever did.
>>
>> - Dan
>>
>> On Fri, May 14, 2021 at 3:37 PM Ruben Wu <[email protected]> wrote:
>>
>>> Hi Dan,
>>> While I understand goma support is being deprecated/removed on AOSP
>>> master, is there a way to still be able to use Goma on Android 12 since I
>>> already have a goma client and server setup to work with Android 10.
>>>
>>> Best,
>>> Ruben
>>>
>>> On Tuesday, February 16, 2021 at 4:14:19 PM UTC-6 Dan Willemsen wrote:
>>>
>>>> GOMA support has been removed on the AOSP master branch, and has been
>>>> replaced with RBE.
>>>>
>>>> - Dan
>>>>
>>>> On Wed, Feb 3, 2021 at 9:30 AM 唐木村 <[email protected]> wrote:
>>>>
>>>>> @Dan Willemsen
>>>>>
>>>>> >>> The build team does not recommend using Goma -- it does not work
>>>>> particularly well with the Android build, and we expect to be removing
>>>>> support for it in master in the coming months (support will most likely
>>>>> still be in this years release, but not next years).
>>>>>
>>>>> whether goma not work well for android build ??? and now 2021 year
>>>>> support better ???
>>>>> https://chromium.googlesource.com/infra/goma/client/
>>>>> https://chromium.googlesource.com/infra/goma/server/
>>>>>
>>>>> 在2020年3月4日星期三 UTC+8 上午5:57:32<Dan Willemsen> 写道：
>>>>>
>>>>>> The build team does not recommend using Goma -- it does not work
>>>>>> particularly well with the Android build, and we expect to be removing
>>>>>> support for it in master in the coming months (support will most likely
>>>>>> still be in this years release, but not next years).
>>>>>>
>>>>>> RBE is the replacement, but it's still evolving at the moment. Many
>>>>>> of our CI builds have switched to it (they never used Goma), but only a
>>>>>> handful of developers have used it so far. If you're interested in this,
>>>>>> I'd highly recommend asking your TAM about it (or if you don't have one,
>>>>>> contact me and I can try to route your request to the right team).
>>>>>>
>>>>>> For what we're doing (other than Goma/RBE), the majority of our CI
>>>>>> builds are done on n1-standard-64
>>>>>> <https://cloud.google.com/compute/docs/machine-types#n1_machine_type>
>>>>>> machines with SSD persistent disks. Depending on your
>>>>>> limitations/requirements, the newer C2/N2 machine families may be more
>>>>>> efficient. For local developers, we're generally buying fast desktops --
>>>>>> 2x
>>>>>> Intel Xeon GOLD 6154 processor (18-core Skylake, up to 3.70 GHz) with 192
>>>>>> GB RAM and a few TB of SSDs.
>>>>>>
>>>>>> - Dan
>>>>>>
>>>>>> On Sun, Mar 1, 2020 at 11:52 PM 'Orion Hodson' via Android Building <
>>>>>> [email protected]> wrote:
>>>>>>
>>>>>>> Hi Alexander
>>>>>>>
>>>>>>> Internally Android developers use goma. The thread below has
>>>>>>> pointers to the client and server. It is built on GCP.
>>>>>>>
>>>>>>>
>>>>>>> https://groups.google.com/a/chromium.org/forum/#!topic/chromium-dev/eOtBzosZtd8
>>>>>>>
>>>>>>> Kind regards
>>>>>>> Orion
>>>>>>>
>>>>>>> On Sun, 1 Mar 2020 at 22:39, alexander zhu <[email protected]>
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Hi,
>>>>>>>>
>>>>>>>> I faced one problem, i have tried to solve it many days.
>>>>>>>>
>>>>>>>>
>>>>>>>> AOSP compile on one powerful physical server(36U128G) is fast .
>>>>>>>> Because my company has so many people need to compile AOSP on the
>>>>>>>> server,so
>>>>>>>> it is busy all the time , and I do not have money to buy more.But the
>>>>>>>> VM I
>>>>>>>> can request more.So I want to use VM on the cloud to compile AOSP.
>>>>>>>>
>>>>>>>> I have some distribute compile experiences in other c/c++ projects.
>>>>>>>> So I'm thinking is there any way to compile AOSP in distribute
>>>>>>>> way?exp: use
>>>>>>>> many VMs for one AOSP build.
>>>>>>>>
>>>>>>>> I noticed there had topic long time ago :
>>>>>>>> https://groups.google.com/forum/#!searchin/android-building/distcc%7Csort:date/android-building/_YJNwvq6FtY/EENyTx4Elk4J
>>>>>>>>
>>>>>>>> I tried distcc , but failed . AOSP switching to clang, but distcc
>>>>>>>> support clang not ok.
>>>>>>>> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=926884
>>>>>>>>
>>>>>>>>
>>>>>>>> So, I want to know ,AOSP in google , how to solve the long build
>>>>>>>> time ?use more powerful physical server? or you have your own
>>>>>>>> distribute compile solution?
>>>>>>>>
>>>>>>>> --
>>>>>>>> --
>>>>>>>> You received this message because you are subscribed to the
>>>>>>>> "Android Building" mailing list.
>>>>>>>> To post to this group, send email to [email protected]
>>>>>>>> To unsubscribe from this group, send email to
>>>>>>>> [email protected]
>>>>>>>> For more options, visit this group at
>>>>>>>> http://groups.google.com/group/android-building?hl=en
>>>>>>>>
>>>>>>>> ---
>>>>>>>> You received this message because you are subscribed to the Google
>>>>>>>> Groups "Android Building" group.
>>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>>> send an email to [email protected].
>>>>>>>> To view this discussion on the web visit
>>>>>>>> https://groups.google.com/d/msgid/android-building/e3dd71e8-e452-48e2-8686-c51e359cbf5c%40googlegroups.com
>>>>>>>> <https://groups.google.com/d/msgid/android-building/e3dd71e8-e452-48e2-8686-c51e359cbf5c%40googlegroups.com?utm_medium=email&utm_source=footer>
>>>>>>>> .
>>>>>>>>
>>>>>>> --
>>>>>>> --
>>>>>>> You received this message because you are subscribed to the "Android
>>>>>>> Building" mailing list.
>>>>>>> To post to this group, send email to [email protected]
>>>>>>> To unsubscribe from this group, send email to
>>>>>>> [email protected]
>>>>>>> For more options, visit this group at
>>>>>>> http://groups.google.com/group/android-building?hl=en
>>>>>>>
>>>>>>> ---
>>>>>>> You received this message because you are subscribed to the Google
>>>>>>> Groups "Android Building" group.
>>>>>>> To unsubscribe from this group and stop receiving emails from it,
>>>>>>> send an email to [email protected].
>>>>>>>
>>>>>> To view this discussion on the web visit
>>>>>>> https://groups.google.com/d/msgid/android-building/CAAttue0u%2BuqgwNO4ggmnWsYS%2B8FmL8xURN-Xqt9sw9d1aLENQQ%40mail.gmail.com
>>>>>>> <https://groups.google.com/d/msgid/android-building/CAAttue0u%2BuqgwNO4ggmnWsYS%2B8FmL8xURN-Xqt9sw9d1aLENQQ%40mail.gmail.com?utm_medium=email&utm_source=footer>
>>>>>>> .
>>>>>>>
>>>>>> --
>>>>> --
>>>>> You received this message because you are subscribed to the "Android
>>>>> Building" mailing list.
>>>>> To post to this group, send email to [email protected]
>>>>> To unsubscribe from this group, send email to
>>>>> [email protected]
>>>>> For more options, visit this group at
>>>>> http://groups.google.com/group/android-building?hl=en
>>>>>
>>>>> ---
>>>>> You received this message because you are subscribed to the Google
>>>>> Groups "Android Building" group.
>>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>>> an email to [email protected].
>>>>>
>>>> To view this discussion on the web visit
>>>>> https://groups.google.com/d/msgid/android-building/6062ea95-ea49-483d-8e32-675bbf2a954en%40googlegroups.com
>>>>> <https://groups.google.com/d/msgid/android-building/6062ea95-ea49-483d-8e32-675bbf2a954en%40googlegroups.com?utm_medium=email&utm_source=footer>
>>>>> .
>>>>>
>>>> --
>>> --
>>> You received this message because you are subscribed to the "Android
>>> Building" mailing list.
>>> To post to this group, send email to [email protected]
>>> To unsubscribe from this group, send email to
>>> [email protected]
>>> For more options, visit this group at
>>> http://groups.google.com/group/android-building?hl=en
>>>
>>> ---
>>> You received this message because you are subscribed to the Google
>>> Groups "Android Building" group.
>>> To unsubscribe from this group and stop receiving emails from it, send
>>> an email to [email protected].
>>>
>> To view this discussion on the web visit
>>> https://groups.google.com/d/msgid/android-building/84771f90-a135-4025-85d3-4d5fe5e3b662n%40googlegroups.com
>>> <https://groups.google.com/d/msgid/android-building/84771f90-a135-4025-85d3-4d5fe5e3b662n%40googlegroups.com?utm_medium=email&utm_source=footer>
>>> .
>>>
>> --
> --
> You received this message because you are subscribed to the "Android
> Building" mailing list.
> To post to this group, send email to [email protected]
> To unsubscribe from this group, send email to
> [email protected]
> For more options, visit this group at
> http://groups.google.com/group/android-building?hl=en
>
> ---
> You received this message because you are subscribed to the Google Groups
> "Android Building" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/android-building/ae2ba21a-319f-4960-9041-8b349dd1fd9fn%40googlegroups.com
> <https://groups.google.com/d/msgid/android-building/ae2ba21a-319f-4960-9041-8b349dd1fd9fn%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
>
--
--
You received this message because you are subscribed to the "Android Building"
mailing list.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to
[email protected]
For more options, visit this group at
http://groups.google.com/group/android-building?hl=en
---
You received this message because you are subscribed to the Google Groups
"Android Building" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/android-building/CAHUnK-1%3D2z-U%2B-gmmTzzfdkxUuei6qcFmP_qz%3Dvgp16i4t2P2w%40mail.gmail.com.
