Good evening, sorry for long and pesimistic e-mail, but I hope that someone will point me to something I'm doing completely wrong.
First I was surprised to see how many recipes were rebuilt after this change: http://git.openembedded.net/cgit.cgi/openembedded-core/commit/?id=aebb9d6599aac683456adf56dc11f8b9f10f25c3 because [YOCTO #1074] was resolved by bitbake commit: http://git.openembedded.net/cgit.cgi/bitbake/commit/?id=139b8a625818225c358a1b8363518d7ed6913188 and I had rm_work change http://patches.openembedded.org/patch/4807/ during this build I decided to find out what is changing so many sstate checksums for such small changes so I took another small dbus change from patchwork http://patches.openembedded.org/patch/4831/ and rebuild many recipes again to play with bitbake-diffsig for a while.. $ bitbake shr-lite-image ... many recipes (efl,gtk,..) were rebuilt ... ... but lets start somewhere close to dbus in dependency tree - pango ... -rw-r--r-- 1 bitbake bitbake 17636 May 26 21:38 pango-1.28.3-r1.0.do_install.sigdata.77b947a28726e59e2075edba10e60295 -rw-r--r-- 1 bitbake bitbake 17636 May 26 23:08 pango-1.28.3-r1.0.do_install.sigdata.222b490aa1dde18f95b0dd32826012bf $ bitbake-diffsigs pango-1.28.3-r1.0.do_install.sigdata.77b947a28726e59e2075edba10e60295 pango-1.28.3-r1.0.do_install.sigdata.222b490aa1dde18f95b0dd32826012bf Hash for dependent task /OE/shr-core/meta-openembedded/meta-oe/recipes-graphics/pango/pango_1.28.3.bb.do_compile changed from 1afaf7d1eced69f56c8f1cf67229ebc2 to 3d1b790028978c4ebda8e8ea4b26c2d7 -rw-r--r-- 1 bitbake bitbake 16031 May 26 21:38 pango-1.28.3-r1.0.do_compile.sigdata.1afaf7d1eced69f56c8f1cf67229ebc2 -rw-r--r-- 1 bitbake bitbake 16031 May 26 23:08 pango-1.28.3-r1.0.do_compile.sigdata.3d1b790028978c4ebda8e8ea4b26c2d7 $ bitbake-diffsigs pango-1.28.3-r1.0.do_compile.sigdata.1afaf7d1eced69f56c8f1cf67229ebc2 pango-1.28.3-r1.0.do_compile.sigdata.3d1b790028978c4ebda8e8ea4b26c2d7 Hash for dependent task /OE/shr-core/meta-openembedded/meta-oe/recipes-graphics/pango/pango_1.28.3.bb.do_configure changed from 2a2fe90e11a773b704ded6d64bbd6b8f to 8c411f1e2b2b3fe6459a4fa873420c8d -rw-r--r-- 1 bitbake bitbake 24993 May 26 21:37 pango-1.28.3-r1.0.do_configure.sigdata.2a2fe90e11a773b704ded6d64bbd6b8f -rw-r--r-- 1 bitbake bitbake 24993 May 26 23:08 pango-1.28.3-r1.0.do_configure.sigdata.8c411f1e2b2b3fe6459a4fa873420c8d $ bitbake-diffsigs pango-1.28.3-r1.0.do_configure.sigdata.2a2fe90e11a773b704ded6d64bbd6b8f pango-1.28.3-r1.0.do_configure.sigdata.8c411f1e2b2b3fe6459a4fa873420c8d Hash for dependent task /OE/shr-core/meta-openembedded/meta-oe/recipes-graphics/cairo/cairo_1.10.0.bb.do_populate_sysroot changed from fe20d4ce2bb2bf730d027febf2dfeb27 to 0454302dbff3f34b36967a4679940349 Hash for dependent task /OE/shr-core/meta-openembedded/meta-oe/recipes-core/glib-2.0/glib-2.0_git.bb.do_populate_sysroot changed from 45d7590c466843330d9b788b253238d8 to 68a4f9b8d7c1fafea99be54e5a2da220 following 2nd change because it's shorter route to dbus change.. -rw-r--r-- 1 bitbake bitbake 19K May 26 21:35 sstate-cache/sstate-glib-2.0-armv4t-oe-linux-gnueabi-2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1-armv4t-2-45d7590c466843330d9b788b253238d8_populate-sysroot.tgz.siginfo -rw-r--r-- 1 bitbake bitbake 19K May 26 23:05 sstate-cache/sstate-glib-2.0-armv4t-oe-linux-gnueabi-2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1-armv4t-2-68a4f9b8d7c1fafea99be54e5a2da220_populate-sysroot.tgz.siginfo $ bitbake-diffsigs sstate-cache/sstate-glib-2.0-armv4t-oe-linux-gnueabi-2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1-armv4t-2-45d7590c466843330d9b788b253238d8_populate-sysroot.tgz.siginfo sstate-cache/sstate-glib-2.0-armv4t-oe-linux-gnueabi-2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1-armv4t-2-68a4f9b8d7c1fafea99be54e5a2da220_populate-sysroot.tgz.siginfo Hash for dependent task /OE/shr-core/meta-openembedded/meta-oe/recipes-core/glib-2.0/glib-2.0_git.bb.do_install changed from 2bc0418b6ff355c63d66183b6390767d to fa5d28375a53c5095982070678980132 -rw-r--r-- 1 bitbake bitbake 17277 May 26 21:35 tmp/stamps/armv4t-oe-linux-gnueabi/glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_install.sigdata.2bc0418b6ff355c63d66183b6390767d -rw-r--r-- 1 bitbake bitbake 17277 May 26 23:05 tmp/stamps/armv4t-oe-linux-gnueabi/glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_install.sigdata.fa5d28375a53c5095982070678980132 $ bitbake-diffsigs glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_install.sigdata.2bc0418b6ff355c63d66183b6390767d glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_install.sigdata.fa5d28375a53c5095982070678980132 Hash for dependent task /OE/shr-core/meta-openembedded/meta-oe/recipes-core/glib-2.0/glib-2.0_git.bb.do_compile changed from e67b51e60d7591b28b0a19a35a061fb7 to 0d670ad6e3c8f3e5a0380236cdb80056 -rw-r--r-- 1 bitbake bitbake 16K May 26 23:05 glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_compile.sigdata.0d670ad6e3c8f3e5a0380236cdb80056 -rw-r--r-- 1 bitbake bitbake 16K May 26 21:35 glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_compile.sigdata.e67b51e60d7591b28b0a19a35a061fb7 $ bitbake-diffsigs glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_compile.sigdata.* Hash for dependent task /OE/shr-core/meta-openembedded/meta-oe/recipes-core/glib-2.0/glib-2.0_git.bb.do_configure changed from 32a3526d951c1cfda7d0986d401aac28 to 86d1c9dd8ed0dfceb74120634f4ee971 -rw-r--r-- 1 bitbake bitbake 25K May 26 23:04 glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_configure.sigdata.32a3526d951c1cfda7d0986d401aac28 -rw-r--r-- 1 bitbake bitbake 25K May 26 21:34 glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_configure.sigdata.86d1c9dd8ed0dfceb74120634f4ee971 bitbake-diffsigs glib-2.0-1_2.29.3+gitr1+d97cbc6731deab137770bc0fe9c69b06f689f5b4-r1.do_configure.sigdata.* Hash for dependent task /OE/shr-core/openembedded-core/meta/recipes-core/dbus/dbus_1.4.1.bb.do_populate_sysroot changed from 06a8b2e32ba10864a6fc097912833176 to fe413a8f790ae3f6ce7a22deea084cfc Hash for dependent task virtual:native:/OE/shr-core/meta-openembedded/meta-oe/recipes-core/glib-2.0/glib-2.0_git.bb.do_populate_sysroot changed from 18f974e09d0fd66cc765866ab565b333 to 51430fcfa8309f9a9276c1e602429f32 -rw-r--r-- 1 bitbake bitbake 19K May 26 21:30 sstate-dbus-armv4t-oe-linux-gnueabi-1.4.1-r3-armv4t-2-fe413a8f790ae3f6ce7a22deea084cfc_populate-sysroot.tgz.siginfo -rw-r--r-- 1 bitbake bitbake 19K May 26 23:00 sstate-dbus-armv4t-oe-linux-gnueabi-1.4.1-r4-armv4t-2-06a8b2e32ba10864a6fc097912833176_populate-sysroot.tgz.siginfo $ bitbake-diffsigs sstate-dbus-armv4t-oe-linux-gnueabi-1.4.1-r3-armv4t-2-fe413a8f790ae3f6ce7a22deea084cfc_populate-sysroot.tgz.siginfo sstate-dbus-armv4t-oe-linux-gnueabi-1.4.1-r4-armv4t-2-06a8b2e32ba10864a6fc097912833176_populate-sysroot.tgz.siginfo basehash changed from ef08f39470f19b15d24f9dac466d0f4c to 7841aff775985c1eb6c2dae88f5aa8a4 Variable PR value changed from r3 to r4 Hash for dependent task /OE/shr-core/openembedded-core/meta/recipes-core/dbus/dbus_1.4.1.bb.do_install changed from a45db97e2ceeecb9e0335f521cc310b7 to 39276f431220a1d8c29857031ad05fb1 -rw-r--r-- 1 bitbake bitbake 17K May 26 21:30 dbus-1.4.1-r3.do_install.sigdata.a45db97e2ceeecb9e0335f521cc310b7 -rw-r--r-- 1 bitbake bitbake 17K May 26 23:00 dbus-1.4.1-r4.do_install.sigdata.39276f431220a1d8c29857031ad05fb1 $ bitbake-diffsigs dbus-1.4.1-r*do_install*sigdata* basehash changed from 353b2f86e0001c380d17efc7ea6ce2c5 to 234e7bf0263eda31deb9d7b644f2e7cf Variable PR value changed from r3 to r4 Hash for dependent task /OE/shr-core/openembedded-core/meta/recipes-core/dbus/dbus_1.4.1.bb.do_compile changed from f6e2879a484955efa017c6ab32a5509a to e24cd7b5f9dd3e18cbbca0008d3814da -rw-r--r-- 1 bitbake bitbake 16K May 26 21:30 dbus-1.4.1-r3.do_compile.sigdata.f6e2879a484955efa017c6ab32a5509a -rw-r--r-- 1 bitbake bitbake 16K May 26 23:00 dbus-1.4.1-r4.do_compile.sigdata.e24cd7b5f9dd3e18cbbca0008d3814da $ bitbake-diffsigs dbus-1.4.1-r*do_compile*sigdata* Hash for dependent task /OE/shr-core/openembedded-core/meta/recipes-core/dbus/dbus_1.4.1.bb.do_configure changed from 56d3d4f8c7e312651b0312983fd0111b to c9735abe8bd30b126c6c96cf4940f413 -rw-r--r-- 1 bitbake bitbake 25K May 26 21:30 dbus-1.4.1-r3.do_configure.sigdata.56d3d4f8c7e312651b0312983fd0111b -rw-r--r-- 1 bitbake bitbake 25K May 26 23:00 dbus-1.4.1-r4.do_configure.sigdata.c9735abe8bd30b126c6c96cf4940f413 OE @ ~/shr-core/tmp/stamps/armv4t-oe-linux-gnueabi $ bitbake-diffsigs dbus-1.4.1-r*do_configure*sigdata* basehash changed from 7c8afe5d11242edc07d33b7a099ddbaa to f8c3cb2c46f77feb23750921b5c2c0be Variable PR value changed from r3 to r4 Hash for dependent task /OE/shr-core/openembedded-core/meta/recipes-core/dbus/dbus_1.4.1.bb.do_patch changed from 84b94d5311ac57ce52576707e36e1280 to f7844c10b663a87f0e2d64d1db150125 Hash for dependent task /OE/shr-core/openembedded-core/meta/recipes-core/dbus/dbus_1.4.1.bb.do_unpack changed from f1490bb761693eebb94c4264eae59905 to 90868c27ba834e0557eeeeac70ff8052 $ bitbake-diffsigs dbus-1.4.1-r*do_patch*sigdata* basehash changed from 8f395933e8dc8bfef6ab807a3d61688e to 478ed1531b11d7e71546c3322eb00818 Variable PR value changed from r3 to r4 Hash for dependent task /OE/shr-core/openembedded-core/meta/recipes-core/dbus/dbus_1.4.1.bb.do_unpack changed from f1490bb761693eebb94c4264eae59905 to 90868c27ba834e0557eeeeac70ff8052 $ bitbake-diffsigs dbus-1.4.1-r*do_unpack*sigdata* basehash changed from 3154be70060b894d8bc19355edc4b78c to 9bbf619b99d6b8fd0d36f215cd6ae293 Variable PR value changed from r3 to r4 .. end of story .. .. I agree it's "right (TM)" to rebuild not only changed package but also its dependencies .. .. I agree it's not possible to differentiate between important library change which can infulence also packages depending on it even if only transitive and cosmetic change improving ie RDEPENDS_${PN} which doesn't influence even direct dependants .. but impact of such small change on small shr-lite-image? almost 2 hours on my quadcore AMD Phenom(tm) II X4 [email protected], 4GB RAM, tmp/work on raid0 (3 SATA2 discs) guess how long is runqueue when someone bumps binutils or gcc PR.. it's like DISTRO_PR bump :/ but almost after every "git pull --rebase". this was for our minimal image task-shr-feed we have in old OE takes about 2-3 days on our buildhost (dualcore with 2GB ram) for 1 arch, we (SHR) are supporting 3 arm architectures armv4t (om-gta01, om-gta02), armv6-novfp (htcdream), armv7a (palmpre, palmpre2, nokia900) so currently it takes 10-14 days to rebuild feed after DISTRO_PR change.. I'm not sure if we can afford our feeds to track oe-core/meta-oe HEADs like we did with old OE :(. Is it expected use-case to base layers only on released version of oe-core/meta-oe and never touch recipes which are higher in dependency tree? Is it possible to disable sstate and do DISTRO_PR bumps manually when distro maintainder decides it's really needed and buildhost is free for long enough to populate feeds? Regards, -- Martin 'JaMa' Jansa jabber: [email protected]
_______________________________________________ Openembedded-core mailing list [email protected] http://lists.linuxtogo.org/cgi-bin/mailman/listinfo/openembedded-core
