Commit 11fc197a authored by Holger Levsen's avatar Holger Levsen
Browse files

reproducible: migrate everything from osuosl170+184 to osuosl1+2 and retire the former 



Signed-off-by: default avatarHolger Levsen <holger@layer-acht.org>
parent e95106f8

README.infrastructure

+4 −4
Original line number Diff line number Diff line
@@ -45,8 +45,10 @@ support@osuosl.org mentioning the machine name in the subject. 


The nodes are used for these jobs:



* osuosl1-amd64: openwrt, coreboot, netbsd

* osuosl2-amd64: openwrt, coreboot (future)

* osuosl1-amd64: archlinux, alpine, coreboot, netbsd, openwrt

* osuosl2-amd64: archlinux, alpine, coreboot, openwrt

** osuosl2 is running in the future

** the alpine jobs are disabled

* osuosl3-amd64: unused

* osuosl4-amd64: snapshot.r-b.o, soon not anymore, then free for other stuff

* osuosl5-amd64: to be snapshot.r-b.o
@@ -56,10 +58,8 @@ The nodes are used for these jobs: 
* osuosl167: debian-janitor and mmdebstrap-jenkins jobs

** janitor and openqa worker should be split on different nodes

* osuosl168: openqa.d.n workers

* osuosl170: archlinux (future), alpine

** is constantly online (in jenkins) now, which is not how we like it and still doesnt solve the netbsd job probs

* osuosl173: Debian live-builds / bootstrap jobs

* osuosl184: archlinux, alpine



=== arm64 nodes

THANKS.head

+2 −4
Original line number Diff line number Diff line
@@ -40,12 +40,10 @@ link:https://jenkins.debian.net/["jenkins.debian.net"] would not be possible wit 
 * In December 2018 we were given access to eight nodes which were donated by Facebook to the GCC Compile Farm project and are now hosted by link:https://osuosl.org/[OSUOSL]:

  ** 32 cores with 144 GB memory for osuosl167-amd64.debian.net used for Debian janitor jobs and mmdebstrap-jenkins jobs

  ** 32 cores with 144 GB memory for osuosl168-amd64.debian.net used for openqa.d.n workers

  ** 32 cores with 144 GB memory for osuosl184-amd64.debian.net used for building Arch Linux for t.r-b.o

  ** 32 cores with 144 GB memory for osuosl170-amd64.debian.net used for building Arch Linux for t.r-b.o

  ** 32 cores with 144 GB memory for osuosl173-amd64.debian.net used for building Debian live builds for t.r-b.o

 * In spring 2023 we got access to some new nodes hosted by link:https://osuosl.org/[OSUOSL]:

  ** 16 cores with 125 GB memory for osuosl1-amd64.reproducible.osuosl.org used for building OpenWrt, coreboot and NetBSD for t.r-b.o

  ** 16 cores with 125 GB memory for osuosl2-amd64.reproducible.osuosl.org used for building OpenWrt, coreboot for t.r-b.o

  ** 16 cores with 125 GB memory for osuosl1-amd64.reproducible.osuosl.org used for building Arch Linux, OpenWrt, coreboot and NetBSD for t.r-b.o

  ** 16 cores with 125 GB memory for osuosl2-amd64.reproducible.osuosl.org used for building Arch Linux, OpenWrt, coreboot for t.r-b.o



==== Past sponsors

TODO

+3 −2
Original line number Diff line number Diff line
@@ -41,9 +41,10 @@ See link:https://jenkins.debian.net/userContent/about.html["about jenkins.debian 
** shutdown legacy nodes at OSUOSL:

*** osuosl167

*** osuosl168

*** osuosl170

*** osuosl173

*** osuosl184

*** already zombified, just waiting for osuosl ack:

**** osuosl170

**** osuosl184

* setup netconsoles:

----

<guerby> | Ramereth, h01ger netconsole is about the only way to diagnose this kind of issue in my experience

bin/common-functions.sh

+1 −1
Original line number Diff line number Diff line
@@ -233,7 +233,7 @@ jenkins_zombie_check() { 
	# related however is that I issued a reboot (via running 

	# /sbin/reboot) right before the zombies appeared...

	#

	ZOMBIES="$(ls -1d /var/lib/jenkins/jobs/* | egrep 'strip-nondeterminism|reprotest|reproducible_(builder_(amd64|i386|armhf|arm64)|setup_(pbuilder|schroot)_testing)|chroot-installation_wheezy|aptdpkg|stretch_install_education-thin-client-server|jessie_multiarch_versionskew|dpkg_stretch_find_trigger_cycles|sid_install_education-services|buster_install_education-services|lvc|chroot-installation_stretch_.*_upgrade_to_sid|chroot-installation_buster_.*_upgrade_to_sid|piuparts_.*_jessie|udd_stretch|d-i_pu-build|debsums-tests_stretch|debian-archive-keyring-tests_stretch|chroot-installation_jessie|chroot-installation_.*education-lang-|kirkwoot|rebootstrap_.*_gcc[5-9]($|_)|rebootstrap_.*_gcc1[01]($|_)|brcm47xx|rebootstrap_kfreebsd|diffoscope_from_git_|disorderfs_from_git_master|diffoscope_pypi|diffoscope_freebsd|diffoscope_netbsd|diffoscope_macports|diffoscope_archlinux|openwrt-target-ath97|profitbricks|pool_buildinfos_suites|g-i-installation|reproducible_compare_Debian_sha1sums|bbx15|cb3a|ff2a|ff2b|jtk1a|jtk1b|odxu4a|odxu4b|odu3a|opi2a|opi2c|p64b|p64c|ar71xx|reproducible_debian_live_build$|chroot-installation_stretch|chroot-installation_bullseye*upgrade_to_sid|rebuilder_prototype|osuosl169|osuosl171|osuosl172|osuosl174|fakeroot-foreign|fdroid|reproducible_.*_reproducible?$|health_check_amd64_snapshot' || true)"

	ZOMBIES="$(ls -1d /var/lib/jenkins/jobs/* | egrep 'strip-nondeterminism|reprotest|reproducible_(builder_(amd64|i386|armhf|arm64)|setup_(pbuilder|schroot)_testing)|chroot-installation_wheezy|aptdpkg|stretch_install_education-thin-client-server|jessie_multiarch_versionskew|dpkg_stretch_find_trigger_cycles|sid_install_education-services|buster_install_education-services|lvc|chroot-installation_stretch_.*_upgrade_to_sid|chroot-installation_buster_.*_upgrade_to_sid|piuparts_.*_jessie|udd_stretch|d-i_pu-build|debsums-tests_stretch|debian-archive-keyring-tests_stretch|chroot-installation_jessie|chroot-installation_.*education-lang-|kirkwoot|rebootstrap_.*_gcc[5-9]($|_)|rebootstrap_.*_gcc1[01]($|_)|brcm47xx|rebootstrap_kfreebsd|diffoscope_from_git_|disorderfs_from_git_master|diffoscope_pypi|diffoscope_freebsd|diffoscope_netbsd|diffoscope_macports|diffoscope_archlinux|openwrt-target-ath97|profitbricks|pool_buildinfos_suites|g-i-installation|reproducible_compare_Debian_sha1sums|bbx15|cb3a|ff2a|ff2b|jtk1a|jtk1b|odxu4a|odxu4b|odu3a|opi2a|opi2c|p64b|p64c|ar71xx|reproducible_debian_live_build$|chroot-installation_stretch|chroot-installation_bullseye*upgrade_to_sid|rebuilder_prototype|osuosl169|osuosl170|osuosl171|osuosl172|osuosl174|osuosl184fakeroot-foreign|fdroid|reproducible_.*_reproducible?$|health_check_amd64_snapshot' || true)"

	if [ ! -z "$ZOMBIES" ] ; then

		DIRTY=true

		figlet 'zombies!!!'

bin/jenkins_node_definitions.sh

+0 −5
Original line number Diff line number Diff line
@@ -50,8 +50,6 @@ osuosl2-amd64.reproducible.osuosl.org 
osuosl3-amd64.reproducible.osuosl.org

osuosl167-amd64.debian.net

osuosl168-amd64.debian.net

osuosl184-amd64.debian.net

osuosl170-amd64.debian.net

osuosl173-amd64.debian.net"



NODE_RUN_IN_THE_FUTURE=false
@@ -73,9 +71,6 @@ get_node_information() { 
	  codethink15*)

	    NODE_RUN_IN_THE_FUTURE=true

	    ;;

	  osuosl170*)

	    NODE_RUN_IN_THE_FUTURE=true

	    ;;

	  osuosl2-amd64*)

	    NODE_RUN_IN_THE_FUTURE=true

	    ;;