OpenSuse Build Service/Installation - Revision history

xfade: Remove Power/ppc section

2010-07-15T08:29:00Z

Remove Power/ppc section

← Older revision		Revision as of 08:29, 15 July 2010
Line 498:		Line 498:
	On the backend machine edit /usr/lib/build/xen.conf to use the correct initrd		On the backend machine edit /usr/lib/build/xen.conf to use the correct initrd

		+	== Remove Power/PPC from monitor page==
		+
		+	We don't target PPC, so best remove it from the build monitor page:
		+
		+	On FE in webui/app/views/monitor/_plots.rhtml
		+
		+	Use html comments to disable the Power line:
		+
		+	<pre><!--<%= render :partial => 'graphs_arch', :locals => { :title => "Power", :prefix => 'ppc_' } %>--></pre>
		+
		+	On FE webui/config/environment.rb
		+
		+	Change the MONITOR_IMAGEMAP section to:
		+
		+	<pre>MONITOR_IMAGEMAP = {.
		+	'pc_waiting' => [
		+	["i586", 'waiting_i586'],
		+	["x86_64", 'waiting_x86_64'] ],
		+	'pc_blocked' => [
		+	["i586", 'blocked_i586' ],
		+	["x86_64", 'blocked_x86_64'] ],
		+	'pc_workers' => [
		+	["idle", 'idle_x86_64' ],
		+	['building', 'building_x86_64' ] ],
		+	# 'ppc_waiting' => [
		+	# ["ppc", 'waiting_ppc'],
		+	# ["ppc64", 'waiting_ppc64'] ],
		+	# 'ppc_blocked' => [
		+	# ["ppc", 'blocked_ppc' ],
		+	# ["ppc64", 'blocked_ppc64'] ],
		+	# 'ppc_workers' => [
		+	# ["idle", 'idle_ppc64' ],
		+	# ['building', 'building_ppc64' ] ],
		+	'arm_waiting' => [
		+	["armv5", 'waiting_armv5el'],
		+	["armv7", 'waiting_armv7el'] ],
		+	'arm_blocked' => [
		+	["armv5", 'blocked_armv5el' ],
		+	["armv7", 'blocked_armv7el'] ],
		+	'arm_workers' => [
		+	["idle", 'idle_armv7el' ],
		+	['building', 'building_armv7el' ] ],
		+	}
		+
		+	</pre>
	[[Category:OpenSuse build service]]		[[Category:OpenSuse build service]]

timeless: grammar/spelling/capitalization

2010-07-09T11:40:38Z

grammar/spelling/capitalization

← Older revision		Revision as of 11:40, 9 July 2010
Line 11:		Line 11:
	== Networking Overview ==		== Networking Overview ==

-	The Front End (fe) machine provides two major services:	+	The Front End (FE) machine provides two major services:
	* the webui on build.obs and		* the webui on build.obs and
	* the API on apo.obs;		* the API on apo.obs;
	It is also a useful holding point for the download service on download.obs		It is also a useful holding point for the download service on download.obs

-	The Back End (be) machine provides the backend services including the schedulers, source server and repo server. The repo server (used by the workers to get required rpms) also doubles as the download server via a reverse-proxy on the fe.	+	The Back End (BE) machine provides the backend services including the schedulers, source server and repo server. The repo server (used by the workers to get required rpms) also doubles as the download server via a reverse-proxy on the FE.

	<source lang="bash">		<source lang="bash">
Line 47:		Line 47:
	</source>		</source>

-	Create some ~~xen~~ volumes	+	Create some Xen volumes
	<source lang='bash'>		<source lang='bash'>
	lvcreate -L 10G VG_data -n fe_root		lvcreate -L 10G VG_data -n fe_root
Line 62:		Line 62:
	</source>		</source>

-	Prepare an ~~opensuse~~ minimal image:	+	Prepare an openSUSE minimal image:
	<source lang='bash'>		<source lang='bash'>
	ROOTFS=/data/11.2min/image-root		ROOTFS=/data/11.2min/image-root
Line 142:		Line 142:
	== Installing the Backend ==		== Installing the Backend ==

-	On this host we need also to setup ~~openSuse~~ Tools repository:	+	On this host we need also to setup openSUSE Tools repository:
	<source lang='bash'>		<source lang='bash'>
	cd /etc/zypp/repos.d/;		cd /etc/zypp/repos.d/;
Line 154:		Line 154:
	zypper in obs-server obs-signer obs-utils createrepo dpkg nfs-client		zypper in obs-server obs-signer obs-utils createrepo dpkg nfs-client
	# obs-server brings these other packages as dependency. This is just for you to notice which packages are needed for Backend installation		# obs-server brings these other packages as dependency. This is just for you to notice which packages are needed for Backend installation
-	# createrepo & dpkg are only ~~reccomends~~	+	# createrepo & dpkg are only recommends
-	# ~~nfs~~ client is needed as we use an ~~nfs~~ share for host/be interchange	+	# NFS client is needed as we use an NFS share for host/BE interchange
	</source>		</source>
	Configure Scheduler architectures		Configure Scheduler architectures
Line 163:		Line 163:
	</source>		</source>

-	/usr/lib/obs/server/BSConfig.pm needs to point to correct server names corresponding to source server, where workers are going to download the source, and the repository server, where RPM repos are going to be ~~shered~~ to users.	+	/usr/lib/obs/server/BSConfig.pm needs to point to correct server names corresponding to source server, where workers are going to download the source, and the repository server, where RPM repos are going to be shared to users.
	<source lang='bash'>		<source lang='bash'>
	vi /usr/lib/obs/server/BSConfig.pm		vi /usr/lib/obs/server/BSConfig.pm
Line 174:		Line 174:
	</source>		</source>

-	Configure services as ~~deamons~~	+	Configure services as daemons
	<source lang='bash'>		<source lang='bash'>
	chkconfig --add obsrepserver obssrcserver obsscheduler obsdispatcher obspublisher obswarden obssigner		chkconfig --add obsrepserver obssrcserver obsscheduler obsdispatcher obspublisher obswarden obssigner
Line 191:		Line 191:
	For version 1.7 there are a new services. You can start them as well:		For version 1.7 there are a new services. You can start them as well:
	* '''obswarden'''		* '''obswarden'''
-	It checks if build hosts are ~~dieing~~ and cleans up hanging builds	+	It checks if build hosts are dying and cleans up hanging builds
	* '''obssigner'''		* '''obssigner'''
	It is used to sign packages via the obs-sign daemon. You need to configure		It is used to sign packages via the obs-sign daemon. You need to configure
	it in BSConfig.pm before you can use it.		it in BSConfig.pm before you can use it.
	* '''obsservice'''		* '''obsservice'''
-	~~The~~ is the source service daemon. OBS 1.7 just comes with a download	+	This is the source service daemon. OBS 1.7 just comes with a download
	service so far. This feature is considered to be experimental so far,		service so far. This feature is considered to be experimental so far,
	but can be already extended with own services.		but can be already extended with own services.
Line 240:		Line 240:
	</source>		</source>

-	== Installing the ~~Frontend~~ (WebUI and API) ==	+	== Installing the FrontEnd (WebUI and API) ==

-	Start with a minimal ~~Suse~~ install and then add Tools repository where OBS 1.7 is available.	+	Start with a minimal SUSE install and then add Tools repository where OBS 1.7 is available.
	<source lang='bash'>		<source lang='bash'>
	cd /etc/zypp/repos.d/;		cd /etc/zypp/repos.d/;
Line 255:		Line 255:
	</source>		</source>

-	'''Setup ~~Mysql~~'''	+	'''Setup MySQL'''

-	~~Mysql~~ server needs to be installed and configured to start as ~~deamon~~	+	MySQL server needs to be installed and configured to start as daemon
	<source lang='bash'>		<source lang='bash'>
	chkconfig --add mysql		chkconfig --add mysql
	rcmysql start		rcmysql start
	</source>		</source>
-	Setup a secure installation, if it's the first time starting ~~mysql~~	+	Setup a secure installation, if it's the first time starting MySQL
	<source lang='bash'>		<source lang='bash'>
	/usr/bin/mysql_secure_installation		/usr/bin/mysql_secure_installation
	</source>		</source>
-	The frontend instance holds 2 applications, the ~~api~~ and the webui. Each one need a database created	+	The frontend instance holds 2 applications, the API and the webui. Each one need a database created
	<source lang='bash'>		<source lang='bash'>
	mysql -u root -p		mysql -u root -p
Line 282:		Line 282:
	FLUSH PRIVILEGES;		FLUSH PRIVILEGES;
	</source>		</source>
-	Configure your MySQL user and password in the "production:" section of the ~~api~~ config:	+	Configure your MySQL user and password in the "production:" section of the API config:
	<source lang='bash'>		<source lang='bash'>
	vi /srv/www/obs/api/config/database.yml		vi /srv/www/obs/api/config/database.yml
Line 292:		Line 292:
	password: ************		password: ************
	</source>		</source>
-	Do the same for the webui. It's configured, by default to use ~~sqlite~~, but since we're configuring the cluster for production environment, let's bind it to mysql:	+	Do the same for the webui. It's configured, by default to use SQLite, but since we're configuring the cluster for production environment, let's bind it to mysql:

	<source lang='bash'>		<source lang='bash'>
Line 313:		Line 313:
	You can check the migration was successful verifying the “migrated” message at the end of each statement.		You can check the migration was successful verifying the “migrated” message at the end of each statement.

-	'''Setup and configure lighttpd for the ~~api~~ and webui'''	+	'''Setup and configure lighttpd for the API and webui'''

-	You need to setup the correct hostnames to where webui, ~~api~~ and repo server are going to point to	+	You need to setup the correct hostnames to where webui, API and repo server are going to point to
	<source lang='bash'>		<source lang='bash'>
	vi /etc/lighttpd/vhosts.d/obs.conf		vi /etc/lighttpd/vhosts.d/obs.conf
Line 364:		Line 364:
	include_shell "cat vhosts.d/*.conf"		include_shell "cat vhosts.d/*.conf"
	</source>		</source>
-	Also, the modules "mod_magnet", "mod_rewrite" and ~~fastcgi~~ need to be enabled by uncommenting the corresponding lines in /etc/lighttpd/modules.conf:	+	Also, the modules "mod_magnet", "mod_rewrite" and FastCGI need to be enabled by uncommenting the corresponding lines in /etc/lighttpd/modules.conf:
	<source lang='bash'>		<source lang='bash'>
	vi /etc/lighttpd/modules.conf		vi /etc/lighttpd/modules.conf
Line 417:		Line 417:
	</source>		</source>

-	ligthttpd user and group need to be the ~~onwer~~ of api and webui dirs (as well as log and tmp):	+	ligthttpd user and group need to be the owner of api and webui dirs (as well as log and tmp):
	<source lang='bash'>		<source lang='bash'>
	chown -R lighttpd.lighttpd /srv/www/obs/{api,webui}		chown -R lighttpd.lighttpd /srv/www/obs/{api,webui}
Line 426:		Line 426:
	The other 14 hosts on the cluster are reserved to be used as workers, where package builds are going to place.		The other 14 hosts on the cluster are reserved to be used as workers, where package builds are going to place.

-	The same ~~openSuse~~ Tools repository addition must be done for each worker.	+	The same openSUSE Tools repository addition must be done for each worker.
	<source lang='bash'>		<source lang='bash'>
	cd /etc/zypp/repos.d/;		cd /etc/zypp/repos.d/;
Line 467:		Line 467:
	pvcreate /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part4		pvcreate /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part4

-	Now ~~creat~~ the OBS VG for the host ~~xen~~ worker:	+	Now create the OBS VG for the host Xen worker:
	vgcreate OBS /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part1		vgcreate OBS /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part1
	vgextend OBS /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part2		vgextend OBS /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part2
Line 490:		Line 490:
	qemu-svn		qemu-svn

-	In order to run arm binaries in the ~~xen~~ chroot we need to ensure the initrd inserts binfmt_misc	+	In order to run arm binaries in the Xen chroot we need to ensure the initrd inserts binfmt_misc
	in /etc/sysconfig/kernel, set		in /etc/sysconfig/kernel, set
	DOMU_INITRD_MODULES="xennet xenblk binfmt_misc		DOMU_INITRD_MODULES="xennet xenblk binfmt_misc

lbt: /* Revise VG setup */

2010-07-09T11:08:29Z

Revise VG setup

← Older revision		Revision as of 11:08, 9 July 2010
Line 462:		Line 462:
	== Revise VG setup ==		== Revise VG setup ==

-	~~lvremove~~ /dev/~~VG_data~~/~~w[8~~-~~12]_root~~	+	pvcreate /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part1
-	~~lvremove~~ /dev/~~VG_data~~/~~w[8~~-~~12]_swap~~	+	pvcreate /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part2
-		+	pvcreate /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part3
-	~~pvmove /dev~~/dm-32	+	pvcreate /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part4
-	~~vgreduce VG_data~~ /dev/~~dm-32~~	+
-	~~kpartx -av~~ /~~dev/dm~~-32	+
-		+
-		+
-	~~add map 360060e8005478600000047860000398c_part1p1 (253:21): 0 97659072 linear /dev~~/dm-~~32 63~~	+
-	~~add map 360060e8005478600000047860000398c_part1p2 (253:22): 0 97659135 linear~~ /dev/~~dm-32 97659135~~	+
-	~~add map 360060e8005478600000047860000398c_part1p3 (253:23): 0 97659135 linear~~ /~~dev/dm~~-~~32 195318270~~	+
-	~~add map 360060e8005478600000047860000398c_part1p4 (253:24): 0 126431550 linear /dev~~/dm-~~32 292977405~~	+
-		+
-	~~(Worried these partitions may not come back at reboot time)~~	+

	Now creat the OBS VG for the host xen worker:		Now creat the OBS VG for the host xen worker:
-	~~pvcreate /dev/mapper/360060e8005478600000047860000398c_part1p1~~	+	vgcreate OBS /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part1
-	vgcreate OBS /dev/~~mapper~~/~~360060e8005478600000047860000398c_part1p1~~	+	vgextend OBS /dev/disk/by-id/dm-name-360060e8005478600000047860000398c_part2
-		+
-	~~pvcreate~~ /~~dev/mapper/360060e8005478600000047860000398c_part1p1~~	+
-	vgextend OBS /dev/~~mapper~~/~~360060e8005478600000047860000398c_part1p1~~	+


-	lvcreate -L 5G -n cache OBS	+	lvcreate -L 20G -n cache OBS
	mkfs -text4 /dev/OBS/cache		mkfs -text4 /dev/OBS/cache

Line 493:		Line 480:
	mkfs -text4 /dev/OBS/worker_root$i		mkfs -text4 /dev/OBS/worker_root$i
	lvcreate -L 1G -n worker_swap$i OBS		lvcreate -L 1G -n worker_swap$i OBS
-	mkswap /dev/OBS/worker_swap$i	+	mkswap -f /dev/OBS/worker_swap$i
	done		done

194.237.7.146: /* Networking Overview */

2010-07-07T12:22:39Z

Networking Overview

← Older revision		Revision as of 12:22, 7 July 2010
Line 11:		Line 11:
	== Networking Overview ==		== Networking Overview ==

-	The fe machine provides ~~the~~ two major services:	+	The Front End (fe) machine provides two major services:
	* the webui on build.obs and		* the webui on build.obs and
-	* the ~~api~~ on apo.obs;	+	* the API on apo.obs;
	It is also a useful holding point for the download service on download.obs		It is also a useful holding point for the download service on download.obs

-	The be machine provides the backend services including the schedulers, source server and repo server. The repo server (used by the workers to get required rpms) also doubles as the download server via a reverse-proxy on the fe.	+	The Back End (be) machine provides the backend services including the schedulers, source server and repo server. The repo server (used by the workers to get required rpms) also doubles as the download server via a reverse-proxy on the fe.

	<source lang="bash">		<source lang="bash">

lbt: /* Revise VG setup */

2010-07-06T14:18:12Z

Revise VG setup

← Older revision		Revision as of 14:18, 6 July 2010
Line 502:		Line 502:
	obs-worker (1.7.3)		obs-worker (1.7.3)
	qemu-svn		qemu-svn
		+
		+	In order to run arm binaries in the xen chroot we need to ensure the initrd inserts binfmt_misc
		+	in /etc/sysconfig/kernel, set
		+	DOMU_INITRD_MODULES="xennet xenblk binfmt_misc
		+	then
		+	mkinitrd -k vmlinuz-2.6.31.12-0.2-xen -i initrd-2.6.31.12-0.2-xen-binfmt -B
		+
		+	On the backend machine edit /usr/lib/build/xen.conf to use the correct initrd

	[[Category:OpenSuse build service]]		[[Category:OpenSuse build service]]

lbt: /* Revise VG setup */

2010-07-04T09:33:20Z

Revise VG setup

← Older revision		Revision as of 09:33, 4 July 2010
Line 480:		Line 480:
	pvcreate /dev/mapper/360060e8005478600000047860000398c_part1p1		pvcreate /dev/mapper/360060e8005478600000047860000398c_part1p1
	vgcreate OBS /dev/mapper/360060e8005478600000047860000398c_part1p1		vgcreate OBS /dev/mapper/360060e8005478600000047860000398c_part1p1
		+
		+	pvcreate /dev/mapper/360060e8005478600000047860000398c_part1p1
		+	vgextend OBS /dev/mapper/360060e8005478600000047860000398c_part1p1
		+
		+
		+	lvcreate -L 5G -n cache OBS
		+	mkfs -text4 /dev/OBS/cache
		+
		+	for i in 1 2 3 4 5 6 7 8 9 10
		+	do
		+	lvcreate -L 4G -n worker_root$i OBS
		+	mkfs -text4 /dev/OBS/worker_root$i
		+	lvcreate -L 1G -n worker_swap$i OBS
		+	mkswap /dev/OBS/worker_swap$i
		+	done
		+
		+	Note in 1.7.3 obsstoragesetup makes /OBS.worker/root1/root but obsworker looks for /OBS.worker/root_1/root (root1 vs root_1)
		+
		+
		+	Also ensure the host has :
		+	obs-worker (1.7.3)
		+	qemu-svn

	[[Category:OpenSuse build service]]		[[Category:OpenSuse build service]]

lbt: /* Tuning */

2010-07-02T21:54:14Z

Tuning

← Older revision		Revision as of 21:54, 2 July 2010
Line 459:		Line 459:
	== Tuning ==		== Tuning ==
	The lighttpd config was reduced to 3 api/webui child processes from 5.		The lighttpd config was reduced to 3 api/webui child processes from 5.
		+
		+	== Revise VG setup ==
		+
		+	lvremove /dev/VG_data/w[8-12]_root
		+	lvremove /dev/VG_data/w[8-12]_swap
		+
		+	pvmove /dev/dm-32
		+	vgreduce VG_data /dev/dm-32
		+	kpartx -av /dev/dm-32
		+
		+
		+	add map 360060e8005478600000047860000398c_part1p1 (253:21): 0 97659072 linear /dev/dm-32 63
		+	add map 360060e8005478600000047860000398c_part1p2 (253:22): 0 97659135 linear /dev/dm-32 97659135
		+	add map 360060e8005478600000047860000398c_part1p3 (253:23): 0 97659135 linear /dev/dm-32 195318270
		+	add map 360060e8005478600000047860000398c_part1p4 (253:24): 0 126431550 linear /dev/dm-32 292977405
		+
		+	(Worried these partitions may not come back at reboot time)
		+
		+	Now creat the OBS VG for the host xen worker:
		+	pvcreate /dev/mapper/360060e8005478600000047860000398c_part1p1
		+	vgcreate OBS /dev/mapper/360060e8005478600000047860000398c_part1p1

	[[Category:OpenSuse build service]]		[[Category:OpenSuse build service]]

amigadave: Category:OpenSuse build service

2010-06-18T13:31:28Z

Category:OpenSuse build service

← Older revision		Revision as of 13:31, 18 June 2010
Line 459:		Line 459:
	== Tuning ==		== Tuning ==
	The lighttpd config was reduced to 3 api/webui child processes from 5.		The lighttpd config was reduced to 3 api/webui child processes from 5.
		+
		+	[[Category:OpenSuse build service]]

lbt: /* Installing the Backend */

2010-05-09T21:34:13Z

Installing the Backend

← Older revision		Revision as of 21:34, 9 May 2010
Line 152:		Line 152:
	Install:		Install:
	<source lang='bash'>		<source lang='bash'>
-	zypper in obs-server obs-signer obs-utils nfs-client	+	zypper in obs-server obs-signer obs-utils createrepo dpkg nfs-client
	# obs-server brings these other packages as dependency. This is just for you to notice which packages are needed for Backend installation		# obs-server brings these other packages as dependency. This is just for you to notice which packages are needed for Backend installation
		+	# createrepo & dpkg are only reccomends
		+	# nfs client is needed as we use an nfs share for host/be interchange
	</source>		</source>
	Configure Scheduler architectures		Configure Scheduler architectures

lbt: /* Creating Xen VMs */

2010-05-08T13:40:47Z

Creating Xen VMs

← Older revision		Revision as of 13:40, 8 May 2010
Line 62:		Line 62:
	</source>		</source>

-	~~Prpeare~~ an opensuse minimal image:	+	Prepare an opensuse minimal image:
	<source lang='bash'>		<source lang='bash'>
		+	ROOTFS=/data/11.2min/image-root
	mkdir /data/11.2min		mkdir /data/11.2min
-	kiwi --prepare suse-11.2-JeOS --root ~~/data/11.2min/image-root~~ --add-profile xenFlavour --add-package less --add-package iputils	+	kiwi --prepare suse-11.2-JeOS --root $ROOTFS --add-profile xenFlavour --add-package less --add-package iputils
	</source>		</source>

	Update the config & modules:		Update the config & modules:
	<source lang='bash'>		<source lang='bash'>
-	cp -a /lib/modules/2.6.31.12-0.2-xen ~~/data/11.2min/image-root~~/lib/modules/	+	ROOTFS=/data/11.2min/image-root
		+	cp -a /lib/modules/2.6.31.12-0.2-xen $ROOTFS/lib/modules/

-	echo default 10.1.1.1 > ~~/data/11.2min/image-root~~/etc/sysconfig/network/routes	+	echo default 10.1.1.1 > $ROOTFS/etc/sysconfig/network/routes
-	echo NETCONFIG_DNS_POLICY=\"\" >> ~~/data/11.2min/image-root~~/etc/sysconfig/network/config	+	echo NETCONFIG_DNS_POLICY=\"\" >> $ROOTFS/etc/sysconfig/network/config
-	echo nameserver 8.8.8.8 > ~~/data/11.2min/image-root~~/etc/resolv.conf	+	echo nameserver 8.8.8.8 > $ROOTFS/etc/resolv.conf
-	echo default 10.1.1.1 > ~~/data/11.2min/image-root~~/etc/sysconfig/network/routes	+	echo default 10.1.1.1 > $ROOTFS/etc/sysconfig/network/routes
-	cat << EOF >~~/data/11.2min/image-root~~/etc/sysconfig/network/ifcfg-eth0	+	cat << EOF >$ROOTFS/etc/sysconfig/network/ifcfg-eth0
	BOOTPROTO='static'		BOOTPROTO='static'
	BROADCAST=''		BROADCAST=''
	STARTMODE='onboot'		STARTMODE='onboot'
	EOF		EOF
		+	echo /dev/xvda1 swap swap defaults 0 0 >> $ROOTFS/etc/fstab
	</source>		</source>