Greg's setting up a new FreeBSD system

This is the current version of a saga that goes back decades. Gradually it's taking shape, but this page is laid out just barely sufficiently for me to understand it. Older versions include newsystem-newest.php, dated 25 December 2012.

The steps:

Create a virtual machine eureso with a copy of the machine eureka. This machine will be kept up to date, with a snapshot to avoid surprises. The root file system contains all system-related files, including the /usr and /var hierarchies. The local files are in /home, including a hierarchy /home/local that mirrors /usr/local. /home/local/bin comes before /usr/local/bin in the PATH.

/var is special. Some subdirectories remain on the root file system, others (related to the local system) are in /home/var:

=== grog@eureka (/dev/pts/26) ~ 2 -> ls -l /var drwxr-xr-x 2 root wheel 512 24 Dec 2013 account drwxr-xr-x 4 root wheel 512 24 Dec 2013 at drwxr-x--- 4 root audit 512 24 Dec 2013 audit drwxrwx--- 2 root authpf 512 24 Dec 2013 authpf drwxr-x--- 2 root wheel 512 3 Jul 01:53 backups lrwxr-xr-x 1 root wheel 15 12 Jul 2016 cache -> /home/var/cache drwxr-x--- 2 root wheel 512 31 Dec 2013 crash drwxr-x--- 3 root wheel 512 24 Dec 2013 cron lrwxr-xr-x 1 root wheel 13 25 Nov 2015 db -> /home/var/db/ dr-xr-xr-x 2 root wheel 512 24 Dec 2013 empty drwxrwxr-x 3 root games 512 3 Oct 2016 games drwx------ 2 root wheel 512 24 Dec 2013 heimdal drwxr-xr-x 9 root wheel 512 5 Nov 2015 lib lrwxr-xr-x 1 root wheel 13 25 Nov 2015 log -> /home/var/log lrwxr-xr-x 1 root wheel 14 25 Nov 2015 mail -> /home/var/mail drwxr-xr-x 2 daemon wheel 512 30 Dec 2013 msgs drwxr-xr-x 5 root wheel 512 25 Nov 2015 named drwxr-xr-x 2 root wheel 512 24 Dec 2013 preserve drwxr-xr-x 21 root wheel 1024 3 Jul 10:21 run drwxrwxr-x 2 root daemon 512 2 Jul 09:25 rwho drwxr-xr-x 12 root wheel 512 2 Oct 2016 spool lrwxr-xr-x 1 root wheel 15 25 Nov 2015 squid -> /home/var/squid lrwxr-xr-x 1 root wheel 13 15 Sep 2016 tmp -> /home/var/tmp drwxr-xr-x 3 unbound unbound 512 26 Sep 2014 unbound lrwxr-xr-x 1 root wheel 13 9 Jun 14:39 www -> /home/var/www drwxr-xr-x 2 root wheel 512 25 Nov 2015 yp
Copy the root file system to a new partition on a destination disk. Configure.

Configuration

/etc/fstab: Add swap:

/dev/ada0p3 none swap sw 0 0
/boot/loader.conf: load drivers (nvidia, sound?)
Configure X:

X -configure

Work out how to find driver.

Version of Tue 25 Dec 2012 15:39:55 EST

This is only (and barely) of historical interest. I'm keeping it here as a source of text blocks.

start again with VM

install system

mount /eureka, /eureka/home, /eureka/src -> /src

=== root@eureka (/dev/pts/6) /home/Sysconfig/scripts 29 -> cd /home You have mail in /var/mail/grog === root@eureka (/dev/pts/6) /home 30 -> ls -l total 1 drwxrwxr-x 2 root operator 512 20 Dec 10:01 .snap drwxr-xr-x 109 grog wheel 2560 8 Oct 10:09 Book drwxr-xr-x 11 root wheel 512 26 Oct 2011 OLD-STUFF lrwxr-xr-x 1 root wheel 21 9 Jul 11:41 Sysconfig -> /src/Sysconfig/eureka drwxr-xr-x 13 grog wheel 512 12 Apr 2010 Texts drwxr-xr-x 17 chris wheel 1024 9 Nov 2011 chris drwxr-xr-x 369 grog lemis 123392 25 Dec 15:45 grog drwxr-xr-x 20 grog lemis 1024 8 Jul 11:53 grog.local drwxr-xr-x 5 grog wheel 512 21 Dec 11:45 house drwxr-xr-x 4 root wheel 512 26 Dec 2011 local drwxr-xr-x 8 grog wheel 2048 12 Jan 2007 monkey lrwxr-xr-x 1 root wheel 21 19 Dec 2011 ncvs -> /src/CVS/FreeBSD/ncvs drwxr-xr-x 71 grog lemis 2048 25 Dec 04:44 ports drwxr-xr-x 23 grog lemis 1024 26 Oct 2011 src drwxrwxrwt 351 root wheel 31744 25 Dec 15:56 tmp drwxr-xr-x 7 root wheel 512 11 Jul 08:19 var drwxr-xr-x 5 grog wheel 512 28 Feb 2011 w3 drwxr-xr-x 42 yana home 4608 28 Dec 2011 yana drwxr-xr-x 27 yvonne home 1024 25 Dec 15:45 yvonne === root@eureka (/dev/pts/6) /home 31 -> pd /src/Sysconfig/ /src/Sysconfig /home === root@eureka (/dev/pts/6) /src/Sysconfig 32 -> l total 1 drwxr-xr-x 4 grog wheel 512 16 Feb 2007 Master drwxr-xr-x 5 grog wheel 512 5 Apr 2005 asterix drwxr-xr-x 5 root wheel 512 6 Oct 22:23 battunga drwxrwxrwx 3 root wheel 512 12 Apr 2008 boskoop drwxr-xr-x 6 grog wheel 512 21 Sep 2009 brewer drwxr-sr-x 4 grog 50 512 23 Nov 2006 ceeveear drwxr-xr-x 4 root wheel 512 10 Mar 2007 cvr2 drwxr-xr-x 11 root wheel 512 28 Sep 13:09 dereel drwxr-xr-x 10 root wheel 512 24 Dec 17:17 echunga drwxr-xr-x 9 grog wheel 512 10 Mar 2009 eucla drwxr-xr-x 3 grog wheel 512 14 Sep 2006 eucla-MySQL drwxr-xr-x 9 grog wheel 512 30 Oct 2005 eucla-Rocksoft drwxr-xr-x 10 root wheel 512 24 Dec 17:17 eureka drwxr-xr-x 7 root wheel 512 27 Jul 2008 eureka.old drwxr-xr-x 10 root wheel 512 21 Mar 2010 foo drwxr-xr-x 10 root wheel 512 21 Mar 2010 foofoo drwxr-xr-x 10 root wheel 512 2 Sep 2009 kimchi drwxr-xr-x 5 root wheel 512 6 Oct 22:23 lagoon drwxr-xr-x 7 grog wheel 512 21 Mar 2005 mojave drwxr-xr-x 5 root wheel 512 11 Apr 2007 monorchid drwxr-xr-x 5 grog wheel 512 4 Jan 2005 naan drwxr-xr-x 7 grog wheel 512 22 Mar 2005 obelix drwxr-xr-x 6 grog wheel 512 17 Sep 2006 oldteevee drwxr-xr-x 4 root wheel 512 11 Nov 2007 pong-gw drwxr-xr-x 6 grog wheel 512 27 Sep 2005 quartet drwxr-xr-x 3 root wheel 512 21 Mar 2010 src drwxr-xr-x 10 grog wheel 512 9 Jul 2009 swamp drwxr-xr-x 9 root wheel 512 11 Feb 2008 swamp.old drwxr-xr-x 6 grog wheel 512 18 Oct 2011 teevee drwxr-xr-x 7 grog wheel 512 21 Mar 2005 teevee-old drwxr-xr-x 7 grog wheel 512 12 Jun 2007 tv2 drwxr-xr-x 6 grog wheel 512 26 Aug 2006 tv2-old drwxr-xr-x 7 root wheel 512 28 Jun 2008 w3 drwxr-xr-x 11 root wheel 512 28 Sep 13:09 wantadilla drwxr-xr-x 7 grog wheel 512 23 Sep 2005 zaphod === root@eureka (/dev/pts/6) /src/Sysconfig 33 -> mkdir stable-amd64 drwxr-xr-x 7 grog wheel 512 23 Sep 2005 zaphod === root@eureka (/dev/pts/6) /src/Sysconfig 33 -> mkdir stable-amd64 === root@eureka (/dev/pts/6) /src/Sysconfig 34 -> cd eureka === root@eureka (/dev/pts/6) /src/Sysconfig/eureka 35 -> tar cf - .|(cd ../stable-amd64/ && tar xvf -) On stable: cd /home ln -s /src/Sysconfig/stable-amd64 Sysconfig ln -s /eureka/home/local kldload linux cd scripts make packages

This will take a long time. Meanwhile:

Add users. Check etc/master.passwd and /etc/group:

=== root@eureka (/dev/pts/13) /etc 115 -> mv group group.orig === root@eureka (/dev/pts/13) /etc 115 -> mv master.passwd master.passwd.orig === root@eureka (/dev/pts/13) /etc 115 -> co -d group master.passwd

cd /etc

rcsdiff -wu master.passwd group>/dev/null | less

pwd_mkdb -p /etc /etc/master.passwd
newaliases

Update files in /etc:

cd /etc
rcsdiff -wu RCS/* 2>/dev/null | less

Fix any conflicts, in particular /etc/group and /etc/master.passwd. If you change /etc/master.passwd, note that you'll have to regenerate /etc/passwd after rebooting to the new system.

Check out any files missing in /etc:

rcsdiff -wu RCS/* 2>&1 >/dev/null | grep "No such file"|sed 's/rcsdiff:/co -M /; s/:.*//'|sh

For each file, decide what to do.

XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX

Create a new partition on a new disk and install the latest and greatest version on it:

export DESTDIR=/destdir cd /src/FreeBSD/svn/stable/8 nice make -j 4 world nice make -j 4 distribution nice make -j 4 kernel KERNCONF=DEREEL mount -t devfs devfs $DESTDIR/dev
Boot from new system.
Create /etc/resolv.conf:

domain lemis.com nameserver 192.109.197.135
Update /etc/fstab:

dereel:/src /src nfs rw 0 0 dereel:/ /dereel nfs rw 0 0 dereel:/home /home nfs rw 0 0 /dev/cd0 /cdrom cd9660 ro,noauto 0 0
Mount NFS file systems:

mkdir /dereel /src /home mount -t nfs -a
Build ports:

ln -s /src/Sysconfig/dereel /home/Sysconfig cd /home/Sysconfig/scripts make ports-fetch

This target fetches all the ports, one after the other. It doesn't stop if one fails, so you might still run into trouble later

make ports-config

This target does configuration. Maybe it should run before ports-fetch, but I'm not sure that works. It's painful, and it changes all the time. Here a couple of things to look out for:
- gimp doesn't install the documentation (gimp-help) by default. Set it. That's not enough: you then need to tell the braindead gimp-help port that you don't want every language under the sun (total download size about 600 MB). Instead,
  
  # cd /usr/ports/graphics/gimp-help # make config
  
  Select the languages you want.
make ports-try make ports

ports-try tries to build the ports and continues if one fails. ports goes through again and stops on any errors. Ideally it should do nothing.

Install most of the RCS files. Ensure that the RCS files are checked in on the old system:

	    /home/Sysconfig/scripts/ciRCS      check in RCS files (on old system)

Then, on the new system, first move some writeable installed files out of the way:

	    cd /usr/local/etc/postfix
	    mv master.cf master.cf.orig
	    mv main.cf main.cf.orig
	    mv /usr/local/etc/apache22/httpd.conf /usr/local/etc/apache22/httpd.conf.orig 
	    mv /usr/local/share/emacs/site-lisp/subdirs.el /usr/local/share/emacs/site-lisp/subdirs.el.orig
	    mv /usr/local/share/ispell/american.hash /usr/local/share/ispell/american.hash.orig

Then check out:

	    /home/Sysconfig/scripts/installRCS -f create new RCS hierarchy
	    cd /root
	    mv .profile .profile-old
	    /home/Sysconfig/scripts/coRCS 2>&1 > /tmp/colog         and check them out
	    cd /usr
	    /home/Sysconfig/scripts/coRCS 2>&1 >> /tmp/colog         and check them out

This looks good, but it seems that co writes error messages to /dev/tty.

Look through /tmp/colog and resolve any failures.
Update files in /etc:
```
	    cd /etc
	    rcsdiff -wu RCS/* 2>/dev/null | less
	  
```
Fix any conflicts, in particular /etc/group and /etc/master.passwd. If you change /etc/master.passwd, note that you'll have to regenerate /etc/passwd after rebooting to the new system.

Update databases:

	    pwd_mkdb -p /etc /etc/master.passwd
	    newaliases

Check out any files missing in /etc:

	    rcsdiff -wu RCS/* 2>&1 >/dev/null | grep "No such file"|sed 's/rcsdiff:/co -M /; s/:.*//'|sh

For each file, decide what to do.

This is a part of the new system HOWTO pages. It relates to upgrading an existing machine by installing a new system on a new disk. See the main page for other options. This is very much the way I do things, and certain aspects are not useful elsewhere.

Create a new partition on a new disk and install the latest and greatest version on it:

export DESTDIR=/destdir cd /src/FreeBSD/svn/stable/8 nice make -j 4 world nice make -j 4 distribution nice make -j 4 kernel KERNCONF=DEREEL mount -t devfs devfs $DESTDIR/dev
Meanwhile, install Ports Collection sources. /usr is on the root file system, and some ports use obscene amounts of disk space when building, so locate the ports collection on /home (say):

mkdir /src
mount dereel:/src /src
ln -s /src/CVS/FreeBSD/ncvs /home
export CVSROOT=/home/ncvs
mv /usr/ports /usr/ports.orig      # or remove them
mkdir /home/ports
cd /usr
ln -s /home/ports
cvs co ports
ln -s /src/FreeBSD/ports/distfiles /usr/ports

Boot from new system.
Create /etc/resolv.conf:

domain lemis.com nameserver 192.109.197.135
Update /etc/fstab:

dereel:/src /src nfs rw 0 0 dereel:/ /dereel nfs rw 0 0 dereel:/home /home nfs rw 0 0 /dev/cd0 /cdrom cd9660 ro,noauto 0 0
Mount NFS file systems:

mkdir /dereel /src /home mount -t nfs -a
Build ports:

ln -s /src/Sysconfig/dereel /home/Sysconfig cd /home/Sysconfig/scripts make ports-fetch

This target fetches all the ports, one after the other. It doesn't stop if one fails, so you might still run into trouble later

make ports-config

This target does configuration. Maybe it should run before ports-fetch, but I'm not sure that works. It's painful, and it changes all the time. Here a couple of things to look out for:
- gimp doesn't install the documentation (gimp-help) by default. Set it. That's not enough: you then need to tell the braindead gimp-help port that you don't want every language under the sun (total download size about 600 MB). Instead,
  
  # cd /usr/ports/graphics/gimp-help # make config
  
  Select the languages you want.
make ports-try make ports

ports-try tries to build the ports and continues if one fails. ports goes through again and stops on any errors. Ideally it should do nothing.

Install most of the RCS files. Ensure that the RCS files are checked in on the old system:

/home/Sysconfig/scripts/ciRCS      check in RCS files (on old system)

Then, on the new system, first move some writeable installed files out of the way:

cd /usr/local/etc/postfix
mv master.cf master.cf.orig
mv main.cf main.cf.orig
mv /usr/local/etc/apache22/httpd.conf /usr/local/etc/apache22/httpd.conf.orig 
mv /usr/local/share/emacs/site-lisp/subdirs.el /usr/local/share/emacs/site-lisp/subdirs.el.orig
mv /usr/local/share/ispell/american.hash /usr/local/share/ispell/american.hash.orig

Then check out:

/home/Sysconfig/scripts/installRCS -f create new RCS hierarchy
cd /root
mv .profile .profile-old
/home/Sysconfig/scripts/coRCS 2>&1 > /tmp/colog         and check them out
cd /usr
/home/Sysconfig/scripts/coRCS 2>&1 >> /tmp/colog         and check them out

This looks good, but it seems that co writes error messages to /dev/tty.

Look through /tmp/colog and resolve any failures.
Update files in /etc:
```
cd /etc
rcsdiff -wu RCS/* 2>/dev/null | less
```
Fix any conflicts, in particular /etc/group and /etc/master.passwd. If you change /etc/master.passwd, note that you'll have to regenerate /etc/passwd after rebooting to the new system.

Update databases:

pwd_mkdb -p /etc /etc/master.passwd
newaliases

Check out any files missing in /etc:

rcsdiff -wu RCS/* 2>&1 >/dev/null | grep "No such file"|sed 's/rcsdiff:/co -M /; s/:.*//'|sh

For each file, decide what to do.