Annotation of src/UPDATING, Revision 1.175

1.175 ! simonb 1: $NetBSD: UPDATING,v 1.174 2008/07/23 00:29:35 lukem Exp $
1.1 abs 2:
1.123 jmc 3: This file (UPDATING) is intended to be a brief reference to recent
4: changes that might cause problems in the build process, and a guide for
5: what to do if something doesn't work.
1.1 abs 6:
1.123 jmc 7: For a more detailed description of the recommended way to build NetBSD
8: using build.sh, see the BUILDING file.
9:
10: Note that much of the advice in this UPDATING file was written before
11: build.sh existed. Nevertheless, the advice here may be useful for
12: working around specific problems with build.sh.
13:
14: See also: BUILDING, build.sh, Makefile.
1.1 abs 15:
16: Recent changes:
17: ^^^^^^^^^^^^^^^
1.138 lukem 18:
1.175 ! simonb 19: 20080731:
! 20: WAPBL (metadata journaling support) has been added, but at this
! 21: time isn't backwards compatible with pre-WAPBL aware kernels
! 22: and userland (fsck_ffs in particular). Please make sure you
! 23: don't use a journaled filesystem with an older kernel/userland,
! 24: especially an uncleanly mounted journaled filesystem.
! 25:
1.174 lukem 26: 20080721:
27: Assembler warnings are now fatal if $WARNS>0 and $NOGCCERROR
28: isn't defined.
29:
1.173 freza 30: 20080531:
31: The ioctl number of DRVSUSPENDDEV command on /dev/drvctl changed
32: from 125 (conflicted with DRVCTLCOMMAND) to 129. The drvctl(8)
33: utility needs to be rebuilt and reinstalled as older binaries
34: won't work correctly. The following sequence of commands:
35:
36: $ (cd sys/sys/ && nbmake-$arch includes)
37: $ (cd sbin/drvctl/ && nbmake-$arch clean)
38: $ (cd sbin/drvctl/ && nbmake-$arch all)
39:
40: leaves new drvctl utility in sbin/drvctl build directory.
41:
1.172 lukem 42: 20080503:
43: The <bsd.lib.mk> variable MKPRIVATELIB was renamed to LIBISPRIVATE.
44:
1.171 he 45: 20080521:
46: For a while, unprivileged UPDATE builds would fail to
47: succeed at the checkflist stage, complaining that
48: ${DESTDIR}/stand/<arch>/ did not exist. A fix for this
49: problem was committed to share/mk/bsd.kmodule.mk, revision 1.9.
50: If you already hit this problem, update the .mk file,
51: remove ${DESTDIR}/stand/<arch>, and re-run the build.
52:
1.174 lukem 53: 20080303:
54: Linker warnings are now fatal if $WARNS>0.
55:
1.170 christos 56: 20080126:
57: The posix_fadvise system call has been changed from an assembly
58: stub, to a c file that calls an assembly stub. You need to
59: 'rm -f posix_fadvise.* .depend' in the libc build directory to
60: avoid using the old assembly stub.
61:
1.168 joerg 62: 20071209:
63: The acpiec(4) driver has been split into two attachments. If you
64: get ACPI errors before the attachment, please update your kernel
1.169 wiz 65: configuration file appropriately or see GENERIC for more details.
1.168 joerg 66:
1.166 xtraeme 67: 20071115:
68: The it(4) driver has been renamed to itesio(4) and the old port
69: argument specified in the kernel configuration file is not valid
70: anymore. The itesio(4) driver now uses the Super I/O address port
71: rather than the EC address port. Please update your kernel
1.167 wiz 72: configuration file appropriately or see GENERIC for more details.
1.166 xtraeme 73:
1.165 jmmv 74: 20071028:
75: The pccons(4) driver has been removed from the NetBSD/shark port.
76: You need to update any custom kernel configuration file you have
77: to remove any references to pccons (which includes removing the
78: now useless XSERVER option) and replace them with the correct
79: entries for the wscons driver. See the GENERIC configuration file
80: for more details.
81:
1.164 gdt 82: 20070913:
83: A latent bug in dhclient/dhcpd that caused it to be unable to
84: enumerate interfaces was fixed. The bug began to cause
85: problems after 20070911 when the kernel's SIOCGIFCONF
86: implementation was repaired. From 20070529 to 20070911 racoon
87: could not enumerate interfaces. (These are noted because
88: normal kernel/userspace version matching hygiene is not
89: sufficient to avoid this problem.) Ensure that both kernel
90: and userland are from after 20070913.
91:
1.163 joerg 92: 20070703:
93: nbinstall has been renamed as it calls the target specific and
94: the logic to pass down STRIP from mk been removed. This forces
95: a re-installation of tools.
96:
1.161 dsl 97: 20070422:
98: The way OS emulations lookup filenames inside the emulation root
99: has been changed. Rather than modify the pathname (and copy back
100: to userspace) namei() and lookup() directly check the emulation
101: root. One side effect is that absolute symlinks inside the emulated
1.167 wiz 102: root file system will be relative to that file system - unless they
1.161 dsl 103: start /../ this is useful when the emulated root is a real install
104: that has such links.
105: This might affect symlinks that have been added to reference outside
106: the emulated root.
107:
1.160 jmcneill 108: 20070412:
109: The pckbc driver on sgimips IP32 has been removed. Use macekbc
110: instead. See the GENERIC32_IP3x kernel configuration for an
111: example.
112:
1.159 gdt 113: 20070319:
114: src/lib/libc/Makefile revision 1.129 broke libc and ld.elf_so
115: on many platforms due to incorrect flags settings. If you
116: updated and built after about 20070315, do "nbmake-$arch
117: cleandir" in src/lib/libc and src/libexec/ld.elf_so to force a
118: rebuild of object files that might have been built
119: incorrectly, and ensure that you have at least
120: src/lib/libc/Makefile 1.130.
121:
1.158 dbj 122: 20070210:
123: src/sys/sys/{sa.h,savar.h} were removed.
124: find ${OBJDIR} \( -name .depend -o -name '*.d' \) -print \
125: | xargs egrep -l '/sa.h|/savar.h' | xargs rm
126: will allow dependencies on those files to get get rebuilt
127:
1.157 apb 128: 20070209:
129: The threading model was changed when the newlock2 branch
130: was merged to NetBSD-current. If you boot with a new
131: kernel (version 4.99.10), then you also need a new pthread
132: library (/usr/lib/libpthread.so.0.7). If you boot with
133: an old kernel, then you need the old pthread library
134: (/usr/lib/libpthread.so.0.6). Provided you keep the kernel and
135: the pthread library in sync, old threaded applications should
136: continue to work with an old or new kernel. Note that named(8)
137: is the only threaded application in the base system.
138:
1.154 he 139: 20061214:
140: Following the move of string_to_flags() and flags_to_string()
141: from the bin/ls/ sources to libutil, users doing UPDATE builds
142: will need to do a "make cleandir" in
143: tools/mtree/, tools/makefs/, tools/binstall/, tools/pax/,
144: bin/pax/, bin/ls/, usr.sbin/mtree/, usr.sbin/makefs/,
1.156 he 145: usr.bin/xinstall/, libexec/ftpd/, rescue/, as well
146: as the installation images in distrib/
1.154 he 147: in order to excise stale references to the old stat_flags.h header
148: file in the ls sources -- stat_flags.h has been removed.
149:
1.152 christos 150: 20061108:
151: The configure script used in the src/tools/gcc compiler has been
152: changed to indicate that our libc has ssp support built-in and
153: does not depend on -lssp and -lssp-nonshared. You'll need to
154: make clean in src/tools/gcc first to rebuild the compiler.
155:
1.151 rpaulo 156: 20061009:
157: The sysctl variables net.inet{,6}.tcp{,6}.newreno are no longer
158: available. Use net.inet{,6}.tcp{,6}.congctl.selected instead.
159:
1.150 bjh21 160: 20060814:
161: The vt, vidcconsole, kbd, and rpckbd drivers on acorn32 have been
162: withdrawn. Use vidcvideo and pckbd instead. See the GENERIC
163: kernel configuration for an example. X servers from the last
164: few years should cope.
165:
1.149 christos 166: 20060703:
167: MPACPI is no more. We always configure PCI interrupts using ACPI
168: if we have an ACPI kernel. The option MPACPI_SCANPCI has been renamed
169: to ACPI_SCANPCI. Thanks to work from fvdl.
170:
1.148 dogcow 171: 20060627:
172: socket(2) has changed, and its system call has been versioned.
173: For userlands with the old version of socket(2), make sure that
174: your kernel has 'options COMPAT_30' set, or else 'bad system call'
175: errors will result.
176:
1.1 abs 177: Hints for a more successful build:
178: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
1.123 jmc 179: Use build.sh, but do not use its "expert mode":
1.132 jmmv 180: This will automatically build the tools in the
1.123 jmc 181: correct order, and it will keep the tools and the
182: new build products from interfering with the running
183: system. This will allow you to ignore most of the
184: other advice in this file.
1.2 mrg 185: Build a new kernel first:
186: This makes sure that any new system calls or features
187: expected by the new userland will be present. This
188: helps to avoid critical errors when upgrading.
1.1 abs 189: Use object directories:
190: This helps to keep stale object
191: files from polluting the build if a Makefile "forgets"
192: about one. It also makes it easier to clean up after
193: a build. It's also necessary if you want to use the
194: same source tree for multiple machines.
1.123 jmc 195: To use object directories with build.sh:
196: a) invoke build.sh with the "-M" or "-O" options.
197: To use object directories without using build.sh:
1.1 abs 198: a) cd /usr/src ; make cleandir
1.2 mrg 199: b) Add "OBJMACHINE=yes" to /etc/mk.conf
200: c) Add "MKOBJDIRS=yes" to /etc/mk.conf
1.1 abs 201: d) cd /usr/src ; make build
1.2 mrg 202: Note that running "make obj" in a directory will create
203: in obj.$MACHINE directory.
1.1 abs 204: Build to a DESTDIR:
1.123 jmc 205: This helps to keep old installed files (especially libraries)
206: from interfering with the new build.
207: To build to a DESTDIR with build.sh, use the "-D" option.
208: To build to a DESTDIR without using build.sh, set the DESTDIR
209: environment variable before running make build. It should be
210: set to the pathname of an initially empty directory.
211: Problems: if you do not use build.sh, you might need to
212: update critical utilities without using DESTDIR since
213: nothing is executed from what is installed in DESTDIR.
214: (See critical utils, below.)
1.1 abs 215: Build often:
216: This keeps critical utilities current enough to not choke
217: on any other part of the source tree that depends on up to
1.123 jmc 218: date functionality. If you use build.sh, you should not have
219: this problem.
1.1 abs 220:
221: What to do if things don't work:
222: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
223: When things don't work there is usually a few things that commonly
224: should be done.
225: 1) make includes
226: This should be done automatically by make build.
227: 2) cd share/mk && make install
228: Again, automatically done by make build.
229:
230: Failsafe rebuild of a small part of the tree:
231: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
232: To make sure you rebuild something correctly you want to do
233: something like the following:
234: 1) Make sure the includes and .mk files are up to date.
235: 2) Make sure any program used to build the particular
236: utility is up to date. (yacc, lex, etc...)
237: 3) cd ...path/to/util...
238: make cleandir
239: rm ...all obj directories...
240: make cleandir # yes, again
241: make obj
242: make depend && make
243:
244: Failsafe rebuild of the entire tree:
245: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
246: If you really want to make sure the source tree is clean and
1.2 mrg 247: ready for a build try the following. Note that sourcing /etc/mk.conf
248: (a make(1) Makefile) in this manner is not right, and will not work
249: for anyone who uses any make(1) features in /etc/mk.conf.
1.1 abs 250:
251: ---cut here---
252: #!/bin/sh
253: . /etc/mk.conf
254:
1.58 lukem 255: if [ -z $NETBSDSRCDIR ] ; then
256: NETBSDSRCDIR=/usr/src
1.1 abs 257: fi
1.58 lukem 258: if [ \! -d $NETBSDSRCDIR ] ; then
1.1 abs 259: echo Unable to find sources
260: exit 1
261: fi
1.58 lukem 262: find $NETBSDSRCDIR -name \*.o -o -name obj.\* -o -name obj -exec rm \{\} \;
1.1 abs 263:
264: if [ -z $BSDOBJDIR ] ; then
265: BSDOBJDIR=/usr/obj
266: fi
267: if [ -d $BSDOBJDIR ] ; then
268: rm -rf $BSDOBJDIR
269: fi
270:
1.58 lukem 271: cd $NETBSDSRCDIR && make cleandir
1.1 abs 272:
273: ---cut here---
274:
275: Critical utilities:
276: ^^^^^^^^^^^^^^^^^^^
1.3 itojun 277: usr.bin/compile_et
1.1 abs 278: usr.bin/make
279: usr.bin/yacc
280: usr.bin/lex
1.11 lukem 281: usr.bin/xlint
1.142 drochner 282: usr.bin/config
1.1 abs 283:
1.34 simonb 284: Other problems and possible solutions:
1.1 abs 285: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
286: Symptom:Complaints involving a Makefile.
1.17 erh 287: Fix: Rebuild usr.bin/make:
288: cd usr.bin/make && make && make install
1.111 simonb 289: Or, a failsafe method if that doesn't work:
1.17 erh 290: cd usr.bin/make && cc *.c */*.c -I . -o make && mv make /usr/bin
291:
1.1 abs 292: Fix: Make sure .mk files are up to date.
293: cd share/mk && make install
1.2 mrg 294:
295: Symptom:Kernel `config' fails to configure any kernel, including GENERIC.
1.142 drochner 296: Fix: Rebuild usr.bin/config
1.1 abs 297:
298: Symptom:
299: Fix: Rebuild usr.bin/yacc
300:
301: Symptom:
302: Fix: Rebuild usr.bin/lex
303:
304: Symptom:
305: Fix: rm /usr/lib/libbfd.a
1.4 itojun 306:
307: Symptom:Obsolete intermediate files are used during compilation
308: Fix: Try the following sequence of commands in the directory in question.
309: make cleandir; rm `make print-objdir`; make cleandir; make obj
310: (If you built the tree without "make obj" in the past, obsolete files
311: may remain. The command tries to clean everything up)
1.5 wiz 312:
313: Symptom:.../sysinst/run.c:xx: warning: initialization from incompatible pointer type
314: Fix: Rebuild and install usr.bin/menuc
1.12 itojun 315:
316: Symptom:mklocale not found during build in share/locale/ctype
317: Fix: Build and install usr.bin/mklocale
1.13 dogcow 318:
1.86 kleink 319: Symptom:undefined reference to `__assert13' or `__unsetenv13'
1.13 dogcow 320: Fix: Rebuild and install lib/libc
321:
1.142 drochner 322: Symptom:usr.bin/config fails to build.
1.19 cgd 323: Fix: Try building with -DMAKE_BOOTSTRAP added to CFLAGS in Makefile.
1.13 dogcow 324:
1.19 cgd 325: Symptom:undefined reference to `getprogname' or `setprogname'
326: Fix: Rebuild and install lib/libc
1.24 abs 327:
328: Symptom:lint does not understand the '-X' option
329: Fix: May need to build & install libs with NOLINT=1 before rebuilding lint