Doh! Forgot to unmount my CF card with a ext2 root file system when I rebooted, and forgot to fsck the filesystem before I remounted it. This lead to severe file system corruption. Got it fsck'ed but a lot of files where corrupted :-(
Have now switched to ext3 to prevent that to happen in the future!