I just found this project: http://www.linuxfromscratch.org/lfs/ Linux From Scratch is all about building your own linux. It is pretty much what I had in mind save the compiling part, but then again that is probably unavoidable if you are building your own.