I'm looking for an image or package that I can put on an USB stick, that
contains Apache, MySQL and PHP for Linux.
I would like to be able to put the stick in any Linux PC and be able to
start the webserver there.

This so I do not need to install this on every PC.

Can anyone help me with this?
I have a Zonbu box (
http://www.zonbu.com/shop/product.php?productid=28&cat=2&page=1 ) with
automatic updates, so I do not want any updates to interfear with my USB and
visa versa.

Since it's a low power box, it's seems perfect to me to run my little
websites on (now on a windows XP, AMP XP 2000+ PC that uses a lot more
energy).