Finally made it to Crystal Palace Museum. It's quite small and only open a few hours a week (Sundays), but if you are visiting Crystal Palace Park on a Sunday it is worth a visit.Unfortunately they do not allow taking pictures or filming (why not is beyond me, but well.. ).
Run by volunteers, they are selling a series of booklets about different aspects of Crystal Palace and the World Fair. Nice way to support the project.