I'd recommend a chemistry set but unfortunately many modern chemistry sets contain little more than colored water. (This is only partially hyperbole.)

Many do. Some are significantly better. Look for reviews. About the only type of chemistry that's going to be available in those sets is single substitution (color change) reactions, but it was a fun start for me at that age.