I used to love this series of books when I was a child. Also in the series were books on Paris, New York, and San Francisco – possibly more.

Which I think means Blue – the colour of underwater/under the sea.