The museum was founded in 1979 by the Goulandris Foundation since Andros is the birthplace of Vasilis Goulandris. Initially at the museum were exhibited works of an artist from Andros (Michali Tobrou) and works from the personal collection of Vasilis and Eliza Goulandris.
In 1986, a new wing was created presenting periodic exhibitions of important artists or specific periods of art.