It became the ancestral seat of the Erskine family, the Earls of Mar and Kellie. This family have played a pivotal part in Scotland's history through the centuries and were loyal supporters of the Stuart monarchs. Mary, Queen of Scots and her son, James VI. Both spent part of their childhood here under the guardianship of the Erskine family. Alloa Tower was lavishly updated by John Erskine, 6th Earl of Mar, who created an 18th-century mansion within the ancient walls.