The Earl's Palace in Birsay is a ruined 16th-century castle. It was built by Robert Stewart, 1st Earl of Orkney (1533–1593), illegitimate son of King James V and his mistress Euphemia Elphinstone.