The palace was surrounded by landscaped grounds or policies, with terraced walks and gardens surrounded by a wall with round corner towers. The wall still survives at Seton Castle, the mansion built on the site of the palace. The wall was largely the work of George, 4th Lord Seton, but completed by his son, also George.
It so happened that on 5th April 1603, after James VI had set out his leisurely journey to claim the English crown when he reached Seton Palace he was met by the funeral procession of George Seton, 1st Earl of Winton. James instructed his retinue to halt and sat up on the garden wall to watch the cortege pass by.