Gilbert was a well-known figure in the town and, in 1808, he became an elder of the beautiful St Mary’s church. Indeed, Agnes Burns, Rabbie’s mother, was buried alongside her son and her daughter Annabella in the parish kirkyard, within a railed enclosure, which still draws visitors to East Lothian today.