In reality, the TV show is filmed at Highclere Castle which is in the South East of England in Hampshire, a few miles from Newbury. Some interior shots are also filmed at Ealing Studios in London.
Downton Abbey is fictitious.
It is filmed at Highclere Castle which is NOT in Scotland, but near Newbury in Berkshire about 65 miles from London and is open to the public. See their website. Take a train from London Paddington Station to Newbury (frequent) Then a taxi
www.highclerecastle.co.uk
www.firstgreatwestern.co.uk
There is no such place as Downton Abbey
It is not a real place, it is filmed in Scotland at Highclere Castle which is the home of the Earl and Countess of Carnarvon
http://www.highclerecastle.co.uk/
It is a fictional place. So this question has no answer.