There are plenty of houses on farm land. Where do you think farmers live?
If you're buying land that was once farmed, it has probably been newly zoned for development, but you need to check on that with local government.
Depends on zoning. Some AG Zoning will only allow 1 house per 10 acres or 35 acres, etc...
You need to ask your local zoning dept in your county.
UK Answer, Usually No you cannot build on agricultural land without permission from your local Council.
UK
I hope so