It sounds like you have a great four acres! However, even in great habitat four acres will be a very small part of a deer’s home range. Couple that with wanting to attract deer during legal shooting hours (1/3 + – of the day) and the chances of success are slim.
Deer require food, cover, and water. Since you can’t establish a food plot it sounds as if your only option is a feeder. You can improve the native habitat, but simply don’t control enough acres to meet your objective of attracting mature bucks on a regular basis.
Given the surrounding land isn’t hunted you won’t be able to have the best cover in the neighborhood that deer don’t associate with danger.
Unless you are in a desert location, there’s probably plenty of water sources – again in areas that aren’t hunted.
Bottom line – you need to offer something that the deer want that’s not available elsewhere in their home range. Unless there are feeders on the neighboring property, that seems like the best option.