Here's my experience with some of the wildlife that we have
Turkeys
The turkeys cause no problems whatsoever. They will walk right through the layout area but they've never stayed around it very long. Never caused any damage either. So I wouldn't worry about turkeys.
Deer
We have lots of mule deer around our area. But they are pretty timid. Interestingly the females seem much more timid then the males. I can walk pretty close to a male deer before he runs away. The deer will sometimes walk through the train layout area. But again I've never noticed any damage caused by deer.
What I have noticed is that they will typically walk around the layout if all of the buildings, rolling stock, etc.. are out on the layout. If some items are missing, meaning there is a really large section of open ground, the deer are more likely to walk there. So I guess they are either afraid of the train stuff or they don't like obstacles in their way.
Elk
These troublesome guys are the only wildlife to actually damage the layout thus far. They are huge too. Part of the problem is they come down during the winter time. That's when there is nothing out at the layout except the track. So not much to scare them away. And the whole area is usually covered by snow. So it's hard to tell there is even anything under the snow. After the melt I look to see if any track sections have been trampled. But thankfully its pretty rare when this happens.
Bear
We've had the occasional black bear roam through the property. They never stick around long, but I have seen one walk near the layout. Didn't cause any damage though.
Chipmunks and Ground Squirrels
These are the most visible since they come out during the daytime. But other than sometimes scampering around the layout, they don't cause any harm.
Packrats
Of all the wild life we have, these guys are the worst. If I forget to put figures or other small items away at night, they will likely be moved or gone the next day. There is not much you can do to prevent them coming either. I make it a point to never have food around the layout to keep critters away, but the packrats still come around looking for toys. Spring rat traps work to some extent, but tiny deer mice can sometimes trigger these larger rat traps without getting caught. Live traps also work, but packrats are very tricky to catch in traps. The funny thing is, packrats are dang cute.
Racoons
They always seem to be looking for food. So if we keep food away from the layout, they stay away.
I'd guess our layout is in as wild a setting as you'll likely see. Our property borders the San Juan National Forrest and we're at 8000' elevation. So I expect wildlife. And that is part of the fun living in the woods.
In this view from the cabin, the only evidence of humans is our flagpole. And that's the way we like it: