Residents in posh town plagued by invading geese from nearby beauty spot