Run for mayor (or local equivalent), win, and then push for/implement a bunch of rules that make the town inhospitable to tourists.
I assume the tourism brings in money to the local community, yeah? Cutting off that income will probably mean you won't be able to win the next subsequent election, so act fast.
PSA standard ("real") tennis balls are bad for dogs, especially their teeth.. https://sierraveterinary.com/2022/03/29/the-dangers-of-tennis-balls/