(NECN: Lauren Collins, Dennis, Mass.) - The lobster rolls at the Sesuit Harbor Cafe in Dennis, Mass. are sweet and the views are even sweeter.

"So quintessential Cape Cod, and I think that's what everybody likes about this place," says Dennis summer resident Myrna Estes.

But with a lot of business comes a lot of traffic - too much for some residents of this beachside neighborhood.

"There is enormous congestion, traffic, safety problems," says attorney Bill Henchy who represents the homeowners.

But Joe Buscone, who owns the property in challenge, says "there's always an issue about the traffic but that's what Cape Cod is and Dennis is one of the most beautiful communities."

The Sesuit Harbor Cafe, it's dinner cruise business The Lobster Roll, and the Northside Marina were all here before the area was zoned and when the lines were drawn in 1973, all of the businesses fell into a residential area. They have since expanded and the small group of neighbors challenging them says they're out of bounds.

"We've pulled every permit that we've needed to and they believe that because of our zoning situation that they're able to challenge what we do," says JC Cuchetti, owner of the Cafe.

But Henchy says it's simple, "we just want the rules that apply to all of my clients to be enforced to the businesses in the area so that we can restore the harmony in the neighborhood and the reasonable balance of what existed before these unwarranted expansions took place."

The town building commissioner did a site visit in response to the homeowners' complaints and did find "there may have been unpermitted expansions of the original lawfully pre-existing nonconforming uses.." He ordered the restaurant to remove a number of tables and told the property owners they can't hold special events like weddings on site.

But he also found that many of the complaints fall into an unenforceable zoning grey area.

In the end, this dispute will likely be settled by the town with new zoning rules.

Estes agrees that would be the best route. "Something should be worked out so that both sides are happy, but that this stays as it is."