If you live in this town long enough, you hear everything.

But it’s taken me my entire life to learn about Westport’s boxing club, Kid Gloves. And one of the men who trained there: Floyd Patterson, heavyweight champion of the world.

The story comes thanks to alert “06880” reader Franklin Mason. A 1960 Staples High School graduate who earned a Ph.D. in chemistry, taught college for 10 years and then became a technical writer in Silicon Valley, he emailed me recently with this fascinating tale.

Franklin Mason: 1960 and 2010.

Mason sent news clippings and photos too. There is no hook or angle to this; no upcoming title fight, demolition of the boxing club building or anything else. It’s simply a fascinating tale, about a long-buried part of Westport’s past.

In 1958, a few prominent Westporters started an after-school gym. The focus was on boxing and body-building. (There were also “figure control classes” for ladies.)

Seven years earlier, the group had helped start Westport Little League. Now they were doing something else for boys in town.

Kid Gloves was located in Nash’s Barn, at the head of Nash’s Pond on Kings Highway North. Built before the Revolutionary War, in the early 1940s it had been converted into a theater. Then it was a dance studio, with a hardwood floor.

Nash’s Barn, 1952.

The building no longer exists. It’s been replaced by a handsome private home — the one owned by singer Michael Bolton.

But in 1958 it hummed with activity. Jim Freeman — a boxer in the 1928 Olympics, World War II pilot and boxing referee, manager and promoter — served as Kid Gloves’ director and “heart,” Mason says.

He should know. Though just 16, scrawny and out of shape, his neighbor Virginia Mercier — Kid Gloves’ office manager — hired him as an instructor.

Freeman taught Mason how to teach the boys how to work out — including 14-year-old Westporter Michael Douglas. One day, his father — Kirk — came to visit. He strapped on gloves, and sparred with his son.

The actor knew what he was doing: In 1949 he’d starred in “Champion,” a boxing movie (based on a short story by Weston’s Ring Lardner).

Other young boxers at Kid Gloves included Daniel, Max and Peter Shulman. Their father, Max Shulman, wrote “Rally Round the Flag, Boys!” about the Westport Nike missile site. In 1958 it was made into a film starring Paul Newman. Soon he and his wife, Joanne Woodward, moved here.

Westport Town Crier ad, October 16, 1958.

In 1959, Floyd Patterson needed a spot to train for his rematch against Ingemar Johansson — the man who had recently taken the world heavyweight title from him.

He wanted a place with “peace and quiet.” A special, regulation-sized ring was ordered. Patterson’s smaller-than-usual speed bag was sent too.

Patterson arrived with his manager Cus D’Amato, and sparring partner Tommy “Hurricane” Jackson. Jackson spent several nights at Mason’s home.

Floyd Patterson, on the speed bag.

Ed Mitchell’s oldest son, Jack, was a football player at Wesleyan University. That summer, to get in shape for the upcoming season, he ran around the track at the old Staples High School on Riverside Avenue (now Saugatuck Elementary School). His younger brother Bill was with him.

D’Amato saw Jack, and asked if he wanted to work out at the gym. He brought the Mitchells across the Post Road. There was Floyd Patterson. They did some pullups and other exercises together.

Patterson asked Mitchell if he’d run on the track with him. “I was never a runner. He wasn’t either,” Mitchell recalls. “But we ran together.”

The brothers were told not to tell anyone that Patterson was there. They kept quiet.

But word got out. When it did, the Westport Town Crier ran this headline: “Boxing Gangsters Invade Westport.”

That was a reference to D’Amato’s alleged association with organized crime. When Patterson saw the headline, he left for another training facility, in Newtown.

Lou Dorsey and Franklin Mason, 1954

Freeman soon left also. But Kid Gloves added staff members. Lou Dorsey — a popular Saugatuck Elementary School phys. ed. instructor — took over as boxing coach. Derek Shelton taught dance to all ages; Edwardo Enrich was a judo instructor for boys and adults.

One of the dance students was Amy Vanderbilt — the famous etiquette expert. One day, waiting for a friend outside the building, Mason honked his horn. She rushed out, and reprimanded him. Sixty years later, he says, he still remembers — and has never done that again.

But Freeman’s departure was crucial. In January of 1960, Kid Gloves was sold. New owner Anthony Iannone of Stratford renamed it “Anthony’s Health Center & Gym.”

By that time Freeman could easily do sit-ups and chin-ups. He was adept on the free rings and trapeze.

Bridgeport Post ad, January 3, 1960.

In June of that year, Floyd Patterson knocked out Ingemar Johansson. For the first time ever, a boxer had regained the world heavyweight title.

Four months later, Anthony’s went out of business.