At Latitude in Suffolk this weekend, the threat of a sudden downpour has only heightened enjoyment of the long dry spells. This is a psychological truth that "festival dads", the indefatigable music fans who might be pushing 50 but refuse to hang up their wellies, instinctively understand. For them, the threat that one day the fun might end altogether makes them among the most ardent festival-goers around.

But as they approach middle age, has this generation of music-lovers outstayed its welcome? This weekend, they were more defiant than ever, following news that Radio 1 hopes to exclude festival dad listeners for good when DJ Chris Moyles leaves the morning show at the end of the summer. The BBC Trust argues that the station should appeal to 15- to 29-year-olds, yet the 7.10 million listeners who regularly tune in for Moyles's show are thought to include at least a million 45- to 54-year-olds.

"We have what I call 'festival dad' who refuses to grow up and will now take his family to hear new music at festivals," sniffed Ben Cooper, the 42-year-old BBC station controller.

At Latitude, the summer festival with perhaps the biggest festival dad contingent, male music fans of a certain age were indignant at the suggestion that new music, whether live or on the radio, is exclusively for the young. "I don't know who Nick Grimshaw is, but when I hear they call him Grimmy, I don't like him already," said Nathan Collins, a 35-year-old attending the festival with his daughter, Lily, aged four.

"I am a single festival dad, and I came mainly because I thought Lily would enjoy it, although I like the Alabama Shakes and am looking forward to seeing some comedy too."

Collins, who works in private equity, has just returned to England after living in Sydney, Australia.

"I have stopped listening to Radio 1, I admit, and my rocking is limited to late at night when the children are asleep, but if I am by myself I still behave like an 18-year-old."

Around 35,000 visitors are expected to visit Henham Park, near Southwold, to see headline acts including Bon Iver, Elbow, Paul Weller, Tim Minchin, Rufus Wainwright, Jack Dee and Lana Del Rey, while in nearby tents Mark Lamarr presents his God's Jukebox and Professor Brian Cox discusses the significance of the Higgs Boson particle. For Latitude organiser Melvin Benn, it is this mix of old and new entertainment, reflected in the audience, that makes the event work: "It is a unique festival that stands alone in terms of quality and depth. That is why it has developed such a name so quickly."

Wayne Barclay, 36, who lives in Leeds around the corner from Moyles's parents and runs an IT consultancy, says the festival is one of the few places that offers something for him and for his two young children. "This is the second time we have come along. We brought Ripley last year when he was three and he has talked about it ever since. He loves the atmosphere," said Barclay, breaking off to attend to six-month-old Junior, sleeping fitfully in a festival trolley beside him.

"And I do listen to Radio 1. I don't care what they say. I will carry on listening too, I expect."

Dan Pegg, a 39-year-old hedge fund manager from St Albans, admitted to revisting the pleasures of the festivals of his youth now he is a father of three. "I have left the wife at home sorting out a few things and come along with two of my kids, Isabelle and Bobby. I think taking kids to Glastonbury would probably be too hardcore."

Pegg, a Coldplay fan, was keen to see White Lies. "Yes, all the stereotypes. And I listen to XFM," he said.

Collins, too, felt that Latitude was a safer choice for children. "You are responsible when you have kids and I wouldn't want to take my daughter to Glastonbury. Having said that, I am already playing the game of guessing who is on what drug."

Recruitment executive Joe Neilson from Crouch End, north London, said he was proud to be at the top of the festival dad demographic at the age of 50. He had brought along his two sons, Fred, 10 and James, 13. After enjoying Lloyd Cole perform, "the second time around", he said he would be lining up for Simple Minds, too. "I saw them back in 1978. I will go to see Lana Del Rey too, though my wife says that is not for the music."

His son Fred said he is glad his father enjoys music because "it makes him be a bit silly sometimes". Neilson's friend, Pete Hilton, 48, confessed that he was a slightly reluctant festival dad. "It was my wife's idea to come along and to be honest, though I like the Eagles and Dire Straits, I don't listen to much music. I am enjoying it though."

Perhaps the most wholehearted festival fan at the site this weekend was also a full-time dad. Ben Fenemore, 33, gave up his work as a builder in Norwich when his wife had their son Michael four years ago. "I listen to BBC 6 Music, not Radio 1 and I am an Elbow fan," said Fenemore, who went to Reading last year. "This is my first time as a festival dad and Michael has tonsilitis so we had to go back home to the doctor earlier today and have only just got back inside again. I bought him an ice-cream and he has perked up now."

While Latitude largely appeals to middle-class families and is full of quilted jackets and cooler bags packed with Prosecco, other music festivals are available. Next month, former punks can take their children to see Public Image Ltd play at Beautiful Days in Devon, while those who like to chillax can try it with toddlers and Van Morrison at the Green Man Festival in Wales. So if the T-shirt still fits – and perhaps even if not – the festival dad will have the last laugh, even at his own expense. After all, being able to laugh at yourself is one advantage age can bestow.

Festival tribes

Well-heeled worthies Older couples and groups of affluent middle-aged professionals dressed in Gore-Tex or capacious pack-away macs and carrying shooting sticks. May sometimes wear tweed and appear to have strolled in from neighbouring farmland or taken an unexpected detour on a hike. Favourite festivals Cropredy, Cornbury

Grungy groupiesClad in vintage, faded festival garb, festooned with stains acquired at the Isle of Wight or Reading in days of yore and worn as badges of honour. Plenty of health foods, plenty of tie-dye, plenty of old-fashioned roll-upcigarettes.Favourite festivals Hop Farm, End of the Road

Camp glampersSporting pink T-shirts and panama hats, sitting next to top-of-the range tents and barbecues, and beside a car boot full of wine. Sometimes spotted crawling into a pre-furnished yurt.Favourite festivals Glastonbury, Womad

Fey waifs Skinny teenage girls with long, pre-Raphaelite tresses, decorated with floral garlands. More likely to hang around outside the poetry tent than to queue for the hog roast.Favourite festival Secret Garden Party

First Time RaversGangs of teenage boys covered in paint or wearing bright "morphsuits" and talking excitedly about getting "wasted". Likely to sing loudly all night or crash out under a tree. Always cross they forgot to pack enough Nurofen. Favourite festivals Reading and Leeds