The number of prisoners over the age of 60 in jail in England and Wales has nearly doubled over the past decade to 3,577, according to the latest Ministry of Justice figures.

Prisoners over 60 are the fastest growing age group in the prison population. Official figures also show that as of 31 March this year there were 102 inmates over 80 serving sentences, including five over 90.

The recent jailing of high-profile celebrities for historic sex offences, including Rolf Harris and Stuart Hall, both aged 84, have highlighted this trend. In 2011 there were only 42 people aged 81 and over in prison. That figure appears to have more than doubled in the past three years.

Justice minister Shailesh Vara told MPs that over the last 10 years the number of prisoners aged 60 and over has grown each year. In 1994 there were 589 such prisoners in the prison system in England and Wales, but by 2004 the number had trebled to 1,839. The latest figures show that since then the number has nearly doubled again.

Older prisoners also form a growing proportion of the overall 85,000 strong prison population, accounting for just under 5% of all inmates.

The Prison Reform Trust (PRT) said that the increase is explained by a surge of prosecutions for historic offences rather than any unseen "elderly crime wave" or demographic changes.

"The increases are due to harsher sentencing policies, courts being more willing to order custodial sentences for breaches of bail and supervision orders, as well as imposing indeterminate sentences. In recent years, improvements in forensics have assisted a surge in retrospective prosecutions for more serious crimes," the PRT's most recent Bromley prison briefing said. More than 40% have been convicted of sex offences.

Attempts by the prison service to meet the needs of older prisoners has seen some newer jails adapted for their needs with more wheelchair ramps and special toilets and showers, but most prisons were built to house fit, young men.

"The national offender management service is working hard to ensure that prisons are equipped to meet the needs of this group, including through the commissioning of health and social care services."

The shadow justice secretary, Sadiq Khan, who secured the latest figures in a parliamentary written answer, said: "This data I've uncovered shows how the ageing of those behind bars is posing big challenges for the prison service. There is no evidence that the government is even aware of this as an issue let alone that they are remotely ready to address the challenges the increasing numbers of elderly prisoners pose," he said.

"The government is unable to solve the prison crisis they have created. Given how their policies have led to increased overcrowding in prisons and cuts in prison officers, it doesn't bode well for the future when more and more older prisoners will need greater amounts of support and supervision. The government needs a proper strategy on addressing the issue of an ageing prison population."

The PRT said recent research showed that older prisoners have a physiological age about 10 years older than their chronological age and that the psychological strains of prison life further accelerate the ageing process.