Of the more than 50 million foreign visitors to the U.S. in 2016, more than 620,000 of them have overstayed their visas, according to a new report from the Department of Homeland Security.

The report also found that Immigration and Customs Enforcement arrests for overstayed visas are on the rise. Those arrests include 450 suspects arrested in the Baltimore area through President Donald Trump's first 100 days. That's more than 100 more arrests than the same time period in 2016.

Nationally, immigration enforcement and removal operations are up 40 percent.

"It's not surprising to me that we see those increased numbers. It's incredibly sad for the community, and it's something we need to fight against," said Nick Katz, senior manager of legal services at the Latino advocacy group CASA.

ICE officials said their homeland security investigations team looks at about a million records each year of people who violate the terms of their visas or visa waiver programs.

Also as part of the president's recently proposed budget, $314 million is proposed to recruit and hire more border patrol agents and 1,000 new ICE law enforcement personnel in 2018. It also proposes $1.5 billion for expanded detention, transportation and removal of illegal immigrants, which means the increased numbers seen in the Baltimore area could get even higher.

"The idea that we need to increase immigration enforcement at this time is exactly the opposite of what needs to happen," Katz said.

Currently, the numbers are just proposals. In Maryland, the Department of Public Safety and Correctional Services said that until the budget gets final approval through Congress, they're unsure how the proposals will affect the many people with immigration detainers in facilities across the state.