"Helping Hands for Homeownership Act of 2004"- Amends the Housing Opportunity Program Extension Act of 1996 to permit a homeowner under the sweat equity model program to perform required construction time on more than one dwelling.

Amends the Housing Act of 1949 to designate the (section 502) single family housing loan guarantee program of the Rural Housing Service as the Doug Bereuter Single Family Housing Loan Guarantee Program.