I don't know about United States Laws, but here in Canada we have what is called a Tenancy board to help protect tenants from sleezball landlords. I would check with your local gov't agency to see if there is a tenancy board in your State and what your rights are as a tenant.

I wouldn't voluntarily leave until you have had a chance to consult with a lawyer or representative from the tenancy board.