Anyone think buying homes in rough areas and renting them out is a good idea?

You would want to rent the house to a good tenant. A good tenant is less likely to rent a house in a rough area. Most likely, your rental house will either be rented to people living a rough life and don't pay rents, or it will sit on the market for long time.