Apparently, some of the neighbors had called the cops before

But nothing ever came of it. Some of the information in the articles is pretty upsetting, so read at your own risk:

http://www.usatoday.com/story/news/nation/2013/05/07/missing-women-cleveland-brothers-arrested/2140359/

http://www.nytimes.com/2013/05/08/us/cleveland-kidnapping.html