Neighbors kids starting fires?

We live in very close proximity to a man who has his 2 boys (5 and 8) on the weekends. Last weekend we had to get the father because they were 5 feet from our house with a fire going, swinging a stick through it and tossing embers dangerously close to our roof and the 5 year old was going to throw a gas can on it! The fathers first reaction when my husband went to his door was "oh, they don't have any gas" Later that day another neighbor called the police because they were on there property (a block away) breaking gl jars. They hid from the police but when they were caught, they also had knives in their pockets. Now again this weekend I saw them with a lighter and matches 2 times and they showed my daughter that they had started a car on fire but the 5 year old put it out. We have told our children (and the boys) that they are not allowed over here and our kids cannot play with them anymore. The neighbor told me that CPS is going to be involved because of the police incident. What more can I do? Weekends are supposed to be relaxing but I spend mine in fear of what these kids will do next. The father is physically disabled and walks with a cane. He sends the boys outside and doesn't worry about what they are up to!