I see the downsides. But I also see the delivery vans in my neighborhood that are always double parking and blocking traffic. At least in the air, traffic can be routed in 3d.
Just as the delivery vans participate with local police through FLOC, so will the drones, soon. Remember, if it can be seen from a public vantage point, it's not private, including what can be seen through windows and behind fences.