Here's the problem in California;
Law section
The way the law is written if you fly pretty much anywhere that has private property within sight of your aircraft some neighboring yo-yo has the potential to generate a lot of grief for pretty much any reason if they saw your aircraft while in flight. The way the law is written there's probable cause for further action if the aircraft has any type of recording device on it. In fact, the law has a clause that pretty much states you could be found in violation of you recorded nothing at all. Law enforcement and government is of course exempt from this law. As things now stand, if you point a camera at pretty much anything that's not owned by your there could be a violation of California's paparazzi law or CA Civil Code 1708.8. Should someone be violated under this law it's highly probable it would be found in conflict with federal airspace regulations and controls but who needs to be paying attorney fees to establish precedent? Brendan Schulman doesn't do pro bono work for drone operators any more...
Best advice I have would be to notify the neighbors, especially those in the higher end side of the tracks, and obtain permission. A forward thinking individual would obtain a photographers release for property and persons in the process to back stop people that change their mind after you take off. If nothing else, and although it may not be legal, put your phone on voice memos and forget to turn it off during conversations. If you're shooting real estate stuff releases and notifications are virtually mandatory prior to every shoot. The people that own the property being shot own the rights to the display of their property so you want things very clear with them, along with approval of the neighbors. If some real estate agent does something wrong in the promotion and sale of the property and a real estate attorney gets dragged in for something you had nothing to do with later you'll have a written record of what you did and an owner's release to protect you from any bad sale after effects. You also want to retain copyrights for your work in order to use it for business advertising later. This stuff is plainly stated in photographers release forms, which you can obtain for free as Word templates via your favorite search engine.
Yea, it's all a pain in the a$$, but that's California in general over the past 15 years or so.