So far, I haven't had any problems with neighbors, HOA or city yet. As long as I'm quiet at night and keep it relatively unnoticeable or put any massive piles of junk or a car back there, no one cares. It does help having a solid wood fence to hide stuff behind.
I was going to suggest a privacy fence, I imagine from hearing the description that the "stuff" can be seen thru his fence.