urban survival

Aside from obtaining water in stores and such where it would probably be crowded, I only would have enough water to last a day, when generally get home situations can span three days. My question is, because I live in a dense urban sprawl, where can I find water to refill my pack in an emergency...