If you don't let me go, I won't leave. Now normally that would be a really stupid argument, but I think in this case we can both agree that it'd be best if I do.
People don't show up at 3AM because someone moved in and they threw a fit. That's like an 8PM activity at the latest.