I would very much doubt you'd get into trouble. Presuming school's not in session and it's not marked as a school I'd think you'd be in the clear.
I'd definitely check your state laws, but it seems unlikely that there would be an issue. Of course the law doesn't always follow common sense.
si vis pacem para bellum