Sounds like you did all right. I own my home so had the shadow been cast on my property I would have up armed to my ar or shotgun and confronted them. Confronting is not the ideal thing to do but I would be a bit upset about someone following me and attempting to break in. Knowing its a single male gives me confidence that I could handle it.
The police in your area suck BTW. You should complain. Hillsborough County Sheriffs Dept. is wonderful at responding to these type calls.