Try wiping with mineral spirits. It sounds like your finish wasn't fully dry. You may also have scratched the finish, especially fresh, with your brush.
But again, buffing with mineral spirits might shine it up. If you have high gloss finish, once it's fully cured, it is easy to use automotive polishing compounds to bring back the shine.