We have about 65 rental properties (many multi unit), this is one of the best way to lose your shirt, known to man, other than just giving your money away.
Owning and maintiaing rental property works, but you really need to have the economy of scale working for you, having one or a half dozen properties will eventually break you, if at any one time your unit is not rentable (which will happen often) due to renter neglect/abuse, or an act of god or something as simple as a downturn in the economy, then you are still going to have to cover that mortgage, and in your case, without an economy of scale, with your own money, do that for three or four months out of the year and you will see all of your profits dry up and yourself in the red.
Unless the property is adjacent to the property that you now own and occupy, it will become a nightmare.
YMMV, but it is one of the few things I know about in this world and would counsel against it unless you were able to pick up 15 to 25 units. (and all of those should be initially rented out).
Good luck!