There are water filters which trap the common nasties, and water purifiers which get 'em all.
Plusses and minuses to both.
If needed, and this is not often required, further treatment of water run through filters can be accomplished by various means. Most often this by use of chemical additives, or boiling.
The SteriPen is only as good as its' batteries, and while it works well, batteries have a way of failing. there are a number of battery-powered items that are used to treat water. Some rely on water being pretty clear to allow UV light to disinfect water, so ridding water of sediment is important with these devices.
As with any battery-powered item, one should consider whether the device will be used in cold temps. If so, will the battery be capable of doing its' job? What will you do if the batteries are discharged, and you need new ones? Are your particular batteries at all uncommon? Are the batteries capable of being recharged, and if so, are there solar re-chargeres available for your particular battery? In a post SHTF world, batteries, particularly uncommon ones will be like gold, Solar re-chargers and suitable batts will be worth their weight in gold.
But I digress.
If I was to start from scratch, I think I would buy a water purifier that had been made using the same filter for a long time, so the purifier filters were fairly common and relatively inexpensive. Buy a BUNCH of filters. I would also have as a backup the means to boil water, and the means to add chem additives to canteens, such as MicroPur tablets. If I used batt-powered devices, I would make sure that I had adequate batts on-hand, and also that I had the capability of solar re-charging the required number of batts. For example, if you needed two freshly re-charged batts every two days, and your single solar re-charger could only supply one batt in same time period, then you need another solar re-charger. Mebbe more than that, to account for cloudy days and so forth.
In the long run, it will come down to how efficiently you can boil water. Never forget that.
Other well-informed folks will have their own opinions, and you should listen to them as well. Just make sure the person you're listening to has actually used their equipment under field conditions, and also understands the difference between water filter, and water purifier.