@Sputnik556
Just you going? Or are kids and womenfolk involved?
Here are a few ideas (I was born and raised in Toronto)
The Royal Ontario Museum is big and often has interesting special exhibits.
The Ontario Science Center also can have interesting featured exhibits, it's a great place for kids.
If there's a Mrs Sputnik she might like the Bata Shoe Museum.
If you like parks, there's a park system that runs behind the Science Center, several parks linked together.
An often overlooked park setting is the Toronto Islands. You can get there by a short ferry ride.
The Distillery District is different, the old Gooderham & Worts distillery works has been converted into a collection of shops, restaurants, bars, and galleries that use the original old buildings.
The Hockey Hall of Fame is in an old stone bank building.
The Art Gallery of Ontario gets high ratings, but the collection is heavy on Canadian art which you might not be interested in.
Casa Loma is a castle right in the city that was built as a private residence, now a museum. It's been used as a set in many movies, including X-Men:
http://torontoist.com/2007/12/reel_toronto_th_1/