What? No... if you're say a US resident, and a Canadian company is charging you HST, then that company is ripping you off.
You don't charge GST/PST/HST to non-residents. For example, if you're an online company in BC, Canada, you charge GST to all Canadian residents, and GST + PST to BC residents. Those taxes don't apply to non-residents though.
When it reaches the family in Canada that's when the HST would have to be paid but other than that no duty if the product is made in NA. Actually, the HST only applies to some products, not sure which ones. Usually you don't pay HST but I've had to pay before, it's weird. I think it depends on the value of the item.
There's some info: http://www.cra-arc.gc.ca/tx/bsnss/tpcs/gst-tps/gnrl/txbl/mprtsxprts/mprtdgds-eng.html