There are many items in the game that either glow or hum or have procs or are potions but don't have the Magical flag. Until you get lore you have to either rely on someone telling you in game, using the mob in the Inn to identify items, or using the QHCF wiki/officials item search to check to see if an item is flagged magic. Regardless your skill % at lore it will always tell you the flags an object has so that way if you do find a magic weapon, armor, potion, wand, etc you can just sac it or give it to Tahren.
For example there's a potion that grants detect invis but is not a magic potion so as a hater of magic you can use it because the source is not magical. Similar to how seaweed isn't magical but you are granted water breathing.