If you can relign hockey blades as Steve+Kayleigh suggested, that might be a good option. Wouldn't hurt to talk to a podiatrist either. It could also be that that boot just doesn't fit you correctly and you need a different brand/model. I'm a figure skater so have limited knowledge with hockey boots.
I can tell you this though- everyone's feet are different, and some of us are just not "normal"
. I have "normal" arches, but supinate. I could hold my ankles up and everything (I skate in mid/high-range stiffness figure boots), but had other issues with my skating. It never occurred to me to realign the blades, but a good skate tech watched me skate, and wanted to push them out a couple millimeters and shim them on the inside. It's made a huge difference, for the better.
Best bet is to talk to a good skate tech, ask around your hockey friends and/or the local hockey club (check with the most advanced players you can find- more likely to have been down this road themselves). Your local guy might be the go-to man, but maybe not. You should have an easier time finding one of them in the hockey world than we do in the figure-skating world!
Good luck!