I did the exact same thing. No junctionning magic to stats. However I did use abilities like str+60%. And after levelling up with the str bonus ablilities etc it wasnt too bad.