To one person, it may be. To another, magic is something beneficial and can be used for the greater good of all. Evil is very subjective and dependent on one's morals and principles. Neither perspective is wrong nor correct.

If you perceive it as something evil, then no one can tell you that you're not right.