Well, you should do whatever you want to do. If you like your current field of study and believe that it will be a fulfilling career then by all means stick with it. On the other hand if you believe aviation is your true love and that it would make you happier, then make the change as soon as possible.