How do you rotate the axes to transform the equation #5x^2-sqrt3xy+4y^2=6# into a new equation with no xy term and then find the angle of rotation?
Here is a very helpful reference
Using the equation (9.4.1) from the reference,
The angle that the conic section is rotated is the opposite rotation of the angle that equation (9.4.6) calculates, because (9.4.6) tells you what angle you use to "un"rotate" the conic section. Therefore, the angle that you want is:
If you want to "un-rotate" the conic section, then you must use the negative of this,
Equation (9.4.3) is the new equation that you want:
Here are the equations that you will need to write the new equation:
(9.4.4f) F' = F
Please notice that I left out, B, D, and E, because we know that they will be 0.