Option (A) is correct.
Explanation: For a circular orbit, rmv2=r2GMm, so
K=2rGMm,V=−rGMm=−2K,E=K+V=−2rGMm=−K
K is the only positive energy, so curve 1 is K. V is the most negative (twice K in size), so curve 3 is V, and curve 2, equal and opposite to K, is E.
All three vary as 1/r. Increasing the radius from 1.0×107 m to 5.0×107 m (five times) divides each of them by 5:
K=5+2.0×109=+0.4×109 J,E=5−2.0×109=−0.4×109 J,V=5−4.0×109=−0.8×109 J
(B) is wrong: the potential energy is twice the kinetic energy in size, so it is the lowest curve (3), not curve 2.
(C) is wrong: it makes the energies vary as 1/r2 (dividing by 25), like the force; the energies vary as 1/r.
(D) is wrong: it multiplies by 5; the energies become smaller in size, not larger, as the orbit gets bigger.