Option (D) is correct.
Step 1 — square and add the two expressions.
Let x=5sinθ−3cosθ. Then
(3sinθ+5cosθ)2+(5sinθ−3cosθ)2
=(9sin2θ+30sinθcosθ+25cos2θ)+(25sin2θ−30sinθcosθ+9cos2θ)
The cross terms cancel:
=34sin2θ+34cos2θ=34
Step 2 — substitute the given value.
52+x2=34⟹x2=9⟹x=3 or x=−3
Step 3 — decide the sign by finding θ.
From 3sinθ=5(1−cosθ), square both sides and use sin2θ=(1−cosθ)(1+cosθ):
9(1−cosθ)(1+cosθ)=25(1−cosθ)2
θ is acute, so 1−cosθ=0; divide by it:
9(1+cosθ)=25(1−cosθ)⟹34cosθ=16⟹cosθ=178
Then sinθ=1715 (positive, since θ is acute), and
5sinθ−3cosθ=1775−1724=1751=3
Check. 3×1715+5×178=1745+40=5. ✓
Why (B) is the trap: squaring gives x=±3, and −3 belongs to θ=0∘ (where 3sin0∘+5cos0∘=5 too), which is not acute.