Option (B) is correct.
Explanation:
Differentiate.
f′(x)=sec2x−cosec2x=cos2x1−sin2x1=sin2xcos2xsin2x−cos2x
Use double angles. sin2x−cos2x=−cos2x and sin2xcos2x=41sin22x, so
f′(x)=sin22x−4cos2x=1−cos22x−4cos2x
Solve. Put c=cos2x:
1−c2−4c=38⟹−12c=8−8c2⟹2c2−3c−2=0⟹(2c+1)(c−2)=0
c=2 is impossible for a cosine, so cos2x=−21. For x in (0,π), 2x is in (0,2π), so 2x=32π or 34π, giving x=3π or x=32π.
Check at 32π. sec2x=4 and cosec2x=34, so f′(x)=4−34=38.
Why the other options are wrong
- (A) 3π only misses the second solution: 2x runs over (0,2π), where cos2x=−21 has two solutions, so x=32π works too.
- (C) 6π and 65π come from a sign slip, f′(x)=1−cos22x4cos2x, which leads to 2c2+3c−2=0 and cos2x=21. At x=6π the true value is 34−4=−38.
- (D) "No value" comes from taking (cotx)′=+cosec2x: then f′(x)=sin22x4=38 needs sin22x=23, which is impossible. The derivative of cotx is −cosec2x.