Option (B) is correct.
Explanation: The atmospheric pressure acts on both faces of the dam and cancels, so only the gauge pressure ρgy of the water matters, where y is the depth below the surface. A horizontal strip of the wet face at depth y, of height dy and length w=50 m, carries a force dF=ρgywdy, and its height above B is (H−y). The torque about B is
τ=∫0Hρgwy(H−y)dy=ρgw(2H3−3H3)=6ρgwH3
τ=61000×9.8×50×(6.0)3=1.76×107 N m
As a check, the total force is 2ρgwH2=8.82×106 N, and τ/F=H/3=2.0 m: the pressure grows with depth, so the resultant acts one-third of the way up the face, not at its middle.
(A) is wrong: 2.65×107 N m places the total force at mid-depth (3.0 m above B), as if the pressure were the same at all depths.
(C) is wrong: 5.29×107 N m uses the bottom pressure ρgH over the whole face with a lever arm H/2; the pressure is zero (gauge) at the top and grows linearly with depth.
(D) is wrong: 3.53×107 N m uses a lever arm of 2H/3=4.0 m; the resultant is 2H/3 below the surface, which is H/3 above the base.