Throughout, "a≡b" means that a and b leave the same remainder on division by 26, that is, 26 divides a−b.
(a) Suppose E(x1)=E(x2) with x1,x2∈L. Then 5x1+8 and 5x2+8 leave the same remainder, so 26 divides their difference:
26∣5(x1−x2).
Now 26=2×13. Neither 2 nor 13 divides 5, so both must divide x1−x2, and hence 26 divides x1−x2. But x1 and x2 lie between 0 and 25, so x1−x2 lies between −25 and 25. The only multiple of 26 there is 0. So x1=x2, and E is one-one.
(b) E maps the 26-element set L into itself and is one-one, so its 26 outputs are all different. Twenty-six different elements of a 26-element set must be the whole set. So every element of L is an output, and E is onto.
E(7): 5×7+8=43=1×26+17, so E(7)=17. The letter H is sent to R.
(c) For x∈L, E(x)≡5x+8, so E(x)−8≡5x. Therefore
21(E(x)−8)≡21×5x=105x=4×26x+x≡x.
So D(E(x)), the remainder of 21(E(x)−8), equals the remainder of x, which is x itself since 0≤x≤25. Hence D(E(x))=x for every x∈L. (Since E is a bijection, this makes D=E−1.) The key fact is 5×21=105=4×26+1.
Decode y=3: 21×(3−8)=−105, and −105=−5×26+25, so D(3)=25, the letter Z. Check: E(25)=5×25+8=133=5×26+3, which is 3.
(d) E2(0)=8, and E2(13): 2×13+8=34=26+8, so E2(13)=8. Two different letters give the same output, so E2 is not one-one.
Range. 2x+8 is always even, and subtracting a multiple of 26 keeps it even, so every output is one of the 13 even numbers 0,2,…,24. Each of them is reached: x=0,1,…,12 give 2x+8=8,10,…,32, that is the outputs 8,10,…,24,0,2,4,6, all 13 different. So the range has 13 elements. (Here 2 shares the factor 2 with 26, which is exactly why the argument of (a) breaks down.)
(e) Fixed letters of E. E(x)=x means 5x+8≡x, that is 26 divides 4x+8=4(x+2). Then 2(x+2) is a multiple of 13, and since 13 does not divide 2, 13 divides x+2. With 0≤x≤25, x+2 lies between 2 and 27, so x+2=13 or 26:
x=11 (L)orx=24 (Y).
Check: 5×11+8=63=2×26+11, and 5×24+8=128=4×26+24.
Fixed letters of E∘E. E(E(x))≡5(5x+8)+8=25x+48. Since 25≡−1 and 48=26+22, this gives
E(E(x))≡22−x.
So E(E(x))=x means 26 divides 22−2x=2(11−x), that is 13 divides 11−x. In L this gives x=11 or x=24, the same two letters. (A letter fixed by E is clearly fixed by E∘E. The calculation shows that E∘E fixes no other letter.)