(a)
EX=[5723][49]=[20+1828+27]=[3855]
The pair (4, 9) is sent as (38, 55).
(b)
DE=[3qp5][5723]=[15+7p5q+356+3p2q+15]
Equating this to I entry by entry: 6+3p=0 gives p=−2, and then 15+7p=15−14=1 as required. 5q+35=0 gives q=−7, and then 2q+15=−14+15=1 as required. So
D=[3−7−25]
The other product is
ED=[5723][3−7−25]=[15−1421−21−10+10−14+15]=[1001]
Since DE=ED=I, D is the inverse of E (and the inverse of a matrix, when it exists, is unique).
(c)
X=DY=[3−7−25][3144]=[93−88−217+220]=[53]
Check: E[53]=[25+635+9]=[3144]. The message was (5, 3).
(d) Both products with F give I:
[1011][10−11]=[10−1+11]=I,[10−11][1011]=[101−11]=I
so F−1=[10−11]. By the rule (EF)−1=F−1E−1,
(EF)−1=F−1D=[10−11][3−7−25]=[10−7−75]
As a check, EF=[57710] and
[57710][10−7−75]=[50−4970−70−35+35−49+50]=I
Decoding:
[10−7−75][4361]=[430−427−301+305]=[34]
Check: F[34]=[74] and E[74]=[35+849+12]=[4361]. The message was (3, 4).
Wrong order, undoing F first and then E:
F−1[4361]=[−1861],D[−1861]=[−54−122126+305]=[−176431]
which is not the message. The step applied last (E) has to be undone first, which is why (EF)−1=F−1E−1 and not E−1F−1.
(e) Since the second column of G is 3 times the first,
G[30]=[63]andG[01]=[63]
so the different messages (3, 0) and (0, 1) are both sent as (6, 3).
Suppose some matrix H satisfied HG=I. Then
[30]=(HG)[30]=H[63]=(HG)[01]=[01]
which is false. So no such H exists and G has no inverse. The receiver could never tell which of the two messages was meant, so G is useless as a code.