Bob sent us his solution:
Firstly I multiplied the matricies to find the new point. Using the trigonometric identities to simplify, I got the new point as (rcos(θ+ϕ),rsin(θ+ϕ)). This meant that we had rotated the point ϕ degrees anticlockwise.

To prove that OX=OX'=p, I drew a line XX', which intersects and is parallel to the line y=xtanθ (call this point of intersection D). But DX'=DX and so ODX and ODX' are two right-angled triangles of the same size, so OX=OX'=p. By the same argument I drew lines OP and OP', and so got right-angled triangles again, so OP=OP'=q.

By looking at the right-angled triangle OAX', with the angle at O being 2θ, I knew that:
cos2θ= OA' OX = OA' p

and so OA'=pcos2θ.

I then looked at the right-angled triangle X'BP, and since the angle at X is 2θ, BP'=qsin2θ. By applying Pythagoras' Theorem to the right-angled triangle OAX, AX'=psin2θ. Finally, applying Pythagoras' Thereom to the triangle X'BP' I found BX'=qcos2θ.

Looking at the change in X co-ordinates, I found P'=(pcos2θ+qsin2θ,psin2θ-qcos2θ).

So the matrix for the reflection would be:
T=( cos2θsin2θ sin2θ-cos2θ )


You may also like to look at the problem ' The Matrix ' from July 2003 and its solution for an explanation of how a transformation of the plane is given by a matrix and how you can find the image of a point by multiplying its vector by the matrix of the transformation.