An orthogonal matrix is one satisfying $A A^t = I$. Suppose $$A = \begin{pmatrix} \frac{1}{\sqrt{2}} & \frac{1}{\sqrt{2}} & 0 \\ 0 & \frac{1}{\sqrt{2}} & \frac{1}{\sqrt{2}} \\ a & b & c \end{pmatrix}.$$
If $A$ is orthogonal, show that $(a, b, c)$ is perpendicular to $(\frac{1}{\sqrt{2}}, \frac{1}{\sqrt{2}}, 0)$ and $(0,\frac{1}{\sqrt{2}}, \frac{1}{\sqrt{2}})$
If $A$ is orthogonal, show that $(a,b,c)$ is of unit length.
Find two values of $(a, b, c)$ so that $A$ is orthogonal.
Hence, we are trying to show that $(a,b,c)\cdot(\frac{1}{\sqrt{2}}, \frac{1}{\sqrt{2}}, 0)=0$ and $(a,b,c)\cdot(0,\frac{1}{\sqrt{2}}, \frac{1}{\sqrt{2}})=0$.