Determining Matrix form of an Operator from known measurements

How can we determine the operator in matrix form? We can use the eigenvectors and measurements (eigenvalues) to solve for each element of the matrix. Example through the z-direction spin operator and spin-up and down in the z direction.