Spin-polarized atoms have been used for high sensitivity measurements of magnetic fields as well as other interactions that couple to particle spin. I will describe recent experimental progress in atomic magnetometers and present results of a new search for neutron spin interactions violating local Lorentz invariance. Because of close connection between CPT and Lorentz symmetry, our results also place the most stringent limit on CPT invariance for fermions.