Right now exact determinant calculations are disabled for Yale and list matrices, but allowed for dense, of sizes 2x2 and 3x3. This doesn't make a ton of sense. They're all pretty trivial calculations.
Someone needs to implement an algorithm which calculates 2x2 and 3x3 exact determinants for Yale and list matrices. It goes in nm_det_exact in ruby_nmatrix.c.
Subsequently, nm_inverse_exact can be adjusted, too; however, this requires the exact determinant calculation.