The FFLAS-FFPACK library provides dense linear algebra routines over word-size prime finite fields. See also: https://github.com/linbox-team/fflas-ffpack