CuPy supports sparse matrices using cuSPARSE. These matrices have the same interfaces of SciPy's sparse matrices.
cupy.sparse
cupy.sparse.coo_matrix cupy.sparse.csr_matrix cupy.sparse.csc_matrix cupy.sparse.dia_matrix cupy.sparse.spmatrix
cupy.sparse.eye cupy.sparse.identity
cupy.sparse.issparse cupy.sparse.isspmatrix cupy.sparse.isspmatrix_csc cupy.sparse.isspmatrix_csr cupy.sparse.isspmatrix_coo cupy.sparse.isspmatrix_dia