Reenable cusparse SpMM on cuda 10.2

[malfet]

This fixes feature regression introduced by #42412 which limited all the use of the API to CUDA-11.0+

[dr-ci]

💊 CI failures summary and remediations

As of commit 078bc51 (more details on the Dr. CI page):

---

• 1/3 failures possibly* introduced in this PR
  • 1/1 non-CircleCI failure(s)
• 2/3 broken upstream at merge base 94e8676 on Aug 04 from 8:36am to 3:15pm PDT (17 commits; b56db30 - 56fc7d0)

---

🚧 1 fixed upstream failure:

These were probably caused by upstream breakages that were already fixed.

Please rebase on the viable/strict branch (expand for instructions)

Since your merge base is older than viable/strict, run these commands:

git fetch https://github.com/pytorch/pytorch viable/strict
git rebase FETCH_HEAD

Check out the recency history of this "viable master" tracking branch.

• pytorch_doc_test on Aug 04 from 8:36am to 3:15pm PDT (17 commits; b56db30 - 56fc7d0)
  • 🔁 rerun

---

ci.pytorch.org: 1 failed

• Failed: pr/pytorch-linux-xenial-rocm3.5.1-py3.6

---

This comment was automatically generated by Dr. CI (expand for details).

Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions on the GitHub issue tracker or post in the (internal) Dr. CI Users group.

See how this bot performed.

This comment has been revised 5 times.

[xwang233]

Thank you so much for the update!

[facebook-github-bot]

@malfet has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

[facebook-github-bot]

@malfet merged this pull request in 3c7fccc.

[peterjc123]

Hey @malfet , looks like this macro caused the Windows failure. The weird thing is that if I replace IS_SPMM_AVAILABLE() with the content in it, it works.

[peterjc123]

#include <iostream>
#include <cusparse.h>

using namespace std;

#define IS_SPMM_AVAILABLE() (defined(__CUDACC__) &&                              \
                             (CUSPARSE_VERSION >= 11100 ||                       \
                              (!defined(_MSC_VER) && CUSPARSE_VERSION >= 10301)))

int main() {
    cout << CUSPARSE_VERSION << endl;
    cout << __CUDACC__ << endl;
    cout << _MSC_VER << endl;
    cout << (__CUDACC__ > 0 && CUSPARSE_VERSION >= 11000) << endl;
    cout << (_MSC_VER > 0 && CUSPARSE_VERSION >= 10301) << endl;
#if (defined(__CUDACC__) && (CUSPARSE_VERSION >= 11100 || (!defined(_MSC_VER) && CUSPARSE_VERSION >= 10301)))
    cout << "hey" << endl;
#endif
#if IS_SPMM_AVAILABLE()
    cout << "yes" << endl;
    return 0;
#else
    cout << "no" << endl;
    return 1;
#endif
}

gives the output:

11100
1
1926
1
1
hey
no

[xwang233]

I found something similar cisco/cjose#63.
A fix is at #42643.

[peterjc123]

#define __CUDACC__ 1

#define IS_CUDACC() defined(__CUDACC__)

#if defined(__CUDACC__)
#error works
#endif

#if IS_CUDACC()
#error this one doesn't work
#endif

[malfet]

@peterjc123 yeah, I keep forgetting about this, but defined() is not a macro that returns a value nor is it a function.