Skip to content

[AutoTVM] Catch cuda errors when using LocalRunner#7738

Closed
michalpiszczek wants to merge 1 commit intoapache:mainfrom
michalpiszczek:main
Closed

[AutoTVM] Catch cuda errors when using LocalRunner#7738
michalpiszczek wants to merge 1 commit intoapache:mainfrom
michalpiszczek:main

Conversation

@michalpiszczek
Copy link
Contributor

This block in measure_methods.py intended to capture CUDA errors caused by invalid kernels generated during AutoTuning:

    except TVMError as exc:
        msg = str(exc)
        if "Stack trace returned" in msg:
            msg = msg[: msg.index("Stack trace returned")]
        if "CUDA Source" in msg:
            msg = msg[: msg.index("CUDA Source")]
        costs = (RuntimeError(msg[:1024]),)
        errno = MeasureErrorNo.RUNTIME_DEVICE

but when using LocalRunner the cuda errors come through here wrapped in RPCError not TVMError.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants