-
Notifications
You must be signed in to change notification settings - Fork 23
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Floating point exception during convolutional downscale (Lanczos) #25
Comments
Could you tell me sizes of source and destination images that cause this error? |
According to your traceback, it looks like the error occurs somewhere in this code: #[inline]
fn lanczos_filter(x: f64) -> f64 {
// truncated sinc
if (-3.0..3.0).contains(&x) {
sinc_filter(x) * sinc_filter(x / 3.)
} else {
0.0
}
}
#[inline]
fn sinc_filter(mut x: f64) -> f64 {
if x == 0.0 {
1.0
} else {
x *= PI;
x.sin() / x
}
} But I have no idea what value of |
I am downscaling from 2048x2048 to 1024x1024 |
According to your traceback,
the exception occurred due to calling __sin(x) function with But value |
GDB Backtrace:
This issue is incredibly rare; my application does this roughly 40 times per second and it takes roughly an hour for it to happen, but it does happen unconditionally given enough time. Let me know if there's any information that would be useful.
The text was updated successfully, but these errors were encountered: