Intermittent timeout/crash in /html/dom/reflection-embedded.html #11100

cbrewster · 2016-05-09T21:37:01Z

▶ TIMEOUT [expected OK] /html/dom/reflection-embedded.html
  │ 
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, ../src/libstd/rand/mod.rs:159
  │ stack backtrace:
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, ../src/libstd/rand/mod.rs:159
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, /Users/servo/.cargo/registry/src/github.com-88ac128001ac3a9a/rand-0.3.14/src/lib.rs:873
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, /Users/servo/.cargo/registry/src/github.com-88ac128001ac3a9a/rand-0.3.14/src/lib.rs:873
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, /Users/servo/.cargo/registry/src/github.com-88ac128001ac3a9a/rand-0.3.14/src/lib.rs:873
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x1073866e9 - std::rand::thread_rng::THREAD_RNG_KEY::__init::h536e3917997a1628
  │    8:        0x10736d98c - std::rand::thread_rng::h789d00d1fce4f79b
  │    9:        0x105d81121 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   10:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   11:        0x10737ef0b - __rust_try
  │   12:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │   13:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   14:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   15:     0x7fff8bd4d059 - _pthread_body
  │   16:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, /Users/servo/.cargo/registry/src/github.com-88ac128001ac3a9a/rand-0.3.14/src/lib.rs:873
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x1073866e9 - std::rand::thread_rng::THREAD_RNG_KEY::__init::h536e3917997a1628
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, /Users/servo/.cargo/registry/src/github.com-88ac128001ac3a9a/rand-0.3.14/src/lib.rs:873
  │    8:        0x10736d98c - std::rand::thread_rng::h789d00d1fce4f79b
  │    9:        0x105d81121 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   10:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   11:        0x10737ef0b - __rust_try
  │   12:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, /Users/servo/.cargo/registry/src/github.com-88ac128001ac3a9a/rand-0.3.14/src/lib.rs:873
  │   13:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   14:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   15:     0x7fff8bd4d059 - _pthread_body
  │   16:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, /Users/servo/.cargo/registry/src/github.com-88ac128001ac3a9a/rand-0.3.14/src/lib.rs:873
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x10718656f - rand::thread_rng::THREAD_RNG_KEY::__init::h95086aa3feb19f11
  │    8:        0x1071863ac - rand::thread_rng::h685796b33c6d5157
  │    9:        0x106b67842 - uuid::Uuid::new_v4::hf5742953332a48bd
  │   10:        0x105d81bb9 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   11:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   12:        0x10737ef0b - __rust_try
  │   13:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │   14:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   15:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   16:     0x7fff8bd4d059 - _pthread_body
  │   17:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, ../src/libstd/rand/mod.rs:159
  │    1:        0x10737f</span><span class="stdout">ca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │ thread &#39;http_loader for http://web-platform.test:8000/html/dom/test-valueOf&#39; panicked at &#39;could not initialize thread_rng: Too many open files (os error 24)&#39;, ../src/libstd/rand/mod.rs:159
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x10718656f - rand::thread_rng::THREAD_RNG_KEY::__init::h95086aa3feb19f11
  │    8:        0x1071863ac - rand::thread_rng::h685796b33c6d5157
  │    9:        0x106b67842 - uuid::Uuid::new_v4::hf5742953332a48bd
  │   10:        0x105d81bb9 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   11:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   12:        0x10737ef0b - __rust_try
  │   13:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │   14:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   15:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   16:     0x7fff8bd4d059 - _pthread_body
  │   17:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x10718656f - rand::thread_rng::THREAD_RNG_KEY::__init::h95086aa3feb19f11
  │    8:        0x1071863ac - rand::thread_rng::h685796b33c6d5157
  │    9:        0x106b67842 - uuid::Uuid::new_v4::hf5742953332a48bd
  │   10:        0x105d81bb9 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   11:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   12:        0x10737ef0b - __rust_try
  │   13:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │   14:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   15:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   16:     0x7fff8bd4d059 - _pthread_body
  │   17:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x10718656f - rand::thread_rng::THREAD_RNG_KEY::__init::h95086aa3feb19f11
  │    8:        0x1071863ac - rand::thread_rng::h685796b33c6d5157
  │    9:        0x106b67842 - uuid::Uuid::new_v4::hf5742953332a48bd
  │   10:        0x105d81bb9 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   11:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   12:        0x10737ef0b - __rust_try
  │   13:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │   14:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   15:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   16:     0x7fff8bd4d059 - _pthread_body
  │   17:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x10718656f - rand::thread_rng::THREAD_RNG_KEY::__init::h95086aa3feb19f11
  │    8:        0x1071863ac - rand::thread_rng::h685796b33c6d5157
  │    9:        0x106b67842 - uuid::Uuid::new_v4::hf5742953332a48bd
  │   10:        0x105d81bb9 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   11:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   12:        0x10737ef0b - __rust_try
  │   13:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │   14:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   15:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   16:     0x7fff8bd4d059 - _pthread_body
  │   17:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x10718656f - rand::thread_rng::THREAD_RNG_KEY::__init::h95086aa3feb19f11
  │    8:        0x1071863ac - rand::thread_rng::h685796b33c6d5157
  │    9:        0x106b67842 - uuid::Uuid::new_v4::hf5742953332a48bd
  │   10:        0x105d81bb9 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   11:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   12:        0x10737ef0b - __rust_try
  │   13:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │   14:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   15:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   16:     0x7fff8bd4d059 - _pthread_body
  │   17:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x10718656f - rand::thread_rng::THREAD_RNG_KEY::__init::h95086aa3feb19f11
  │    8:        0x1071863ac - rand::thread_rng::h685796b33c6d5157
  │    9:        0x106b67842 - uuid::Uuid::new_v4::hf5742953332a48bd
  │   10:        0x105d81bb9 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   11:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   12:        0x10737ef0b - __rust_try
  │   13:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │   14:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   15:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   16:     0x7fff8bd4d059 - _pthread_body
  │   17:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x1073866e9 - std::rand::thread_rng::THREAD_RNG_KEY::__init::h536e3917997a1628
  │    8:        0x10736d98c - std::rand::thread_rng::h789d00d1fce4f79b
  │    9:        0x105d81121 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   10:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   11:        0x10737ef0b - __rust_try
  │   12:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd</span><span class="stdout">
  │   13:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   14:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   15:     0x7fff8bd4d059 - _pthread_body
  │   16:     0x7fff8bd4cfd6 - _pthread_start
  │ stack backtrace:
  │    1:        0x10737fca8 - std::sys::backtrace::tracing::imp::write::h9fb600083204ae7f
  │    2:        0x1073860c5 - std::panicking::default_hook::_$u7b$$u7b$closure$u7d$$u7d$::hca543c34f11229ac
  │    3:        0x107385cde - std::panicking::default_hook::hc2c969e7453d080c
  │    4:        0x106b2e892 - util::panicking::initiate_panic_hook::_$u7b$$u7b$closure$u7d$$u7d$::_$u7b$$u7b$closure$u7d$$u7d$::h0bad41b0b38a855d
  │    5:        0x10736d388 - std::sys_common::unwind::begin_unwind_inner::h30e12d15ce2b2e25
  │    6:        0x10736ecbe - std::sys_common::unwind::begin_unwind_fmt::hb2de8a9968d38523
  │    7:        0x1073866e9 - std::rand::thread_rng::THREAD_RNG_KEY::__init::h536e3917997a1628
  │    8:        0x10736d98c - std::rand::thread_rng::h789d00d1fce4f79b
  │    9:        0x105d81121 - net::http_loader::load::h68b5ac4fbf09d0a1
  │   10:        0x105d7e79d - std::sys_common::unwind::try::try_fn::h94855ca93006dd22
  │   11:        0x10737ef0b - __rust_try
  │   12:        0x10737ee93 - std::sys_common::unwind::inner_try::h47a4d9cd4a369dcd
  │   13:        0x105d7f87d - _&lt;F as std..boxed..FnBox&lt;A&gt;&gt;::call_box::hca0e8efc2dc5954d
  │   14:        0x107385148 - std::sys::thread::Thread::new::thread_start::h6f266e069bf4ec2b
  │   15:     0x7fff8bd4d059 - _pthread_body
  └   16:     0x7fff8bd4cfd6 - _pthread_start

The text was updated successfully, but these errors were encountered:

Ms2ger · 2016-05-13T11:52:15Z

I suspect this has something to do with the increased parallelism for wpt runs. @metajack ?

metajack · 2016-05-13T12:53:09Z

I checked all the linked PRs. This intermittent appears isolated to mac-rel-wpt.

metajack · 2016-05-13T12:58:56Z

I don't see anything in relection-embedded.html that would create files. Am I missing something? I can understand why we'd run out of file descriptors, but why always on this specific test?

Ms2ger · 2016-05-13T13:06:19Z

That's the one that handles iframe and img.

metajack · 2016-05-13T13:13:56Z

All instances seem to be on servo-mac3 or servo-macpro1.

metajack · 2016-05-13T13:31:53Z

On linux we seem to be happy with the default number of file descriptors (1024). We also run many more simultaneous tests on linux since there are more processors.

On the mac, we attempt to set the limit to 30k via sysctl, but according to http://superuser.com/questions/302754/increase-the-maximum-number-of-open-file-descriptors-in-snow-leopard this is no longer enough. launchctl limit shows us limited to 256.

I have manually run launchctl limit maxfiles 1024 unlimited on servo-mac1, servo-mac2, servo-mac3, and servo-macpro1, to see if this problem is alleviated.

Is there any reason why OS X runs would want more file descriptors than linux runs?

larsbergstrom · 2016-05-13T13:43:31Z

Aha, I recently had to pave mac3 and macpro1 and I must have done something similarly manual that we haven't properly automated in salt yet that I didn't do when restoring them. Thanks!

I thought that our linux machines were defaulting to unlimited the last time I checked.

metajack · 2016-05-13T13:44:39Z

ulimit -a and launchctl limit showed 10240 and 256 respectively. I guess ulimit just lies on OS X now.

metajack · 2016-05-13T13:45:43Z

Note that this was consistent across servo-mac1, servo-mac2, servo-mac3, and servo-macpro1. I didn't find any configuration differences, but it is possible I missed something.

larsbergstrom · 2016-05-13T13:47:59Z

This is what I used to do, pre-salt:

echo 'kern.maxfiles=60000\nkern.maxfilesperproc=20000\nkern.ipc.somaxconn=2048' | sudo tee -a /etc/sysctl.conf
echo -e 'limit maxfiles 8192 20480\nlimit maxproc 1000 2000' | sudo tee -a /etc/launchd.conf
echo 'ulimit -n 10240' | sudo tee -a /etc/profile

metajack · 2016-05-13T13:51:55Z

launchd.conf only exists on servo-mac2. All of them seem to have the /etc/profile change, and they also all had the sysctl.conf change (salt manages that one currently).

metajack · 2016-05-13T13:52:42Z

I wonder if we used to run mac-rel-wpt on servo-mac2 before? That would explain why this popped up.

larsbergstrom · 2016-05-13T13:53:48Z

@metajack Almost all our macs except for -mac2 have been paved in the last few weeks. I would not call OSX a stable OS for long-running automated systems :-)

metajack · 2016-05-13T14:37:43Z

I'm unsure whether my changes were in effect for #11173, but it seems to have failed :(

metajack · 2016-05-13T18:28:46Z

I spent some time investigating this to see whether it was opening excessive numbers of files. Here's a dtrace script I used:

#!/usr/sbin/dtrace -s

#pragma D option quiet

syscall::open*:entry,
syscall::socket*:entry,
syscall::accept*:entry,
syscall::socketpair*:entry,
syscall::pipe*:entry
/execname == "servo"/
{
  @calls[execname,probefunc] = count();
  printf("%s %s %s\n", execname, probefunc, copyinstr(arg0));
ustack();
}

syscall::open*:return,
syscall::socket*:return,
syscall::pipe*:return
/execname == "servo" && arg0 == -1/
{
  @errors[execname, probefunc] = count();
}

syscall::close:entry
/execname == "servo"/
{
  @calls[execname,probefunc] = count();
  printf("%s %s\n", execname, probefunc);
}

This seems to show it does open a lot more files than say /html/dom/elements/elements-in-the-dom/unknown-element.html but it seems to be all the threads initializing their RNG from /dev/urandom. I didn't measure concurrent fd counts, and I may have missed some syscalls that create fds.

KiChjang · 2016-11-18T18:48:59Z

Consider disabling this since it's been hitting #14227 4 times in a row.

Should help with servo#11100.

Use FnvHasher in http_loader::load Should help with #11100.  --- This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/14284)

Ms2ger · 2016-11-20T12:55:03Z

Disabling in #14293.

Disable reflection-embedded.html. CC #11100  --- This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/14293)

cbrewster added the I-intermittent Problem reproduces intermittently. label May 9, 2016

cbrewster mentioned this issue May 9, 2016

Move ConvertPipelineIdFromWebRender to compositing #11090

Merged

emilio mentioned this issue May 11, 2016

layout: Take margins in the inline direction into account when guessing the inline-size of block formatting contexts. #11125

Merged

KiChjang mentioned this issue May 11, 2016

Create pull request template. #11118

Merged

emilio mentioned this issue May 12, 2016

Reworded some of PULL_REQUEST_TEMPLATE.md #11141

Merged

5 tasks

jdm mentioned this issue May 12, 2016

Only use zeroed memory for gecko style structs, not the wrapper servo struct. #11160

Merged

emilio mentioned this issue May 13, 2016

codegen: Fix dictionary handling and semantics #11155

Merged

5 tasks

metajack mentioned this issue May 13, 2016

Stop using JSAutoRequest. #11173

Merged

5 tasks

jdm mentioned this issue May 14, 2016

Minor cleanup and optimizations in glyph/style caching #11180

Merged

samlh mentioned this issue May 14, 2016

(Do not merge) Test orbit. #11110

Closed

mbrubeck mentioned this issue May 17, 2016

Remove num-traits from compositing #11213

Merged

5 tasks

jdm mentioned this issue May 17, 2016

script: Avoid needless ChangeRunningAnimationsState messages during typical requestAnimationFrame() animations. #11205

Merged

mbrubeck mentioned this issue May 18, 2016

Support font-style in geckolib #11240

Merged

jdm mentioned this issue May 19, 2016

adding interface for custom responses #10961

Merged

Ms2ger mentioned this issue May 19, 2016

Remove misleading nonexistant flag hint #11209

Merged

jdm mentioned this issue Sep 12, 2016

Correct an unsound optimization in event dispatch. #13245

Merged

jdm changed the title ~~Intermittent timeout in /html/dom/reflection-embedded.html~~ Intermittent timeout/crash in /html/dom/reflection-embedded.html Sep 12, 2016

jdm mentioned this issue Sep 23, 2016

Appveyor and Travis fix #13383

Merged

This was referenced Nov 9, 2016

Fix ./mach clippy. #14134

Merged

Log debug messages when devtools is not notified about a HTTP request. #14133

Merged

style: Don't assume siblings are alive in the rule tree when removing ourselves from the child list. #14167

Merged

KiChjang mentioned this issue Nov 10, 2016

Update CORS naming from 'CORS' to 'Cors'. #14156

Merged

glennw mentioned this issue Nov 10, 2016

Add support for DirectWrite font rendering on Windows #14153

Merged

5 tasks

jdm mentioned this issue Nov 15, 2016

Move the servo binary to ports. #14172

Merged

Manishearth mentioned this issue Nov 16, 2016

Immutable CSSOM #14190

Merged

3 tasks

emilio mentioned this issue Nov 17, 2016

Update rust-cssparser for speed improvements when tokenizing strings and data uris #14245

Merged

wafflespeanut mentioned this issue Nov 17, 2016

Stylo - gecko glue code for font-size-adjust. #14227

Merged

5 tasks

SimonSapin mentioned this issue Nov 17, 2016

rule tree: Avoid yet another dumb assertion when dropping the rule tree. #14233

Closed

stshine mentioned this issue Nov 19, 2016

Make document url mutable and implement location.replace() #13418

Merged

4 tasks

nox added a commit to nox/servo that referenced this issue Nov 19, 2016

Use FnvHasher in http_loader::load

7a8c5ae

Should help with servo#11100.

nox mentioned this issue Nov 19, 2016

Use FnvHasher in http_loader::load #14284

Merged

heycam mentioned this issue Nov 20, 2016

GC the rule tree only when the free list gets to a certain size. #14256

Merged

wafflespeanut mentioned this issue Nov 20, 2016

Disable incremental_trailing_whitespace_a.html. #14288

Merged

stshine mentioned this issue Nov 20, 2016

Implement range index with the Position enum on ServoUrl #14274

Merged

5 tasks

Ms2ger mentioned this issue Nov 20, 2016

Disable reflection-embedded.html. #14293

Merged

Ms2ger added the C-disabled The issue describes an intermittent failure in a test, which has been temporarily disabled label Nov 20, 2016

nox mentioned this issue Nov 21, 2016

Add missing action in CreateContextualFragment method #14210

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Intermittent timeout/crash in /html/dom/reflection-embedded.html #11100

Intermittent timeout/crash in /html/dom/reflection-embedded.html #11100

cbrewster commented May 9, 2016

Ms2ger commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

Ms2ger commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

larsbergstrom commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

larsbergstrom commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

larsbergstrom commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

KiChjang commented Nov 18, 2016 •

edited by wafflespeanut

Ms2ger commented Nov 20, 2016

Intermittent timeout/crash in /html/dom/reflection-embedded.html #11100

Intermittent timeout/crash in /html/dom/reflection-embedded.html #11100

Comments

cbrewster commented May 9, 2016

Ms2ger commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

Ms2ger commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

larsbergstrom commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

larsbergstrom commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

larsbergstrom commented May 13, 2016

metajack commented May 13, 2016

metajack commented May 13, 2016

KiChjang commented Nov 18, 2016 • edited by wafflespeanut

Ms2ger commented Nov 20, 2016

KiChjang commented Nov 18, 2016 •

edited by wafflespeanut