ZJIT: Recompile ISEQ when a type/shape check fails on monomorphic callsites

[k0kubun]

context: #771 (comment)

There are phase changes where a reasonable call-threshold setting would not observe all possible types. To address exits in such situations, it's nice to experiment with recompiling a whole ISEQ:

1. Update the profile on such a exit
2. Clear JIT code and reset the call counter to re-compile the ISEQ after profiling num-profiles times again

[aidenfoxivey]

Does a phase change refer to a change in the type or shape of a given variable?

[k0kubun]

Yeah. In production contexts, I would imagine traffic pattern changes over time impact what endpoints are used, which would subsequently shift these things in the application. For ruby-bench, it would be Ruby prelude, ruby-bench harness, benchmark setup, and then benchmark iterations. Each phase of them may change how a method is used with what type/shape.

[k0kubun]

Send/ivar turns out to be a bit complicated because they're compiled as if it was monomorphic even when it's actually (skewed) polymorphic. So it's not guaranteed that the type distribution changes when you profile types at their exits.

I'll land the recompilation support for patch points first. I'll then separately expand its support to send/ivar, changing how polymorphic callsites are compiled. I may work on compiling polymorphic callsites into proper HIR first if needed.

[tekknolagi]

So as we have the JIT right now, recompilation will lead to fewer side exits but it will also make all paths through JIT code slower since we don't handle polymorphic lookup right now.

[tekknolagi]

That is, unless you're clearing previous profiles and starting from a clean slate

[k0kubun]

I'll see what the benchmark results look like. Whether it has a slowdown or not, I'm thinking of compiling a polymorphic callsite as dispatch chains ordered by the distribution + a fallback and the end instead of a side exit, similarly to YJIT. That way, types observed in the past should still be optimized while it doesn't exit.