-
-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
New (internal) Cache and NoFileCache classes + implement use of these #332
New (internal) Cache and NoFileCache classes + implement use of these #332
Commits on Jun 30, 2022
-
Tests: add TypeProviderHelper class
Based on a similar class I wrote for the Requests library. If/when that class get published as a package, this class should be removed in favour of the package.
Configuration menu - View commit details
-
Copy full SHA for 7cad4fd - Browse repository at this point
Copy the full SHA 7cad4fdView commit details -
✨ New (internal)
Cache
andNoFileCache
classes... to allow for caching the results of processing intensive utility methods. The `Cache` class is intended to be used for utility functions which depend on the `$phpcsFile` object. The `NoFileCache` class is for file-independent functions. Use selectively and with care as the memory usage of PHPCS will increase when using these caches! Includes full set of tests to cover this new functionality. These new tests have been added to the `RunFirst` test suite to prevent the cache setting and clearing done in these tests from interfering with the rest of the tests.
Configuration menu - View commit details
-
Copy full SHA for 24da15e - Browse repository at this point
Copy the full SHA 24da15eView commit details -
[NoFile]Cache: allow for disabling the cache in test situations
Includes: * Additional tests to cover this change on the off-chance that someone will use this functionality in a non-test situation. * Making sure that the tests related to the `[NoFile]Cache` classes will always run with caching turned **on** as running the cache functionality tests without caching enabled is a little pointless (and would fail the tests).
Configuration menu - View commit details
-
Copy full SHA for 76b8cb9 - Browse repository at this point
Copy the full SHA 76b8cb9View commit details -
ControlStructures::getDeclareScopeOpenClose(): implement use of the n…
…ew `Cache` class As `declare` constructs using alternative syntax can be long, determining the scope opener/closer can involve a lot of token walking, which is why I'm implementing caching for it. Includes some minor tweaks to the exit routes of the function to ensure that the cache will always be set when the `T_DECLARE` token doesn't natively have a scope opener/closer assigned. Includes a dedicated test to verify the cache is used and working.
Configuration menu - View commit details
-
Copy full SHA for 5a5bce0 - Browse repository at this point
Copy the full SHA 5a5bce0View commit details -
FunctionDeclarations::getArrowFunctionOpenClose(): implement use of t…
…he new `Cache` class While arrow functions are generally only small snippets of code, as they don't always have a clear "end token", determining whether something is an arrow function and retrieving the relevant open/close tokens can be token-walking intensive, which is why I'm implementing caching for it. Note: the results will only be cached for the backported functionality. When using a more recent PHPCS version, the cache code will only be reached in the case of parse errors. Includes a dedicated test to verify the cache is used and working.
Configuration menu - View commit details
-
Copy full SHA for 88640db - Browse repository at this point
Copy the full SHA 88640dbView commit details -
Namespaces::findNamespacePtr(): implement use of the new
Cache
classThis method searches up in a file to try and find an applicable namespace declaration. As non-scoped namespace declarations are often at the top of the file, this can involve a **_lot_** of token walking, which is why I'm implementing caching for it. Includes some minor tweaks to the exit routes of the function to ensure that the cache will always be set when the token passed is not in a scoped namespace declaration. Includes a dedicated test to verify the cache is used and working.
Configuration menu - View commit details
-
Copy full SHA for 4924df8 - Browse repository at this point
Copy the full SHA 4924df8View commit details -
PassedParameters::getParameters(): implement use of the new
Cache
c……lass While most function calls only involve a few parameters, splitting out an array into the individual array items can be very processing intense and will slow things down considerably when multiple sniffs each need the break down of the same array. With this in mind, I'm implementing caching for it. The saved cache can be quite large for calls to this function, at the same time, the trade off performance-wise is worth it in this case IMO. Note: as this function can be called with a `$limit`, we need to be able to distinguish between "limited" results and "full" results, but should also take advantage of available "full" results when a consecutive function call tries to retrieve a "limited" result. The implementation takes this into account, though the situation where a "limited" result was previously retrieved (and cached), and new "limited" call is made with a _lower_ limit currently does not take full advantage of the available cache. This is possibly an improvement which can still be made in the future. Includes a set of dedicated tests to verify the cache is used and working, including testing specifically how the cache is set and used when the `$limit` parameter has been passed.
Configuration menu - View commit details
-
Copy full SHA for a27c2f8 - Browse repository at this point
Copy the full SHA a27c2f8View commit details -
TextStrings::getEndOfCompleteTextString(): implement use of the new `…
…Cache` class This method finds the end of a potentially multi-line text string. While most text strings are short and even multi-line ones are often only a few lines, some can be thousands of lines long. With that in mind, I'm implementing caching for this method. I've considered also applying caching for the `TextStrings::getCompleteTextString()` method, but as - in the case of thousands of lines long text - that would take a huge chunk of memory, I've decided against it. Caching the "end token" of a multi-line text string should sufficiently improve performance. Includes a dedicated test to verify the cache is used and working.
Configuration menu - View commit details
-
Copy full SHA for e5e8748 - Browse repository at this point
Copy the full SHA e5e8748View commit details -
UseStatements::splitImportUseStatement(): implement use of the new `C…
…ache` class Depending on whether or not group use or multi-use statements are used, this method can involve sufficient token walking to make caching relevant. Especially when keeping in mind that this function will likely be used a **_lot_** in the near future as part of the namespace resolution functionality, so retrieving the results via the cache instead of executing the same logic dozens of times for a file, seem prudent. Includes a dedicated test to verify the cache is used and working.
Configuration menu - View commit details
-
Copy full SHA for 4f301b9 - Browse repository at this point
Copy the full SHA 4f301b9View commit details -
Arrays::getDoubleArrowPtr(): implement use of the new
Cache
classWhile this function will generally be _fast_ for array entries _with_ a double arrow, it will be _slow_ for array entries without a double arrow, especially if the contents of the array item contains a lot of tokens as the fact that the array item does not have a double arrow can only be determined when the end of the array item has been reached. With this in mind, I'm implementing caching for it. Includes some minor tweaks to the exit routes of the function to ensure that the cache will always be set. Includes a dedicated test to verify the cache is used and working.
Configuration menu - View commit details
-
Copy full SHA for 4397a87 - Browse repository at this point
Copy the full SHA 4397a87View commit details -
Lists::getAssignments(): implement use of the new
Cache
classWhile most list only involve a few assignment, for more complex and nested list structures, splitting the list into the individual assignments can tax performance, which is why I'm implementing caching for it. Includes a dedicated test to verify the cache is used and working.
Configuration menu - View commit details
-
Copy full SHA for 87170bc - Browse repository at this point
Copy the full SHA 87170bcView commit details -
Arrays::isShortArray()/Lists::isShortList(): implement use of the new…
… `Cache` class These are easily the most used functions as well as the slowest functions (when dealing with large arrays/lists). While this commit already implements the use of the new `Cache` class, further improvements are still needed and will be pulled in a follow-up PR. Note: code coverage for these functions _may_ go down a little due to the multiple exit points in the functions. I'm not concerned about that as that - again - will be addressed in the follow-up PR. Includes a dedicated test to verify the cache is used and working.
Configuration menu - View commit details
-
Copy full SHA for 56e15f3 - Browse repository at this point
Copy the full SHA 56e15f3View commit details -
TextStrings::getStripEmbeds(): implement use of the new
NoFileCache
…… class Depending on the size of the text string, this function _could_ become pretty slow/performance intense, which is why I'm implementing caching for it. Includes a dedicated test to verify the cache is used and working.
Configuration menu - View commit details
-
Copy full SHA for ca49541 - Browse repository at this point
Copy the full SHA ca49541View commit details -
Tests/bootstrap: allow for running the tests with/without caching
This commit sets up a mechanism in the test `bootstrap.php` file to turn the cache on/off depending on an environment variable, which can be set from within a `phpunit.xml` file or on the OS-level. This allows for running the tests both with caching turned on, as well as with caching turned off. By default, the tests will run with caching turned **off**. Being able to run the tests with both settings will allow for: * [Caching off] Making sure that all code paths can be reached (code coverage check). Caching being enabled could prevent some code paths from being tested. * [Caching on] Making sure that caching does not (negatively) impact the actual results of the functions.
Configuration menu - View commit details
-
Copy full SHA for 7f6443b - Browse repository at this point
Copy the full SHA 7f6443bView commit details -
GH Actions: run the tests twice - once with cache, once without
Adjust the GH actions test workflows to run the complete test suite once with the cache turned on and once with the cache turned off. The test run with caching turned on will run the tests twice and only run the tests which don't need isolation. This should safeguard that the cache does not negatively influence sniff results. The code coverage job will (should) run with caching turned _off_ to prevent tests not reaching all code paths due to cached results from previous tests short-circuiting things. Note: the effect of caching on the test suite will be minimal as most tests will only execute a function once for a particular input/code snippet. Still good to safeguard/double-check though.
Configuration menu - View commit details
-
Copy full SHA for ecfef72 - Browse repository at this point
Copy the full SHA ecfef72View commit details