Add custom function for filtering cached arguments. #1

andreip · 2018-01-03T16:08:34Z

Adds ability to only use certain fields as cache key.

andreip · 2018-01-03T19:09:03Z

^ huh, that's unexpected. On local I get FAILED (failures=4) when running python setup.py test.

tommikaikkonen

Left a monster comment discussing the API we want for this.

tommikaikkonen · 2018-01-04T02:01:36Z

cache_utils/decorators.py

@@ -11,7 +11,8 @@
 logger = logging.getLogger("cache_utils")


-def cached(timeout, group=None, backend=None, key=None):
+def cached(timeout, group=None, backend=None, key=None,
+           filter_args_kwargs=None):


This is a very useful feature 💯 I have some opinions about the API for this, let me know your thoughts!

The goal here is to allow the user to modify the cache key for each call, right? filter_args_kwargs as a concept seems slightly too restrictive than it needs to be: we may also want to transform them. (Or if you want to live dangerously, add something new to the key, like a mutable global variable )

Further, the return value doesn't have to be in the args & kwargs, tuple and dict form—we just need a serializable value we can use as a cache key. I think the simplest interface would be a function that maps arguments to any Python value that may be serialized to a concrete cache key.

I would separate out the following things and allow the user to customize each:

Calculating the function cache key (the prefix)

Based on function arguments on a single call, determine the unserialized cache key value

Serializing cache key value above (JSON? Pickle? hash? django-cache-utils casts to string)

Calculating the function cache key

The generated function key in django-cache-utils is something like cacheable_scrape_article[cached]:431. We may want to make the key kwarg accept a callable to facilitate this, e.g.

@cached(..., key=lambda fn: f'{fn.__name__}_version_1')

That would allow the default value of key to be the function that returns cacheable_scrape_article[cached]:431 based on the function.

Determining the cache key for a single call

Specifying the cache key for a call would be facilitated with a keyword argument similar to filter_args_kwargs; I think the most intuitive kwarg name would be key, but that is already used for the function key. Without having to think about backwards compatibility, I would rename key to fn_key and have the call cache key function specified in key.

Serializing the key value for a call

Now that we have the key (Python) value for a call, we can use the user-specified serializer to turn it into a key value usable by the cache backend. django-cache-utils uses a simple string cast, but I think JSON/pickle would be more robust. Then the whole cache key would be serialize(fn_key(fn)) + serialize(call_key(*args, **kwargs))

Obviously we don't need to make all these changes at once, but it would be useful to have a consistent, robust API in mind as we make improvements.

I agree that renaming key to fn_key and making it a callable with the default work as is now would be nice.

Also now that key is free, we can use that for computing the paramters to a python value, I wanted to use that but was taken.

Lastly, I guess a nice to have would be to add other serialization methods, yep. But this isn't an immediate option to use since we use cached in a bunch of places and changing this to sth other than the _args_to_unicode with prefix [cached] would be equivalent to invalidating all our cache. We could start using different serialization protocols for new code though.

I've changed the code to support this. At first I was hesitant to do too many changes and the odd implementation from before encouraged hacks. I like your idea with splitting the args and the function conversion to serializables and using those. I just used str for now, I didn't look much into what the final output needs to be so memcached/group_backend.py etc. related code would accept it. Moreover, kept backwards compatibility so our old cache is hit with this update. Let me know what you think and if you spot any issues 👍 .

tommikaikkonen · 2018-01-04T02:02:42Z

cache_utils/utils.py

    """ Construct readable cache key """
+    if filter_args_kwargs and inspect.isfunction(filter_args_kwargs):


Does callable work here?

I guess that's less restrictive, we can go with that.

tommikaikkonen · 2018-01-04T02:16:52Z

cache_utils/decorators.py

+                        and returns the new args and kwargs. Those are
+                        combined with function name to get the final key.
+        E.g.
+            def filter_args_kwargs(args, kwargs):


I had some discussion about filter_arg_kwargs(args, kwargs) versus filter_args_kwargs(*args, **kwargs) in my other comment, but now I see that this code comment was just outdated and that the actual implementation is like filter_args_kwargs(*args, **kwargs) which I think is the better choice. I removed that discussion from my other comment.

andreip · 2018-01-04T15:51:15Z

^ tests don't work well for me, I think because I don't have memcached setup locally. Not sure if on circleCI it worked or not, but now seems some tests fail, so might have worked, idk.

Nevertheless, should sort out the tests thing before merging this in. I'm not sure if all tests passed beforehand since some were failing for me because I don't have memcached running. Putting below which ones failed for me in master probably due to not running memcached on local.

======================================================================
FAIL: test_decorator (cache_utils.tests.DecoratorTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/andrei/repos/upbeat/django-cache-utils/cache_utils/tests.py", line 161, in test_decorator
    self.assertEqual(my_func(), "1")
AssertionError: '2' != '1'
- 2
+ 1


======================================================================
FAIL: test_func_invalidation (cache_utils.tests.InvalidationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/andrei/repos/upbeat/django-cache-utils/cache_utils/tests.py", line 119, in test_func_invalidation
    self.assertEqual(my_func(1, 2), 1)
AssertionError: 2 != 1

======================================================================
FAIL: test_group_invalidation (cache_utils.tests.InvalidationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/andrei/repos/upbeat/django-cache-utils/cache_utils/tests.py", line 98, in test_group_invalidation
    self.assertEqual(cache.get('vasia', group='names'), 'foo')
AssertionError: None != 'foo'

======================================================================
FAIL: test_method_invalidation (cache_utils.tests.InvalidationTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/andrei/repos/upbeat/django-cache-utils/cache_utils/tests.py", line 139, in test_method_invalidation
    self.assertEqual(foo.bar(1), 1)
AssertionError: 2 != 1

…p.py

…m default key, provide legacy key and fn_key functions to allow cache key compatibility with previous versions

tommikaikkonen

Made the following changes:

Removed support for decorating methods
Improved fn_key: omitted line number, used __qualname__ instead of __name__ (is there a case we would still need the line number?)
Simplified the default implementation for key not to consider serialization

Added legacy_fn_key and legacy_key to remain compatible with previous cache key generation, added a test for that. Usage would be like this:

from cache_utils import cached, legacy_fn_key, legacy_key

@cached(3600, fn_key=legacy_fn_key, key=legacy_key)
def foo(...):
    ...

andreip

I like that you simplified the code even more and kept an option for the legacy way of doing it. We probably will be using those ourselves for old code.

See the only question with None I had below. Otherwise I think we can merge this in.

andreip · 2018-01-05T14:18:42Z

cache_utils/decorators.py

@@ -46,16 +71,26 @@ def test(*args, **kwargs):
        cache_backend = caches['default']

    def _cached(func):
-        func_type = _func_type(func)
+        fn_key_str = str(


this could become str(None) = "None" (if you explicitly pass fn_key=None for any reason) and then it wouldn't raise an error below.

Do you think we should maybe also add an if above for fn_key to not be falsy? Or if a user provides an argument, then maybe they check docs? But there aren't any, so the code in this case.

Great catch! We can make a hard requirement for fn_key to either be a callable or a str, and the result of a callable fn_key to be a str to remove the str casting. If these requirements fail, we raise an exception. This should avoid any unexpected behavior.

andreip · 2018-01-05T14:28:16Z

cache_utils/decorators.py

+
+
+def default_fn_key(func):
+    return ".".join([func.__module__, func.__qualname__])


I like this, didn't like lineno either, and qualname is better. But I suppose we'll have to make sure to keep on using the legacy ones for the caches we've already set up.

andreip · 2018-01-05T14:32:32Z

cache_utils/decorators.py

            # try to get the value from cache
-            key = _get_key(wrapper._full_name, func_type, args, kwargs)
+            key = _get_key(*args, **kwargs)


👍

also, makes perfect sense to move all the _get_key and fn_key_str computations inside the _cached context, since we have the function and can drop one param.

tommikaikkonen · 2018-01-05T20:06:34Z

Re: setting up memcached locally and getting the tests to run, this is all I had to do:

brew install libmemcached
brew services start memcached

andreip added 2 commits January 3, 2018 18:06

Add custom function for filtering cached arguments.

3a8b101

Pass *args, **kwargs expanded to filter function, for easier work w/ it.

083c8d8

andreip added the needs review label Jan 3, 2018

andreip added 2 commits January 3, 2018 20:33

Update circle.yml

f8ae1fb

Remove tox setup.

e6506b8

tommikaikkonen reviewed Jan 4, 2018

View reviewed changes

andreip added 4 commits January 4, 2018 17:13

Refactor to add key,fn_key to @cached. Simplified logic.

e170fab

Remove now unused full_name.

e97c915

Remove unused code, update func_info to receive *args instead of args.

8e7e327

Add redis backend in setup.py.

e80f109

tommikaikkonen added 4 commits January 4, 2018 15:00

Install test dependencies in circle.yml, define tests_require in setu…

c2637c8

…p.py

Remove support for decorating methods, remove function linenumber fro…

432d924

…m default key, provide legacy key and fn_key functions to allow cache key compatibility with previous versions

Fix test

5a30113

Use smart_text in legacy_key instead of serialize

5a30722

tommikaikkonen reviewed Jan 5, 2018

View reviewed changes

Remove now unused classes.

5c33d03

andreip commented Jan 5, 2018

View reviewed changes

Require the resulting fn_key to be a str, throw an exception otherwise

e628801

tommikaikkonen merged commit 031b162 into master Jan 5, 2018

tommikaikkonen deleted the feature/filter_cached_arguments branch January 5, 2018 20:11

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add custom function for filtering cached arguments. #1

Add custom function for filtering cached arguments. #1

andreip commented Jan 3, 2018

andreip commented Jan 3, 2018 •

edited

Loading

tommikaikkonen left a comment

tommikaikkonen Jan 4, 2018 •

edited

Loading

andreip Jan 4, 2018 •

edited

Loading

tommikaikkonen Jan 4, 2018

andreip Jan 4, 2018

tommikaikkonen Jan 4, 2018

andreip commented Jan 4, 2018

tommikaikkonen left a comment

andreip left a comment •

edited

Loading

andreip Jan 5, 2018

tommikaikkonen Jan 5, 2018

andreip Jan 5, 2018

andreip Jan 5, 2018

tommikaikkonen commented Jan 5, 2018

		""" Construct readable cache key """
		if filter_args_kwargs and inspect.isfunction(filter_args_kwargs):



		def default_fn_key(func):
		return ".".join([func.__module__, func.__qualname__])

Add custom function for filtering cached arguments. #1

Add custom function for filtering cached arguments. #1

Conversation

andreip commented Jan 3, 2018

andreip commented Jan 3, 2018 • edited Loading

tommikaikkonen left a comment

Choose a reason for hiding this comment

tommikaikkonen Jan 4, 2018 • edited Loading

Choose a reason for hiding this comment

andreip Jan 4, 2018 • edited Loading

Choose a reason for hiding this comment

tommikaikkonen Jan 4, 2018

Choose a reason for hiding this comment

andreip Jan 4, 2018

Choose a reason for hiding this comment

tommikaikkonen Jan 4, 2018

Choose a reason for hiding this comment

andreip commented Jan 4, 2018

tommikaikkonen left a comment

Choose a reason for hiding this comment

andreip left a comment • edited Loading

Choose a reason for hiding this comment

andreip Jan 5, 2018

Choose a reason for hiding this comment

tommikaikkonen Jan 5, 2018

Choose a reason for hiding this comment

andreip Jan 5, 2018

Choose a reason for hiding this comment

andreip Jan 5, 2018

Choose a reason for hiding this comment

tommikaikkonen commented Jan 5, 2018

andreip commented Jan 3, 2018 •

edited

Loading

tommikaikkonen Jan 4, 2018 •

edited

Loading

andreip Jan 4, 2018 •

edited

Loading

andreip left a comment •

edited

Loading