chunking for json normalization

[kbuma]

Summary

Collections such as materials have end up with over 4 million columns if the whole collection is json normalized. Attempting to process collections like this caused a memory error.

Solution is to chunk and then normalize and filter that chunk, then pull all those filtered chunks together.

Checklist

• Google format doc strings added.
• Code linted with ruff. (For guidance in fixing rule violates, see rule list)
• Type annotations included. Check with mypy.
• Tests added for new features/fixes.
• I have run the tests locally and they passed.