but to do so at a scale that will work for VERY large datasets requires ensuring that we can minimize the amount of work necessary to build and update that cache