Maybe the approach needs to be tried in reverse?

Start where there's too much data for a human to keep up, and then work backwards.

Always possible that what's going on is backwards already, and what's needed is more forward thinking ;)