-
Notifications
You must be signed in to change notification settings - Fork 106
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improved batch processing #37
Conversation
Basic improvements to the batch processor work now, specifically that chunking happens and so there is no real limit to the input list size. What's next:
From this I realized we can create an iterator-based batch function, so filed #38. The existing non-iterators can be refactored to reuse the iterator later by consuming all of the iterator at once before returning. |
chunking happens now; input list size limit doesnt exist.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ahmad//aa
Closes #33
Closes #35