optimize batch aggregation

[aniketmaurya]

Before submitting

• Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
• Did you read the contributor guideline, Pull Request section?
• Did you make sure to update the docs?
• Did you write any new necessary tests?

What does this PR do?

Make the requests Queue timeout auto adjustable with remaining time for aggregation.

uid = request_queue.get(timeout=0.001) ----> User might choose a lower batch_timeout and this line won't respect that.

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in GitHub issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

[codecov]

Codecov Report

Attention: Patch coverage is 75.00000% with 3 lines in your changes missing coverage. Please review.

Project coverage is 79%. Comparing base (5f7c2f0) to head (3e388d2).

Additional details and impacted files

@@         Coverage Diff         @@
##           main   #147   +/-   ##
===================================
- Coverage    79%    79%   -0%     
===================================
  Files        13     13           
  Lines       925    931    +6     
===================================
+ Hits        729    733    +4     
- Misses      196    198    +2     

[lantiga]

Looks good. Please add a before vs after perf comparison to the description of these optimization PRs.

[aniketmaurya]

this one doesn't bring a visible performance gain but more like better way to handle timeout. I will put perf comparisons for PRs with visible perf gains.