Repository navigation
Batch processing: enable fast mode #1328
Description
Is your feature request related to a problem?
Batch runs through the provider batch APIs are slow for small submissions, causing delays in processing.
Describe the solution you'd like
- Add an optional
modeon list input:batch(default) orfast; includeFASTinassessment.method. - Implement direct per-row provider calls using a thread pool with a concurrency setting; limit to about 10 rows (
ASSESSMENT_FAST_MAX_ROWS), return 422 for exceeding the cap. - Ensure the same result shape, storage, and callback as batch; build on the RESPONSE request path.
Original issue
Context
Batch runs go through the provider batch APIs, which is slow for small submissions.
Scope
- Optional
modeon list input:batch(default) orfast;FASTadded toassessment.method. - Direct per-row provider calls with a thread pool (concurrency setting); row cap of about 10 (
ASSESSMENT_FAST_MAX_ROWS), 422 above the cap. - Same result shape, storage and callback as batch; builds on the RESPONSE request path.
Metadata
Metadata
Assignees
Labels
Type
Projects
- Status
Activity
[-]Assessment: Add FAST mode[/-][+]Batch Processing: Improve submission speed[/+][-]Batch Processing: Improve submission speed[/-][+]Batch processing: enable fast mode[/+]