fix: make job pipeline robust against partial and transient failures #82

Merged
theis merged 1 commit from fix/job-pipeline-integrity into main 2026-08-23 14:49:21 +00:00
Owner
  • Validate streamed results before marking jobs completed: translation
    chunks must be contiguous and match the service-reported total, TTS
    segments must be contiguous, otherwise the job fails instead of
    silently storing truncated translations/audio.
  • Classify busy-lock and connection-refused service errors as transient
    and requeue with backoff (max 5 attempts) before failing the job.
  • Run the stale-running-job requeue sweep periodically instead of only
    at startup; raise the stale threshold above the HTTP timeout so live
    jobs are never swept.
  • Report real TTS progress (synthesized characters) during synthesis.
- Validate streamed results before marking jobs completed: translation chunks must be contiguous and match the service-reported total, TTS segments must be contiguous, otherwise the job fails instead of silently storing truncated translations/audio. - Classify busy-lock and connection-refused service errors as transient and requeue with backoff (max 5 attempts) before failing the job. - Run the stale-running-job requeue sweep periodically instead of only at startup; raise the stale threshold above the HTTP timeout so live jobs are never swept. - Report real TTS progress (synthesized characters) during synthesis.
fix: make job pipeline robust against partial and transient failures
Some checks failed
/ test-frontend (push) Successful in 34s
/ test-backend (push) Has been cancelled
6856c73199
- Validate streamed results before marking jobs completed: translation
  chunks must be contiguous and match the service-reported total, TTS
  segments must be contiguous, otherwise the job fails instead of
  silently storing truncated translations/audio.
- Classify busy-lock and connection-refused service errors as transient
  and requeue with backoff (max 5 attempts) before failing the job.
- Run the stale-running-job requeue sweep periodically instead of only
  at startup; raise the stale threshold above the HTTP timeout so live
  jobs are never swept.
- Report real TTS progress (synthesized characters) during synthesis.
theis force-pushed fix/job-pipeline-integrity from 6856c73199
Some checks failed
/ test-frontend (push) Successful in 34s
/ test-backend (push) Has been cancelled
to 604e802b61
All checks were successful
/ test-frontend (push) Successful in 1m2s
/ test-backend (push) Successful in 2m6s
2026-08-23 14:42:41 +00:00
Compare
theis merged commit 2297cf9a06 into main 2026-08-23 14:49:21 +00:00
theis deleted branch fix/job-pipeline-integrity 2026-08-23 14:49:21 +00:00
Sign in to join this conversation.
No reviewers
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
theis/webspeaker!82
No description provided.