LOADING…
0%
Complete changelog

Commit

perf: Optimize worker pool and queue concurrency for 32 vCPU

Commit details

Commit notes

- Worker pool now uses ~75% of available CPUs on high-CPU servers (24 workers on 32 vCPU) - Added environment variable overrides for fine-tuning: - ANALYSIS_POOL_SIZE: Override worker pool size - ANALYSIS_QUEUE_CONCURRENCY: Analysis queue workers (default: 16) - PROCESSING_QUEUE_CONCURRENCY: Audio processing workers (default: 10) - GUEST_QUEUE_CONCURRENCY: Guest sample workers (default: 12) - ASSEMBLY_QUEUE_CONCURRENCY: Chunk assembly workers (default: 8) - Increased max queue size to 5000 for high-throughput scenarios - Reduced block timeout for faster job pickup

On 32 vCPU Railway: - Worker pool: 24 parallel analysis workers - Combined queue concurrency: 46 concurrent jobs - Estimated throughput: 100+ samples/minute

Co-authored-by: armin.naimi <[email redacted]>

Files changed
2
Lines added
+55
Lines removed
−13
This page is a permanent record of commit a47785a5.