Event details
All Things Performance!
P99 CONF is for developers who care about P99 percentiles and high-performance, low-latency applications, organized by ScyllaDB.
This year, Joe Zhou (DevRel @JuiceFS) will present the talk "Managing 500 Billion+ Files for AI Workloads."
Even a proven distributed file system faces extreme challenges at the AI training scale. This talk explores how to manage over 500 billion files in a single volume, optimizing for critical AI scenarios like:
- Large-file sequential reads (model loading): Breaking single-thread FUSE bandwidth limits to reach 70+ GB/s via multi-threading and distributed caching.
- Massive small files (computer vision): Turning metadata IOPS bottlenecks into linear scalability.
- High-concurrency random reads (sample-based loading): Boosting from 7,000 to 20,000+ IOPS by shifting from cold object storage to warm cache.
Learn the architecture and practical tuning strategies that perfect the last mile of AI data access. This is P99 CONF, so we know that there's always room for optimization, and don't let the GPUs starve.
Register now for free, and we hope to see you there!
