backendconcurrency
A cache stampede is a concurrency problem
Anonymous
When many requests miss the same expired key, they can all start the same expensive work. A per-key single-flight mechanism lets one request compute the value while the others wait. Keep the waiting behavior bounded so a slow computation does not pile up requests indefinitely.
0