MetaCPAN running really well. Thanks!
I don't know everyone who is involved in maintaining MetaCPAN and I don't know all the details of the performance related issues that have been an ongoing challenge (I believe they have been related to relentless bots?).
In any case, this last week MetaCPAN seems to have been running flawlessly!
So rather than burying a thanks note in a github issue, I wanted to put a public thanks here to all the volunteers and sponsors that keep MetaCPAN (and CPAN) running.
I blog about Perl. I am now in California
Fastly ftw
Hi Dean,
You are welcome - if anyone is interested most of the work was documented at https://github.com/metacpan/metacpan-k8s/issues/154
And the biggest win was enabling Dynamic Challenge detection with Fastly (who kindly gave us this service along with a whole load of other resources), all the other mitigations helped but didn't stop the very odd spikes in scraping which we were seeing.
I'd also like to mention DataDog as they gave us a place to send all our logs so we could actually see the problem patterns... we've setup a public dashboard at:
https://p.datadoghq.eu/sb/c2941b7b-37bb-11f0-94e3-32bf19abf102-744ae84f98611bfd6781365a482e2155