On the eve of CPAN Testers

Have a look at the CPAN Testers reports for two TRIAL releases of the same module, one from 2 days ago, the other a little over 3 years ago:

Last time, reports started coming in within hours of the release; over 60% of the picture was there within a day; some 85% after 2 days; and the first wave of reports lasted a week.

This time, it took almost a day to even start getting reports, and the diversity has been much lower. 3 days in, reports are still absent for many platforms:

  • None for NetBSD, almost none for OpenBSD.
  • Only a handful for Solaris (but I’ll admit to small surprise about that one).
  • Windows is sparse – although coverage is not notably down relative to last time.
  • Cygwin is entirely absent this time – but not a big difference from the one lone report it had last time.
  • FreeBSD and Linux are at least healthy – but no longer anywhere near comprehensively covered. (How’s that for something I’d never have expected to see?)
  • Who’da thunk the best-covered platform would someday be… Darwin?

(Also of note is that the only 5.8 tested at all so far is 5.8.9, a maintenance release from long after 5.10.0 with little real-world relevance. Last time 5.8 had good coverage, including the most important releases (5.8.1; 5.8.5; 5.8.8). (Of course, any 5.8 is better than no 5.8 at all.))

Within just a few years, we are severely down on CPAN Testers resources.

And that’s compared to 2018, which already was a long way from any kind of golden age for CPAN Testers.

CPAN Testers is on its way out.

I never bothered with CI for CPAN modules before but now it seems an unavoidable necessity.

(And common CI products have never made broad platform coverage easy…)


I've found CPAN Testers to be extremely helpful lately in troubleshooting a new distribution that I've been working on.

Many thanks to everyone involved in the CPAN Testers ecosystem for continuing to keep this valuable resource online and useful.

Within just a few years, we are severely down on CPAN Testers resources.

So, let's get concrete. What steps are you proposing or personally taking to improve the situation?

Aristotle wrote: "Has it prompted you? You asked what I am proposing to fix this. Well, do you come into the picture anywhere?

Yes, it has. When I set up a new virtual machine (which I do via vagrant, I now include Task::CPAN::Reporter among the CPAN modules to be installed at the outset. That way, any CPAN distro I subsequently install gets a test report without my having to think about it.

Earlier this year I assumed co-maintenance of Devel-NYTProf. I made extensive use of CPANtesters reports in determining whether my revisions were sufficiently acceptable or not.

So where can I RTFM on how to set up a smoker?

So where can I RTFM on how to set up a smoker?

cpan Task::CPAN::Reporter

Thanks, I've set up a reporter on my local CPAN client. That's the least I can do, but maybe I'll set up something automated when I have more time

Leave a comment

About Aristotle

user-pic Waxing philosophical