Getting CPAN module tarball from local MiniCPAN mirror

This blog post is just for sharing a simple script.

Like many Perl programmers, I have a mini CPAN mirror locally on my hard drive (I put mine in /cpan). Aside from installing CPAN modules offline using cpanminus, I also sometimes want to peek into a dist's files (especially the contents of the t/). So what's a quick way to get the path of a module's tarball, or to extract it?

Normally cpanminus can do this, via cpanm --mirror /cpan --mirror-only --look Module::Name, but it doesn't work on my setup (both on the PC and laptop). So I turn to CPAN.

There are at least three libraries on CPAN that deal with this. Parse::CPAN::Packages is a huge library that does many things, but is very heavy on startup (loads 110k+ source code lines and over 300 files, takes 0.5s just to load the module on my laptop). To get the path of a single module requires almost 8s!

Apparently the heaviness of Parse::CPAN::Packages annoyed Slaven Rezic enough that he wrote Parse::CPAN::Packages::Fast (he said that initializing Parse::CPAN::Packages alone takes 10s(!) on his system :-) ). But I find that on my laptop it still takes an average of about 2s to get the path of a module using this library.

Then there's Neil Bowers' . But the interface of his module is not great for my use case. First you need to download via HTTP from www.cpan.org first, because you can't directly feed a local 02packages.details.txt(.gz).

I ended up writing a script that opens 02packages.details.txt.gz with zcat using Perl's "unsafe" 2-param open(), parses it line by line, and exits immediately after finding a match. Depending on the listing position of the module you want to search in 02packages.details.txt.gz, the script takes on average about 0.25s on my laptop. I'm happy again.

To get a tarball path:

% get-tarball-path-from-local-cpan Module::Path
/cpan/authors/id/N/NE/NEILB/Module-Path-0.13.tar.gz

To extract:

% tar xfz `get-tarball-path-from-local-cpan Module::Path`

Leave a comment

About Steven Haryanto

user-pic A programmer (mostly Perl 5 nowadays). My CPAN ID: SHARYANTO. I'm sedusedan on perlmonks. My twitter is stevenharyanto (but I don't tweet much). Follow me on github: sharyanto.