On 23 mei 2014, at 15:43, Alexandre Bergel alexandre.bergel@me.com wrote:
As you know, the moose team is full of passionated and happy people willing to analyze software. We have great platforms to carry out analysis that are robust enough to compete with state-of-the-Art software analysis platforms out there.
It would be great to have software to feed our wonderful tools. There are 123 873 packages on Smalltalkhub (!). Can we have easily access to them? I mean, a big big big .zip file would be fantastic with all the public software.
Well yes. DeprecationFinder on smalltalkhub has most of what you need. It is missing the teams as an entry point, though. If you want to find out the interface to smalltalkhub, there is the smalltalkhub ci image on pharo-contributions. DeprecationFinder only loads the latest versions of packages, but that is a trivial extension.
I'm not sure how much rate-limiting is needed, but you should *not* run without rate-limiting. You touch the whole database, so not only is there copying from mongo to pharo input buffer to pharo output buffer going on, but most of the pages containing older versions of packages will be swapped out to disk.
You might want to consider just creating a local mirror of smalltalkhub. It seems to be easy to set up.
Stephan