Loading Hapax

List overview All Threads
Download

newer

older

Mooseless moose model

Hismo integration guide

Hernán Morales Durand

7 Aug 2011 7 Aug '11

9:22 a.m.

Hello, I know that Hapax possibly isn't fully ported to Pharo, but running the Hapax tests causes my Moose 4.5 image to hang (I've loaded everything in the SqS Hapax repository). What image and package loading order should one use to load Hapax? I'm interested in the information retrieval part for natural language analysis, could that part be repackaged in its own package? Cheers, Hernán

Show replies by date

Stéphane Ducasse

7 Aug 7 Aug

10:08 a.m.

I do not know but I would like to know the answer too. On Aug 7, 2011, at 9:22 AM, Hernán Morales Durand wrote:

...

Tudor Girba

1:11 p.m.

The port is indeed not complete. As far as I remember, the code was a simple brute force loading from VW and it is not expected to work. However, any work in this area would be highly interesting for Moose. Cheers, Doru On 7 Aug 2011, at 10:08, Stéphane Ducasse wrote:

...

I do not know but I would like to know the answer too. On Aug 7, 2011, at 9:22 AM, Hernán Morales Durand wrote:

_______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

-- www.tudorgirba.com "There are no old things, there are only old ways of looking at them."

Alexandre Bergel

4:16 p.m.

+1 Alexandre On Aug 7, 2011, at 7:11 AM, Tudor Girba <tudor(a)tudorgirba.com> wrote:

...

I do not know but I would like to know the answer too. On Aug 7, 2011, at 9:22 AM, Hernán Morales Durand wrote:

_______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

-- www.tudorgirba.com "There are no old things, there are only old ways of looking at them." _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Simon Denier

11:11 p.m.

On 7 août 2011, at 13:11, Tudor Girba wrote:

...

The port is indeed not complete. As far as I remember, the code was a simple brute force loading from VW and it is not expected to work.

Exactly. As said before, the basic things are well tested and already integrated in moose (like the stemming algo). Unfortunately, there are very few tests for the higher level stuff. Adrian told me that all this stuff was pretty much "work in progress" last time he touched: it's not clear what they do/what should be done now to make it work. And the area is quite complex so a complete rewrite from scratch might be necessary.

...

However, any work in this area would be highly interesting for Moose. Cheers, Doru On 7 Aug 2011, at 10:08, Stéphane Ducasse wrote:

I do not know but I would like to know the answer too. On Aug 7, 2011, at 9:22 AM, Hernán Morales Durand wrote:

_______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

-- Simon Denier

Gustavo Jansen

23 Oct 23 Oct

11:18 a.m.

So, for the time being, I'm working on the integration of Hapax in Moose4.8. Basically, some classes were doing old stuff or using classes that no longer exist Today Status: - Text Extraction is complete, using the example of Hernán ( link <http://moose-dev.97923.n3.nabble.com/Hapax-CodeFu-changes-and-example-script-td4025949.html> ) and using the Moose model - Some complex linear algebra functions are called to a C library via NativeBoost. We don't need to use ProcessWrapper to run in the operating system anymore. - Refactoring (adding documentation, porting some messages to other projects such as FileSystem or Algos-InformationRetrieval for example) To do: - Apply Hierachical Clustering - Visualization in Distribution Maps ( I figure both are already ported in other projects, right? ) - Tests!! (some of them are red and there is a lot to cover) - More Refactoring I have less than one month in RMoD, and I'm writing my dissertation, but I'll do my best here. Any sign of working in progress in these areas (clustering, visualization...) will be very helpful Best Regards - Gustavo Jansen -- View this message in context: http://moose-dev.97923.n3.nabble.com/Loading-Hapax-tp3232628p4029230.html Sent from the moose-dev mailing list archive at Nabble.com.

Alexandre Bergel

1 Nov 1 Nov

2:02 p.m.

Hi Gustavo, Just wondering how your work is going. Any news? Alexandre On Oct 23, 2013, at 6:18 AM, Gustavo Jansen <gugajansen(a)gmail.com> wrote:

...

-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

Gustavo Jansen

2:26 p.m.

Hi Alexandre, so far, it's going well. The visualization is *almost* complete, as you can see in the following image [ https://dl.dropboxusercontent.com/u/67114006/firstDistributionMap.png]. The properties of the Distribution Map are extracted from the vocabularies of each class (each color denotes a group of conceptually similar classes). There are other visualizations, so i took the one that is more related to my Master's study. After that, i need to refactor+test+document and also present the progress for RMoD plus: working with Distribution Map was very easy :-) - Gustavo Jansen On Fri, Nov 1, 2013 at 2:02 PM, Alexandre Bergel <alexandre.bergel(a)me.com>wrote;wrote:

...

Hi Gustavo, Just wondering how your work is going. Any news? Alexandre On Oct 23, 2013, at 6:18 AM, Gustavo Jansen <gugajansen(a)gmail.com> wrote:

So, for the time being, I'm working on the integration of Hapax in

Moose4.8.

Basically, some classes were doing old stuff or using classes that no

longer

exist Today Status: - Text Extraction is complete, using the example of Hernán ( link <

http://moose-dev.97923.n3.nabble.com/Hapax-CodeFu-changes-and-example-scrip…

) and using the Moose model - Some complex linear algebra functions are called to a C library via NativeBoost. We don't need to use ProcessWrapper to run in the operating system anymore. - Refactoring (adding documentation, porting some messages to other

projects

such as FileSystem or Algos-InformationRetrieval for example) To do: - Apply Hierachical Clustering - Visualization in Distribution Maps ( I figure both are already ported in other projects, right? ) - Tests!! (some of them are red and there is a lot to cover) - More Refactoring I have less than one month in RMoD, and I'm writing my dissertation, but I'll do my best here. Any sign of working in progress in these areas (clustering, visualization...) will be very helpful Best Regards - Gustavo Jansen -- View this message in context:

http://moose-dev.97923.n3.nabble.com/Loading-Hapax-tp3232628p4029230.html

Sent from the moose-dev mailing list archive at Nabble.com. _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Tudor Girba

2:32 p.m.

Hi Gustavo, This is good news. Just a thing: we should explicitly distinguish between the semantic analysis part and the visualization part. Where is your code? Would you agree to add it to the Moose team repository on StHub? Cheers, Doru On Fri, Nov 1, 2013 at 2:26 PM, Gustavo Jansen <gugajansen(a)gmail.com> wrote:

...

Hi Gustavo, Just wondering how your work is going. Any news? Alexandre On Oct 23, 2013, at 6:18 AM, Gustavo Jansen <gugajansen(a)gmail.com> wrote:

So, for the time being, I'm working on the integration of Hapax in

Moose4.8.

Basically, some classes were doing old stuff or using classes that no

longer

exist Today Status: - Text Extraction is complete, using the example of Hernán ( link <

http://moose-dev.97923.n3.nabble.com/Hapax-CodeFu-changes-and-example-scrip…

projects

http://moose-dev.97923.n3.nabble.com/Loading-Hapax-tp3232628p4029230.html

_______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

-- www.tudorgirba.com "Every thing has its own flow"

Alexandre Bergel

2:35 p.m.

Excellent! Let us know when you feel your code is ready to be checked by us Cheers, Alexandre On Nov 1, 2013, at 10:26 AM, Gustavo Jansen <gugajansen(a)gmail.com> wrote:

...

Hi Alexandre, so far, it's going well. The visualization is *almost* complete, as you can see in the following image [https://dl.dropboxusercontent.com/u/67114006/firstDistributionMap.png]. The properties of the Distribution Map are extracted from the vocabularies of each class (each color denotes a group of conceptually similar classes). There are other visualizations, so i took the one that is more related to my Master's study. After that, i need to refactor+test+document and also present the progress for RMoD plus: working with Distribution Map was very easy :-) - Gustavo Jansen On Fri, Nov 1, 2013 at 2:02 PM, Alexandre Bergel <alexandre.bergel(a)me.com> wrote: Hi Gustavo, Just wondering how your work is going. Any news? Alexandre On Oct 23, 2013, at 6:18 AM, Gustavo Jansen <gugajansen(a)gmail.com> wrote:

-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;.

Gustavo Jansen

3:32 p.m.

Hi everybody, Doru, it's good that you're pointing this, because i'm separating these interests. It was somehow entangled in the old code. Basically, I'm working with old projects Hapax<http://www.squeaksource.com/Hapax.html>and BioSmalltalk <http://ss3.gemstone.com/ss/BioSmalltalk.html>, both in SqueakSource. What i did was to refactor some legacy code and create a class to play with the Moose Model Both, my code is currently local because it's not stable (few tests, most of them red etc.). But i'll sure add it to StHub in the next weeks. - Gustavo Jansen On Fri, Nov 1, 2013 at 2:35 PM, Alexandre Bergel <alexandre.bergel(a)me.com>wrote;wrote:

...

Excellent! Let us know when you feel your code is ready to be checked by us Cheers, Alexandre On Nov 1, 2013, at 10:26 AM, Gustavo Jansen <gugajansen(a)gmail.com> wrote:

Hi Alexandre, so far, it's going well. The visualization is *almost* complete, as you

can see in the following image [ https://dl.dropboxusercontent.com/u/67114006/firstDistributionMap.png]. The properties of the Distribution Map are extracted from the vocabularies of each class (each color denotes a group of conceptually similar classes). There are other visualizations, so i took the one that is more related to my Master's study.

After that, i need to refactor+test+document and also present the

progress for RMoD

plus: working with Distribution Map was very easy :-) - Gustavo Jansen On Fri, Nov 1, 2013 at 2:02 PM, Alexandre Bergel <

alexandre.bergel(a)me.com> wrote:

Hi Gustavo, Just wondering how your work is going. Any news? Alexandre On Oct 23, 2013, at 6:18 AM, Gustavo Jansen <gugajansen(a)gmail.com>

wrote:

> So, for the time being, I'm working on the integration of Hapax in

Moose4.8.

> Basically, some classes were doing old stuff or using classes that no

longer

> exist > > Today Status: > - Text Extraction is complete, using the example of Hernán ( link > <

http://moose-dev.97923.n3.nabble.com/Hapax-CodeFu-changes-and-example-scrip…

> ) and using the Moose model > - Some complex linear algebra functions are called to a C library via > NativeBoost. We don't need to use ProcessWrapper to run in the

operating

> system anymore. > - Refactoring (adding documentation, porting some messages to other

projects

> such as FileSystem or Algos-InformationRetrieval for example) > > To do: > - Apply Hierachical Clustering > - Visualization in Distribution Maps > ( I figure both are already ported in other projects, right? ) > - Tests!! (some of them are red and there is a lot to cover) > - More Refactoring > > I have less than one month in RMoD, and I'm writing my dissertation,

but

> I'll do my best here. > Any sign of working in progress in these areas (clustering, > visualization...) will be very helpful > > Best Regards > - > Gustavo Jansen > > > > -- > View this message in context:

http://moose-dev.97923.n3.nabble.com/Loading-Hapax-tp3232628p4029230.html

Hernán Morales Durand

6 Nov 6 Nov

4:14 a.m.

Hi Gustavo, Please notice I have migrated BioSmalltalk and latest code is in SmalltalkHub now. http://www.smalltalkhub.com/#!/~hernan/BioSmalltalk It contains some Hapax code which I wrote for tf-idf script. Cheers, Hernán El 01/11/2013 11:32, Gustavo Jansen escribió:

...

Hi everybody, Doru, it's good that you're pointing this, because i'm separating these interests. It was somehow entangled in the old code. Basically, I'm working with old projects Hapax <http://www.squeaksource.com/Hapax.html> and BioSmalltalk <http://ss3.gemstone.com/ss/BioSmalltalk.html>, both in SqueakSource. What i did was to refactor some legacy code and create a class to play with the Moose Model Both, my code is currently local because it's not stable (few tests, most of them red etc.). But i'll sure add it to StHub in the next weeks. - Gustavo Jansen On Fri, Nov 1, 2013 at 2:35 PM, Alexandre Bergel <alexandre.bergel(a)me.com <mailto:alexandre.bergel@me.com>> wrote: Excellent! Let us know when you feel your code is ready to be checked by us Cheers, Alexandre On Nov 1, 2013, at 10:26 AM, Gustavo Jansen <gugajansen(a)gmail.com <mailto:gugajansen@gmail.com>> wrote:

Hi Alexandre, so far, it's going well. The visualization is *almost* complete,

as you can see in the following image [https://dl.dropboxusercontent.com/u/67114006/firstDistributionMap.png]. The properties of the Distribution Map are extracted from the vocabularies of each class (each color denotes a group of conceptually similar classes). There are other visualizations, so i took the one that is more related to my Master's study.

After that, i need to refactor+test+document and also present the

progress for RMoD

plus: working with Distribution Map was very easy :-) - Gustavo Jansen On Fri, Nov 1, 2013 at 2:02 PM, Alexandre Bergel

<alexandre.bergel(a)me.com <mailto:alexandre.bergel@me.com>> wrote:

Hi Gustavo, Just wondering how your work is going. Any news? Alexandre On Oct 23, 2013, at 6:18 AM, Gustavo Jansen <gugajansen(a)gmail.com

<mailto:gugajansen@gmail.com>> wrote:

> So, for the time being, I'm working on the integration of Hapax

in Moose4.8.

> Basically, some classes were doing old stuff or using classes

that no longer

> exist > > Today Status: > - Text Extraction is complete, using the example of Hernán ( link >

<http://moose-dev.97923.n3.nabble.com/Hapax-CodeFu-changes-and-example-script-td4025949.html>

> ) and using the Moose model > - Some complex linear algebra functions are called to a C

library via

> NativeBoost. We don't need to use ProcessWrapper to run in the

operating

> system anymore. > - Refactoring (adding documentation, porting some messages to

other projects

dissertation, but

http://moose-dev.97923.n3.nabble.com/Loading-Hapax-tp3232628p4029230.html

Sent from the moose-dev mailing list archive at Nabble.com. _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch <mailto:Moose-dev@iam.unibe.ch> https://www.iam.unibe.ch/mailman/listinfo/moose-dev

-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch <mailto:Moose-dev@iam.unibe.ch> https://www.iam.unibe.ch/mailman/listinfo/moose-dev _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch <mailto:Moose-dev@iam.unibe.ch> https://www.iam.unibe.ch/mailman/listinfo/moose-dev

-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch <mailto:Moose-dev@iam.unibe.ch> https://www.iam.unibe.ch/mailman/listinfo/moose-dev _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

Gustavo Jansen

4:17 p.m.

Hi Hernán, that's good. I will see the changes and integrate them. I had to change the whole SVDProcess when integrating with Moose. I also put the project in SmalltalkHub [ http://www.smalltalkhub.com/#!/~GustavoSantos/Hapax]. I'm still running tests and refactoring, so it is not stable yet. It was just an initial commit. -- Gustavo Jansen On Wed, Nov 6, 2013 at 4:14 AM, Hernán Morales Durand < hernan.morales(a)gmail.com> wrote:

...

Hi everybody, Doru, it's good that you're pointing this, because i'm separating these interests. It was somehow entangled in the old code. Basically, I'm working with old projects Hapax <http://www.squeaksource.com/Hapax.html> and BioSmalltalk <http://ss3.gemstone.com/ss/BioSmalltalk.html>, both in SqueakSource. What i did was to refactor some legacy code and create a class to play with the Moose Model Both, my code is currently local because it's not stable (few tests, most of them red etc.). But i'll sure add it to StHub in the next weeks. - Gustavo Jansen On Fri, Nov 1, 2013 at 2:35 PM, Alexandre Bergel <alexandre.bergel(a)me.com <mailto:alexandre.bergel@me.com>> wrote: Excellent! Let us know when you feel your code is ready to be checked by us Cheers, Alexandre On Nov 1, 2013, at 10:26 AM, Gustavo Jansen <gugajansen(a)gmail.com <mailto:gugajansen@gmail.com>> wrote:

Hi Alexandre, so far, it's going well. The visualization is *almost* complete,

as you can see in the following image [https://dl.dropboxusercontent.com/u/67114006/firstDistributionMap. png]. The properties of the Distribution Map are extracted from the vocabularies of each class (each color denotes a group of conceptually similar classes). There are other visualizations, so i took the one that is more related to my Master's study.

After that, i need to refactor+test+document and also present the

progress for RMoD

plus: working with Distribution Map was very easy :-) - Gustavo Jansen On Fri, Nov 1, 2013 at 2:02 PM, Alexandre Bergel

<alexandre.bergel(a)me.com <mailto:alexandre.bergel@me.com>> wrote:

Hi Gustavo, Just wondering how your work is going. Any news? Alexandre On Oct 23, 2013, at 6:18 AM, Gustavo Jansen <gugajansen(a)gmail.com

<mailto:gugajansen@gmail.com>> wrote:

> So, for the time being, I'm working on the integration of Hapax

in Moose4.8.

> Basically, some classes were doing old stuff or using classes

that no longer

> exist > > Today Status: > - Text Extraction is complete, using the example of Hernán ( link >

<http://moose-dev.97923.n3.nabble.com/Hapax-CodeFu- changes-and-example-script-td4025949.html>

> ) and using the Moose model > - Some complex linear algebra functions are called to a C

library via

> NativeBoost. We don't need to use ProcessWrapper to run in the

operating

> system anymore. > - Refactoring (adding documentation, porting some messages to

other projects

dissertation, but

http://moose-dev.97923.n3.nabble.com/Loading-Hapax- tp3232628p4029230.html

> Sent from the moose-dev mailing list archive at Nabble.com. > > _______________________________________________ > Moose-dev mailing list > Moose-dev(a)iam.unibe.ch <mailto:Moose-dev@iam.unibe.ch>

https://www.iam.unibe.ch/mailman/listinfo/moose-dev

https://www.iam.unibe.ch/mailman/listinfo/moose-dev _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch <mailto:Moose-dev@iam.unibe.ch>

https://www.iam.unibe.ch/mailman/listinfo/moose-dev

-- _,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;: Alexandre Bergel http://www.bergel.eu ^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;._,.;:~^~:;. _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch <mailto:Moose-dev@iam.unibe.ch> https://www.iam.unibe.ch/mailman/listinfo/moose-dev _______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

_______________________________________________ Moose-dev mailing list Moose-dev(a)iam.unibe.ch https://www.iam.unibe.ch/mailman/listinfo/moose-dev

4063

days inactive

4885

days old

moose-dev@list.inf.unibe.ch

Manage subscription

12 comments

6 participants

tags (0)

participants (6)

Alexandre Bergel
Gustavo Jansen
Hernán Morales Durand
Simon Denier
Stéphane Ducasse
Tudor Girba