Ciao-users December 2001

ciao-users@cliplab.org

11 participants
17 discussions

Re: Database and memory limitations
by John Fletcher 12 Dec '01

12 Dec '01

----- Original Message ----- From: "Dupont, Michael" <michael.dupont(a)mciworldcom.de> To: <ciao-users(a)clip.dia.fi.upm.es> Sent: Wednesday, December 12, 2001 11:51 AM Subject: Database and memory limitations > > Dear Ciao Users, > > I have been experimenting with using prolog as a repository for program meta > information of c++ programs. > Concretly i have exported the parse trees from the gcc compiler into XML, > translated them into a prolog program using xslt and then read them into by > compiling the program. > > I have the following predicate structure > node(id,type) > node(id,attribute,value) > node(fromid,relationship,toid) > > The problem that i have is following, > the number of nodes is maxing out the system (100,000-1,000,000 nodes with > 5-25 relationships per node). > > Can you tell me of ways to use prolog, but to use it on datasets that are > large? > Specifically i have would like to using prolog to query the dataset and > write queries. Michael, Depending how you access the data, I would look at "de-normalizing" it first, e.g. node( 1, a ). node( 1, colour, blue ). node( 1, size, big ). node( 1, above, 2 ). node( 1, next_to, 3 ). changes into: % de_normalized( Id, Type, AttributesAndRelationships ). de_normalized( 1, a, [colour=blue, size=big, above=1, next_to=3] ). then: node( Id, Type ) :- de_normalized( Id, Type, _AVs ). and: node( Id, A, V ) :- de_normalized( Id, _Type, AVs ), member( A=V, AVs ). There are lots more tricks you can try, but this might get you started. Regards John Fletcher

1 0

Re: Database and memory limitations
by Roel Wuyts 12 Dec '01

12 Dec '01

In my PhD I did a similar thing, but I worked in Smalltalk and integrated my Prolog to eliminate this kind of overhead (I talked directly to my Smalltalk image instead of having to create a separate repository). I don't know if that's possible in your approach. For what I needed to do this was needed and sufficient (the integration served other purposes as weel, on which I'm not going to dwell right now :-) ). My colleague, however, was doing work with checking software architectures against the implementation, and for that my logic language was too slow. We then used a 'regular Prolog (WinProlog at that time), and an ODBC connection to a relational database where we stored the full parse tree information. I think that this setup could be very useful in your approach. More information can be found in my dissertation (http://www.iam.unibe.ch/~wuyts/ARTICLES/WuytsPhd.pdf) or in Kim Mens' dissertation (http://prog.vub.ac.be/Research/ResearchPublicationsDetail2.asp?paperID=82) On woensdag, december 12, 2001, at 12:51 , Dupont, Michael wrote: > > Dear Ciao Users, > > I have been experimenting with using prolog as a repository for program > meta > information of c++ programs. > Concretly i have exported the parse trees from the gcc compiler into > XML, > translated them into a prolog program using xslt and then read them > into by > compiling the program. > > I have the following predicate structure > node(id,type) > node(id,attribute,value) > node(fromid,relationship,toid) > > The problem that i have is following, > the number of nodes is maxing out the system (100,000-1,000,000 nodes > with > 5-25 relationships per node). > > Can you tell me of ways to use prolog, but to use it on datasets that > are > large? > Specifically i have would like to using prolog to query the dataset and > write queries. > > Thanks in advance, > > mike > > Roel Wuyts Software Composition Group roel.wuyts(a)iam.unibe.ch University of Bern, Switzerland http://www.iam.unibe.ch/~wuyts/ Board Member of the European Smalltalk User Group: www.esug.org

1 0

Re: Database and memory limitations
by Manuel Carro 12 Dec '01

12 Dec '01

Hiya Michael, First off, I'm not an experienced Prolog coder, so my reply may well be naive, and in which case feel free to simply bin it. When evaluating several Prologs I noted that most had configs for memory usage (heap etc), and indeed a couple of times I had to raise these settings in order to run tests... might there be a similar issue here? I find it of interest that you are transforming xml datasets into prolog with xsl... specifically the reason your snippet caught my eye is I'm about to try out some previous work with Topic Navigation Maps with Prolog (which is new to me), well basically to see what fits well and what doesn't. If you do find a solution I'd be appreciative as after xmas I was going to throw a large dataset at Ciao to see how it went (DMoz), and from the sounds of it the answer would be not very far. Sorry I can't be of any substantial help, and thanks for any follow-up you're able to give. Regards, Guy Murphy. ----- Original Message ----- From: "Dupont, Michael" <michael.dupont(a)mciworldcom.de> To: <ciao-users(a)clip.dia.fi.upm.es> Sent: Wednesday, December 12, 2001 11:51 AM Subject: Database and memory limitations > > Dear Ciao Users, > > I have been experimenting with using prolog as a repository for program meta > information of c++ programs. > Concretly i have exported the parse trees from the gcc compiler into XML, > translated them into a prolog program using xslt and then read them into by > compiling the program. > > I have the following predicate structure > node(id,type) > node(id,attribute,value) > node(fromid,relationship,toid) > > The problem that i have is following, > the number of nodes is maxing out the system (100,000-1,000,000 nodes with > 5-25 relationships per node). > > Can you tell me of ways to use prolog, but to use it on datasets that are > large? > Specifically i have would like to using prolog to query the dataset and > write queries. > > Thanks in advance, > > mike > MCL _____________________________________________________________ All I want is a warm bed and a kind word and unlimited power.

1 0

Database and memory limitations
by Dupont, Michael 12 Dec '01

12 Dec '01

Dear Ciao Users, I have been experimenting with using prolog as a repository for program meta information of c++ programs. Concretly i have exported the parse trees from the gcc compiler into XML, translated them into a prolog program using xslt and then read them into by compiling the program. I have the following predicate structure node(id,type) node(id,attribute,value) node(fromid,relationship,toid) The problem that i have is following, the number of nodes is maxing out the system (100,000-1,000,000 nodes with 5-25 relationships per node). Can you tell me of ways to use prolog, but to use it on datasets that are large? Specifically i have would like to using prolog to query the dataset and write queries. Thanks in advance, mike

1 0

Constraints in Ciao Prolog
by Alexandre Saidi 12 Dec '01

12 Dec '01

Hi, Is there any change on CLP (by IBM) made many years ago. Ciao manual don't say anything about other sources. Thanks.

1 0

Re: ODBC Mediator? (repeat post due to foul up)...
by Manuel Carro 07 Dec '01

07 Dec '01

>> Can anybody point me to the ODBC Mediator for Ciao... it's not >> included in either the most current distro or the "stable" distro... a >> degree of ODBC support was one of the reasons I chose Ciao, I'm liking >> it and would regret having to ditch it over ODBC. Hi. There has been some other requests for ODBC. In the last times we have been paying more attention to connection to other databases such as MySQL, and lack of resources impeded working in lock step in all the database variants. The ODBC mediator was in fact working quite well, but its architecture (a separate process was needed to access the ODBC databases over the net), but we did not want to include in a (stable) distribution without making sure that an high degree of reliability and transparency from the Prolog side w.r.t. the back-end database was achieved. We want, however, to give a push to database access, and have the ability to interoperate with differents types/brands of external databases with basically the same Prolog view. The intricacies of the existing database variants (MySQL, ODBC, PostGres, ...) will, however, take some time to pin down and work out correctly. We ask all users interested in database access (we ourselves are interested!) to bear with us in the meantime---or to join in in order to make this time as short as possible. MCL & the Ciao team _________________________________________ Noalias must go. This is non-negotiable.

1 0

Documentation in spanish?
by rey＠cepes.uh.cu 07 Dec '01

07 Dec '01

Hello: Before starting my work with CiaoProlog, I was searching for related information. Is there any source of it in spanish? Should be... -- Saludos, Rey.

1 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000

1999

1998

Ciao-users December 2001