Google Mail Calendar Documents Reader Web more »
Recently Visited Groups | Help | Sign in
Google Groups Home
Looking for metasearch software
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  5 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Follow-up To:
Add Cc | Add Follow-up to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers that you hear
 
Thomas Guignard  
View profile   Translate to Translated (View Original)
 More options 28 Sep 2006, 08:06
Newsgroups: alt.internet.search-engines, comp.lang.php
Follow-up To: alt.internet.search-engines
From: Thomas Guignard <thomas.guign...@epfl.ch>
Date: Thu, 28 Sep 2006 09:06:44 +0200
Local: Thurs 28 Sep 2006 08:06
Subject: Looking for metasearch software
Hello

I am looking for a way to query multiple search forms and aggregate
results. The forms are NOT from common websearch engines (google and
such) but from several editor database.

Most forms have to be submitted in POST method.

Apple's Sherlock used to let users develop their own search plugins that
could query multiple sites with GET or POST, but
1. Sherlock is no longer supported by Apple
2. The only app that is supposed to run these plugins on Windows is an
old french app called Glooton (www.glooton.com) which anyway doesn't
work (I tried it with the supplied plugins, but I can't get any results).
3. We would prefer to have a web application (php or perl)

Do anyone has an idea?

We are a public library and would eventually like to offer our readers
with a way to search the multiple ebook and reference databases we have.
Developping a metasearch for these databases will be complicated, since
the editors are unwilling to let other engines search their contents.
Therefore, we would first like to find a quick solution and then wait to
see how the market for these ebooks evolves.

Thank you for your help

Thomas

FU2: alt.internet.search-engines


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
pittendrigh  
View profile   Translate to Translated (View Original)
 More options 28 Sep 2006, 13:44
Newsgroups: alt.internet.search-engines
From: "pittendrigh" <Sandy.Pittendr...@gmail.com>
Date: 28 Sep 2006 05:44:59 -0700
Local: Thurs 28 Sep 2006 13:44
Subject: Re: Looking for metasearch software

Thomas Guignard wrote:
> Hello

> I am looking for a way to query multiple search forms and aggregate
> results. The forms are NOT from common websearch engines (google and
> such) but from several editor database.

> Most forms have to be submitted in POST method.

If the "searches" are keyword searches then a
good web programmer could put this together quickly.
What you are talking about is what database developers often
refer to as a "database mediator:"

A high level query is sent to the mediator.
The mediator re-sends the query to N-different databases
and then collects N-different results in a a single,
concatenated answer, which is returned to the original
posting form.

When the query is a complex statement, that has to be
translated into N-different dialects of SQL, and then sent
off to a N-different relational databases, in that case
building the mediator is a major undertaking.

But if the query is just a list of comma-delimited keywords,
then there is no query translation step to go through.
A journeyman web programmer should be able to put a
form system like that together in an hour or two.


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
pittendrigh  
View profile   Translate to Translated (View Original)
 More options 28 Sep 2006, 13:48
Newsgroups: alt.internet.search-engines
From: "pittendrigh" <Sandy.Pittendr...@gmail.com>
Date: 28 Sep 2006 05:48:59 -0700
Local: Thurs 28 Sep 2006 13:48
Subject: Re: Looking for metasearch software

Thomas Guignard wrote:
> Hello

> I am looking for a way to query multiple search forms and aggregate
> results. The forms are NOT from common websearch engines (google and
> such) but from several editor database.

> Most forms have to be submitted in POST method.

If the "searches" are keyword searches then web programmer
could put this together quickly.
What you are talking about is what database developers often
refer to as a "database mediator:"

A high level query is sent to the mediator.
The mediator sends that query to N-different databases
and then collects N-different results in a a single,
concatenated answer, which is returned to the original
posting form.

When the query is a complex statement, that has to be
translated into N-different dialects of SQL, and the sent
to a N-different relational databases, in that case
building the mediator is an undertaking.

But if the query is just a list of comma-delimited keywords,
then there is no query translation step to go through.
A journeyman web programmer should be able to put a
form system like that together in an hour or two.


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
pittendrigh  
View profile   Translate to Translated (View Original)
 More options 28 Sep 2006, 14:19
Newsgroups: alt.internet.search-engines
From: "pittendrigh" <Sandy.Pittendr...@gmail.com>
Date: 28 Sep 2006 06:19:57 -0700
Local: Thurs 28 Sep 2006 14:19
Subject: Re: Looking for metasearch software

Thomas Guignard wrote:
> Hello

> I am looking for a way to query multiple search forms and aggregate
> results. The forms are NOT from common websearch engines (google and
> such) but from several editor database.

<?php

class keyword_query_mediator
{
var $buffer;
var $keywords;
var $servers = (
        "http://abc.org"=>"/queryform.php",
        "http:/xyz.net"=>"/cgi-bin/db.cgi",
        "http://www.ugabuga.com"=>"/db/db.php"
    );

  function keyword_query_mediator($keywords)
  {
    $this->keywords = $keywords;
    $this->buffer='';
    $this->makeQueries();
  }

  function makeQueries()
  {
    while(list($host,$path) = each($this->servers))
    {
       $this->makeQuery($host,$path);
    }
  }

  function makeQuery($host,$path)
  {
      $this->buffer .=
$this->sendToHost($host,'post',$path,$this->keywords,0);
  }

  // from
http://www.faqts.com/knowledge_base/view.phtml/aid/12039/fid/51
  function sendToHost($host,$method,$path,$data,$useragent=0)
  {
      // Supply a default method of GET if the one passed was empty
      if (empty($method)) {
          $method = 'GET';
      }
      $method = strtoupper($method);
      $fp = fsockopen($host, 80);
      if ($method == 'GET') {
          $path .= '?' . $data;
      }
      fputs($fp, "$method $path HTTP/1.1\r\n");
      fputs($fp, "Host: $host\r\n");
      fputs($fp,"Content-type: application/x-www-form-
urlencoded\r\n");
      fputs($fp, "Content-length: " . strlen($data) . "\r\n");
      if ($useragent) {
          fputs($fp, "User-Agent: MSIE\r\n");
      }
      fputs($fp, "Connection: close\r\n\r\n");
      if ($method == 'POST') {
          fputs($fp, $data);
      }

      while (!feof($fp)) {
          $buf .= fgets($fp,128);
      }
      fclose($fp);
      return $buf;
  }

  function query_response() { return $this->buffer; }

}

?>

    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Thomas Guignard  
View profile   Translate to Translated (View Original)
 More options 28 Sep 2006, 15:12
Newsgroups: alt.internet.search-engines
From: Thomas Guignard <thomas.guign...@epfl.ch>
Date: Thu, 28 Sep 2006 16:12:15 +0200
Local: Thurs 28 Sep 2006 15:12
Subject: Re: Looking for metasearch software
Thank you for your help! I will look what I can do in these lines. I
will also look for further information on "database mediators".

Thomas

--
Thomas Guignard
Central Library
Swiss Federal Institute of Technology, Lausanne


    Reply to author    Forward  
You must Sign in before you can post messages.
To post a message, you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2009 Google