Hello,

we just developed a search engine module for DNN 3.1.1.

The module uses DotLucene as the indexing engine, and it includes a spider that the administrator can configure to crawl any site, be it a DNN site or not.  The modules on the site do not need to be ISearcheable compliant in order to be indexed.

Open-SearchEngine works just like Google would.  A site is crawled according to the links it contains, and the content is indexed and stored in the file system.  Upon searchng, the indexed content is queried, and the results displayed in the familiar google format, according to relevance.

All source code is included.  

For a demo and more details, please see http://www.opendnn.com
The module can be purchased on SnowCovered at: http://www.snowcovered.com/snowcovered2/Default.aspx?tabid=166&CatalogItemID=2372

Best Regards,
Andreas.

I've recently purchased this module from SnowCovered (seems to be exactly what I need).

What is the best place to go to get some quick support?  My issue is that the search results are returning results from public websites (like WSJ.com) that are not on my list of URLs configured in the module.  And, content within my DNN portals is not being indexed/found.

Thanks.

hello dharmesh,

the fastest way to get support is to open a support ticket on snowcovered, or to contact xepient solutions directly.

Here is what could be happening as far as getting results from public web sites: If youu have links on your DNN site for which you are keeping track how many times they are being clicked, DNN will generate an href tag that points to your owns site first and a linkclick parameter.... something like: http://www.yourdnnsite.com?linkclick=http://www.externalsite.com.  The spider will check the base url and see that it corresponds to your own site (same base uri) and as a result follow it, however DNN will redirect to the external site. This will only happen once per link.  Once on the external site the spider will not follow any other external link, since it will recognize that the url is no longer equal the base uri settings.

if not all of your content on the DNN site is being indexed, it is because the spiders is not finding all of the links to your content.  In the setup instructions that came with Open-searchengine, there is a tip related to the solpart menu and the way it behaves with crawlers (alll crawlers once it recognizes them as such).  If you were to add the suggested entries to the web.config, you will see dramatic improvements to the number of crawled pages. Please be aware that what is being indexed now, is probably the same amount of information that is being indexed by other crawlers like Google, since Open-SearchEngine has the same Header entries as Google.

Hope this heps.

Best Regards,
Andreas

Hello everyone.

I am working on the next version of Open-SearchEngine.

Below is a list of features that I am thinking about adding, and would like some feedback:

1. Ability to spider a site as a registered user (so that public as well as private content may be indexed).
2. Office Documents Indexing.  I am working with Filters (the same implemented by the window explorer during a search), in order to index documents such as .doc
3. Pdf Indexing

Thank you in advance,

Andreas.

Hello,

for those that have been following this thread, asking about PDF indexing capabilities,

I would like to announce that we finally have implemented this capability.

As a result, Open-SearchEngine is now capable of indexing regular HTML content, as well as MSOffice documents and PDF documents.

 

More information on our site:

www.opendnn.com

or on SnowCovered:
http://www.snowcovered.com/Snowcovered2/Default.aspx?tabid=242&PackageID=5092

 

Best Regards,

Andreas.