[OASIS Issue Tracker] Created: (CMIS-86) Provide a new service thatwill allow search crawlers to efficiently navigate a CMIS repository.

[OASIS Issues Tracker <workgroup_mailer@lists.oasis-open.org>]

Provide a new service that will allow search crawlers to efficiently navigate a CMIS repository.
------------------------------------------------------------------------------------------------

                 Key: CMIS-86
                 URL: http://tools.oasis-open.org/issues/browse/CMIS-86
             Project: OASIS Content Management Interoperability Services TC
          Issue Type: New Feature
          Components: Domain Model, REST/AtomPub Binding, Schema, Web Services Binding
    Affects Versions: Draft 0.52
            Reporter: Gregory Melahn
            Assignee: Ethan Gur-esh


CMIS needs to allow repositories to expose what information inside the repository has changed in an efficient manner for applications of interest, like search crawlers, to facilitate incremental indexing of a repository.

In theory, a search crawler could index the content of a CMIS repository by using the navigation mechanisms already defined as part of the proposed specification. For example, a crawler engine could start at the root collection and, using the REST bindings, progressively navigate through the folders, get the document content and metadata, and index that content. It could use the CMIS date/time stamps to more efficiently do this by querying for documents modified since the last crawl.

But there are problems with this approach. First, there is no mechanism for knowing what has been deleted from the repository, so the indexed content would contain 'dead' references. Second, there is no standard way to get the access control information needed to filter the search results so the search consumer only sees the content (s)he is supposed to see. Third, each indexer would solve the crawling of the repository in a different way (for example, one could use query and one could use navigation) causing different performance and scalability characteristics that would be hard to control in such  a system.  Finally, the cost of indexing an entire repository can be prohibitive for large content, or content that changes often, requiring support for incremental crawling and paging results.


-- 
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://tools.oasis-open.org/issues/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira