Note: this repository and respective service is no longer maintained
Send indexable files to an IaaS (Index as a Service)
The following components are required before installation:
- An AWS SQS FIFO queue, used as destination (see next section for more details)
- A GitHub repository with your
helix-query.yamlconfiguration - One or more Excel workbooks in SharePoint that will contain the indexed records
If all of this is given, deploy the AWS Lambda action. For more information on the parameters expected by the action, see the next section.
The following parameters are expected by the action:
owner: GitHub repository ownerrepo: GitHub repository nameref: GitHub repository reference or branchpath: path to the document to be indexed
Note: the first three parameters also determine the location where the helix-query.yaml configuration file is downloaded from. The Excel
Workbook updated is determined by the target property in your index definition, located in the same file.
The AWS SQS FIFO destination queue's name is given as:
https://sqs.<aws-region>.amazonaws.com/<aws-account>/helix-excel--<owner>--<repo>.fifo
The action will store indexed records in that queue, ready to be picked up by Helix Excel Indexer
This action can be invoked automatically when documents in SharePoint are created, deleted or modified. This requires a simultaneous deployment of the Helix OneDrive Listener. This is how to proceed:
- Determine the queue for sending changes processed by
Helix Onedrive Listener, it should be namedhelix-onedrive--<owner>--<repo> - Add a trigger to that queue, that automatically invokes this action, with a batch size of
1 - Optionally, add a dead letter queue, with a non-zero delivery count, so the action is re-executed if there's an intermittent error preventing the document to be indexed
In your helix-query.yaml 1, you can define one or more index definitions. A sample index definition looks as follows:
indices:
mysite:
source: html
fetch: https://{ref}--{repo}--{owner}.project-helix.page/{path}
properties:
author:
select: main > div:nth-of-type(3) > p:nth-of-type(1)
value: |
match(el, 'by (.*)')
The select property is a CSS selector that grabs HTML elements out of your document. To verify that a CSS selector entered
is selecting what you expect, you can test it in your browser's Javascript console, e.g. for the author selector shown above,
enter the following expression:
document.querySelectorAll('main > div:nth-of-type(3) > p:nth-of-type(1)');
The value or values property contains an expression to apply to all HTML elements selected. The property name value is preferred
when you need a string, values on the other hand provides you with an array of all the matches found. The expression can contain
a combination of functions and variables:
Returns the HTML content of an element.
Returns the text content of the selected element, and all its descendents.
Returns the value of the attribute with the specified name of an element.
Matches a regular expression containing parentheses to capture items in the passed element.
In the author example above, the actual contents of the <p> element selected might
contain by James Brown, so it would capture everything following by .
Useful for teasers, this selects a range of words out of an HTML element.
Replaces all occurrences of a substring in a text with a replacement.
Parses a timestamp given as string, and returns its value as number of seconds since 1 Jan 1970.
Returns the HTML elements selected by the select property.
Returns the path of the HTML document being indexed.
Returns the value of the HTTP response header with the specified name, at the time the HTML document was fetched.
[1]: The full definition of the helix-query.yaml is available here: https://github.com/adobe/helix-shared/blob/main/docs/indexconfig.md