Skip to content

Commit

Permalink
Docs: fixing wrong jinja example and stating how airbyte decides last…
Browse files Browse the repository at this point in the history
… date cursor (#34000)

Co-authored-by: Segers <gabrielsegers@hotmail.com>
  • Loading branch information
girarda and Swadish committed Jan 9, 2024
1 parent c8ca4b1 commit 62d3b56
Showing 1 changed file with 5 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -82,10 +82,14 @@ Then when a sync is triggered for the same connection the next day, the followin
curl 'https://content.guardianapis.com/search?from-date=<b>2023-04-15T07:30:58Z</b>&to-date={`<now>`}'
</pre>

:::info
If the last record read has a datetime earlier than the end time of the stream interval, the end time of the interval will be stored in the state.
:::

The `from-date` is set to the cutoff date of articles synced already and the `to-date` is set to the current date.

:::info
In some cases, it's helpful to reference the start and end date of the interval that's currently synced, for example if it needs to be injected into the URL path of the current stream. In these cases it can be referenced using the `{{ stream_interval.start_date }}` and `{{ stream_interval.end_date }}` [placeholders](/connector-development/config-based/understanding-the-yaml-file/reference#variables). Check out [the tutorial](./tutorial.mdx#adding-incremental-reads) for such a case.
In some cases, it's helpful to reference the start and end date of the interval that's currently synced, for example if it needs to be injected into the URL path of the current stream. In these cases it can be referenced using the `{{ stream_interval.start_time }}` and `{{ stream_interval.end_time }}` [placeholders](/connector-development/config-based/understanding-the-yaml-file/reference#variables). Check out [the tutorial](./tutorial.mdx#adding-incremental-reads) for such a case.
:::

## Incremental sync without time filtering
Expand Down

0 comments on commit 62d3b56

Please sign in to comment.