[Filebeat] httpjson - Allow response.pagination transforms to read .last_request.*

[chrisberkhout]

The enhancement:

Add .last_request.* to the list of things that the httpjson input's response.pagination transforms can read state from.

The existing list is: [.last_response.*, .first_event.*, .last_event.*, .cursor.*, .header.*, .url.*, .body.*].

A specific use case for the enhancement:

This would remove the need for the workaround used in the bugfix #6649 [ti_misp] Keep the same timestamp for later pages.

The workaround for not having direct access to the last request in the pagination transformers was to add an ignored query string parameter to the actual request, since the query string parameters could be accessed via .last_response.url.params.

[elasticmachine]

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

[elasticmachine]

Pinging @elastic/security-service-integrations (Team:Security-Service Integrations)