Collection keywords not searchable

[tjaeuth]

Hi,

I am using a collection search conform API (STAC FastAPI with Postgres database from https://github.com/developmentseed/eoAPI).
Unfortunately, I was able to filter collections by IDs but not by keywords, as browser STAC supports it.

The API is not publishing a queryables endpoint for the collection search but only for item search.
Inspecting the database, I am also not seeing anything about queryables for collections search.

I don't understand how can I filter collections by keywords or even with metadata fields from extensions?

[vincentsarago]

Hi @tjaeuth
Collection-Search was added in stac-fastapi-pgstac 4.0.0 and the version in the eoAPI repo docker image is set to 3.0.0

Let me update the eoAPI docker-compose file

[tjaeuth]

@vincentsarago

I am sorry not sharing the version I am using.
We already updated the version in the docker compose file so it is
image: ghcr.io/stac-utils/stac-fastapi-pgstac:4.0.1

Even though it is not working.

[vincentsarago]

We have it deployed in https://github.com/developmentseed/eoapi-devseed and it works fine

curl https://stac.eoapi.dev/collections\?filter\=id\=%27copernicus-dem%27 | jq

{
  "collections": [
    {
      "id": "copernicus-dem",
      "type": "Collection",
      "links": [
        {
          "rel": "items",
          "type": "application/geo+json",
          "href": "https://stac.eoapi.dev/collections/copernicus-dem/items"
        },
        {
          "rel": "parent",
          "type": "application/json",
          "href": "https://stac.eoapi.dev/"
        },
        {
          "rel": "root",
          "type": "application/json",
          "href": "https://stac.eoapi.dev/"
        },
        {
          "rel": "self",
          "type": "application/json",
          "href": "https://stac.eoapi.dev/collections/copernicus-dem"
        },
        {
          "rel": "items",
          "href": "https://stac.eoapi.dev/collections/copernicus-dem/items",
          "type": "application/geo+json"
        },
        {
          "rel": "http://www.opengis.net/def/rel/ogc/1.0/queryables",
          "type": "application/schema+json",
          "title": "Queryables",
          "href": "https://stac.eoapi.dev/collections/copernicus-dem/queryables"
        }
      ],
      "title": "Copernicus Digital Elevation Model (DEM)",
      "extent": {
        "spatial": {
          "bbox": [
            [
              -180.0,
              -90.0,
              180.0,
              90.0
            ]
          ]
        },
        "temporal": {
          "interval": [
            [
              "2022-05-09T00:00:00.000000Z",
              "2022-05-10T00:00:00.000000Z"
            ]
          ]
        }
      },
      "license": "CC-BY-4.0",
      "description": "Copernicus Digital Elevation Model (DEM)",
      "item_assets": {
        "dem": {
          "type": "image/tiff; application=geotiff; profile=cloud-optimized",
          "roles": [
            "data"
          ],
          "title": "dem"
        }
      },
      "stac_version": "1.0.0",
      "stac_extensions": [
        "https://stac-extensions.github.io/item-assets/v1.0.0/schema.json"
      ]
    }
  ],
  "links": [
    {
      "rel": "root",
      "type": "application/json",
      "href": "https://stac.eoapi.dev/"
    },
    {
      "rel": "self",
      "type": "application/json",
      "href": "https://stac.eoapi.dev/collections?filter=id=%27copernicus-dem%27"
    }
  ],
  "numberMatched": 1,
  "numberReturned": 1
}

[tjaeuth]

I agree it works with IDs as described in the initial post.
The problem comes with other fields like keywords.

Can you search collections with keywords. In your example there are no keywords but I found collections with keywords here:

https://radiantearth.github.io/stac-browser/#/external/gis.ktn.gv.at/ogd/custom/stac_cat_ktn/STAC_2023/kagis-catalog/catalog.json?.language=de

[vincentsarago]

are keywords part of your queryables?

in https://stac.eoapi.dev/collections/MAXAR_afghanistan_earthquake22/queryables we only have id/datetime/geometries

https://stac-utils.github.io/pgstac/pgstac/#queryable-metadata

[vincentsarago]

@tjaeuth could you share which pgstac version you're using?

[tjaeuth]

@tjaeuth could you share which pgstac version you're using?

ghcr.io/stac-utils/pgstac:v0.9.2

[tjaeuth]

are keywords part of your queryables?

in https://stac.eoapi.dev/collections/MAXAR_afghanistan_earthquake22/queryables we only have id/datetime/geometries

https://stac-utils.github.io/pgstac/pgstac/#queryable-metadata

I was expecting that the queryables in that endpoint refer only to items, and thus to the item search.

Meanwhile, I am trying to add keywords to the queryables using the instructions here:
https://stac-utils.github.io/pgstac/pgstac/#queryable-metadata

I hoped to have to call just some endpoint for reindexing :(

[tjaeuth]

@vincentsarago I still do not understand but it seems that the queryables are common for item search and collection search.
I was now able to index the keywords and search collections and items using the keywords.

FYI, The following I had to insert into the queryables table to get it to work.

INSERT INTO queryables (
   name,
   collection_ids,
   definition,
   property_wrapper,
   property_index_type
) VALUES (
   'keywords',
   NULL,
   '{
       "title": "Keywords",
       "description": "Keywords describing the item.",
       "type": "array",
       "items": {
           "type": "string"
       }
   }'::jsonb,
   'to_text',
   NULL
);

[vincentsarago]

yeah so in fact we don't have queryables for the collections metadata themself but only for items

ref: stac-utils/pgstac#350

Also I think stac-browser is using the freetext extension for the collection-search and we're in the process of publishing a new version of pgstac with some fixes. Please keep an eye on pgstac repo ;-)