`pub_dev_search` returns a lot of content under `api.qualifiedNames`

[domesticmouse]

I'm looking at the returned result for pub_dev_search for the term riverpod. Thinking about the token burn, I don't see the value in the content returned under api.qualifiedNames. Can we elide this information?

{
  "packageName": "riverpod",
  "latestVersion": "2.6.1",
  "description": "A reactive caching and data-binding framework. Riverpod makes working with asynchronous code a breeze.\n",
  "scores": {
    "pubPoints": 160,
    "maxPubPoints": 160,
    "likes": 3665,
    "downloadCount": 1812054
  },
  "topics": [],
  "licenses": [
    "license:mit",
    "license:fsf-libre",
    "license:osi-approved"
  ],
  "publisher": "publisher:dash-overflow.net",
  "api": {
    "qualifiedNames": [
      "riverpod",
      "riverpod.AlwaysAliveProviderBase",
      "riverpod.AlwaysAliveProviderBase.select",
      "riverpod.AlwaysAliveProviderListenable",
      "riverpod.AlwaysAliveProviderListenable.select",
      "riverpod.AlwaysAliveRefreshable",
      "riverpod.AlwaysAliveRefreshable.AlwaysAliveRefreshable.new",
      "riverpod.AsyncData",
      "riverpod.AsyncData.AsyncData.new",
      "riverpod.AsyncData.copyWithPrevious",
      "riverpod.AsyncData.error",
      "riverpod.AsyncData.hasValue",
      "riverpod.AsyncData.isLoading",
      "riverpod.AsyncData.map",
      "riverpod.AsyncData.stackTrace",
      "riverpod.AsyncData.value",
      "riverpod.AsyncError",
      "riverpod.AsyncError.AsyncError.new",
      "riverpod.AsyncError.copyWithPrevious",
      "riverpod.AsyncError.error",
      "riverpod.AsyncError.hasValue",
      "riverpod.AsyncError.isLoading",
      "riverpod.AsyncError.map",
      "riverpod.AsyncError.stackTrace",
      "riverpod.AsyncError.value",
      "riverpod.AsyncLoading",
      "riverpod.AsyncLoading.AsyncLoading.new",
      "riverpod.AsyncLoading.copyWithPrevious",
      "riverpod.AsyncLoading.error",
      "riverpod.AsyncLoading.hasValue",
      "riverpod.AsyncLoading.isLoading",
      "riverpod.AsyncLoading.map",
      "riverpod.AsyncLoading.stackTrace",
      "riverpod.AsyncLoading.value",
      "riverpod.AsyncNotifier",
      "riverpod.AsyncNotifier.AsyncNotifier.new",
      "riverpod.AsyncNotifier.build",
      "riverpod.AsyncNotifier.future",
      "riverpod.AsyncNotifier.listenSelf",
      "riverpod.AsyncNotifier.ref",
      "riverpod.AsyncNotifier.state",
      "riverpod.AsyncNotifier.update",
      "riverpod.AsyncNotifier.updateShouldNotify",
      "riverpod.AsyncNotifierFamilyProvider",
      "riverpod.AsyncNotifierProvider",
      "riverpod.AsyncNotifierProviderElement",
      "riverpod.AsyncNotifierProviderElement.AsyncNotifierProviderElement.new",
      "riverpod.AsyncNotifierProviderElement.create",
      "riverpod.AsyncNotifierProviderElementBase",
      "riverpod.AsyncNotifierProviderElementBase.AsyncNotifierProviderElementBase.new",
      "riverpod.AsyncNotifierProviderElementBase.dispose",
      "riverpod.AsyncNotifierProviderElementBase.futureNotifier",
      "riverpod.AsyncNotifierProviderElementBase.handleFuture",
      "riverpod.AsyncNotifierProviderElementBase.handleStream",
      "riverpod.AsyncNotifierProviderElementBase.onData",
      "riverpod.AsyncNotifierProviderElementBase.onError",
      "riverpod.AsyncNotifierProviderElementBase.runOnDispose",
      "riverpod.AsyncNotifierProviderElementBase.state",
      "riverpod.AsyncNotifierProviderElementBase.updateShouldNotify",
      "riverpod.AsyncNotifierProviderElementBase.visitChildren",
      "riverpod.AsyncNotifierProviderFamily",
      "riverpod.AsyncNotifierProviderFamily.AsyncNotifierProviderFamily.new",
      "riverpod.AsyncNotifierProviderFamily.allTransitiveDependencies",
      "riverpod.AsyncNotifierProviderFamily.call",
      "riverpod.AsyncNotifierProviderFamily.debugGetCreateSourceHash",
      "riverpod.AsyncNotifierProviderFamily.dependencies",
      "riverpod.AsyncNotifierProviderFamily.getProviderOverride",
      "riverpod.AsyncNotifierProviderFamily.name",
      "riverpod.AsyncNotifierProviderFamily.overrideWith",
      "riverpod.AsyncNotifierProviderFamily.overrideWithProvider",
      "riverpod.AsyncNotifierProviderRef",
      "riverpod.AsyncNotifierProviderRef.AsyncNotifierProviderRef.new",
      "riverpod.AsyncValue",
      "riverpod.AsyncValue.AsyncValue.data",
      "riverpod.AsyncValue.AsyncValue.error",
      "riverpod.AsyncValue.AsyncValue.loading",
      "riverpod.AsyncValue.copyWithPrevious",
      "riverpod.AsyncValue.error",
      "riverpod.AsyncValue.guard",
      "riverpod.AsyncValue.hasValue",
      "riverpod.AsyncValue.hashCode",
      "riverpod.AsyncValue.isLoading",
      "riverpod.AsyncValue.map",
      "riverpod.AsyncValue.operator ==",
      "riverpod.AsyncValue.stackTrace",
      "riverpod.AsyncValue.toString",
      "riverpod.AsyncValue.unwrapPrevious",
      "riverpod.AsyncValue.value",
      "riverpod.AsyncValueX",
      "riverpod.AsyncValueX.asData",
      "riverpod.AsyncValueX.asError",
      "riverpod.AsyncValueX.hasError",
      "riverpod.AsyncValueX.isRefreshing",
      "riverpod.AsyncValueX.isReloading",
      "riverpod.AsyncValueX.mapOrNull",
      "riverpod.AsyncValueX.maybeMap",
      "riverpod.AsyncValueX.maybeWhen",
      "riverpod.AsyncValueX.requireValue",
      "riverpod.AsyncValueX.valueOrNull",
      "riverpod.AsyncValueX.when",
      "riverpod.AsyncValueX.whenData",
      "riverpod.AsyncValueX.whenOrNull",
      "riverpod.AutoDisposeAsyncNotifier",
      "riverpod.AutoDisposeAsyncNotifier.AutoDisposeAsyncNotifier.new",
      "riverpod.AutoDisposeAsyncNotifier.build",
      "riverpod.AutoDisposeAsyncNotifier.future",
      "riverpod.AutoDisposeAsyncNotifier.listenSelf",
      "riverpod.AutoDisposeAsyncNotifier.ref",
      "riverpod.AutoDisposeAsyncNotifier.state",
      "riverpod.AutoDisposeAsyncNotifier.update",
      "riverpod.AutoDisposeAsyncNotifier.updateShouldNotify",
      "riverpod.AutoDisposeAsyncNotifierProvider",
      "riverpod.AutoDisposeAsyncNotifierProviderElement",
      "riverpod.AutoDisposeAsyncNotifierProviderElement.AutoDisposeAsyncNotifierProviderElement.new",
      "riverpod.AutoDisposeAsyncNotifierProviderElement.maintainState",
      "riverpod.AutoDisposeAsyncNotifierProviderElement.mayNeedDispose",
      "riverpod.AutoDisposeAsyncNotifierProviderElement.runOnDispose",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily.AutoDisposeAsyncNotifierProviderFamily.new",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily.allTransitiveDependencies",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily.call",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily.debugGetCreateSourceHash",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily.dependencies",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily.getProviderOverride",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily.name",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily.overrideWith",
      "riverpod.AutoDisposeAsyncNotifierProviderFamily.overrideWithProvider",
      "riverpod.AutoDisposeAsyncNotifierProviderRef",
      "riverpod.AutoDisposeAsyncNotifierProviderRef.AutoDisposeAsyncNotifierProviderRef.new",
      "riverpod.AutoDisposeFamilyAsyncNotifier",
      "riverpod.AutoDisposeFamilyAsyncNotifier.AutoDisposeFamilyAsyncNotifier.new",
      "riverpod.AutoDisposeFamilyAsyncNotifier.arg",
      "riverpod.AutoDisposeFamilyAsyncNotifier.build",
      "riverpod.AutoDisposeFamilyAsyncNotifier.future",
      "riverpod.AutoDisposeFamilyAsyncNotifier.listenSelf",
      "riverpod.AutoDisposeFamilyAsyncNotifier.ref",
      "riverpod.AutoDisposeFamilyAsyncNotifier.state",
      "riverpod.AutoDisposeFamilyAsyncNotifier.update",
      "riverpod.AutoDisposeFamilyAsyncNotifier.updateShouldNotify",
      "riverpod.AutoDisposeFamilyAsyncNotifierProvider",
      "riverpod.AutoDisposeFamilyNotifier",
      "riverpod.AutoDisposeFamilyNotifier.AutoDisposeFamilyNotifier.new",
      "riverpod.AutoDisposeFamilyNotifier.arg",
      "riverpod.AutoDisposeFamilyNotifier.build",
      "riverpod.AutoDisposeFamilyNotifier.listenSelf",
      "riverpod.AutoDisposeFamilyNotifier.ref",
      "riverpod.AutoDisposeFamilyNotifier.state",
      "riverpod.AutoDisposeFamilyNotifier.stateOrNull",
      "riverpod.AutoDisposeFamilyNotifier.updateShouldNotify",
      "riverpod.AutoDisposeFamilyNotifierProvider",
      "riverpod.AutoDisposeFamilyStreamNotifier",
      "riverpod.AutoDisposeFamilyStreamNotifier.AutoDisposeFamilyStreamNotifier.new",
      "riverpod.AutoDisposeFamilyStreamNotifier.arg",
      "riverpod.AutoDisposeFamilyStreamNotifier.build",
      "riverpod.AutoDisposeFamilyStreamNotifier.future",
      "riverpod.AutoDisposeFamilyStreamNotifier.listenSelf",
      "riverpod.AutoDisposeFamilyStreamNotifier.ref",
      "riverpod.AutoDisposeFamilyStreamNotifier.state",
      "riverpod.AutoDisposeFamilyStreamNotifier.update",
      "riverpod.AutoDisposeFamilyStreamNotifier.updateShouldNotify",
      "riverpod.AutoDisposeFamilyStreamNotifierProvider",
      "riverpod.AutoDisposeFutureProvider",
      "riverpod.AutoDisposeFutureProvider.AutoDisposeFutureProvider.internal",
      "riverpod.AutoDisposeFutureProvider.AutoDisposeFutureProvider.new",
      "riverpod.AutoDisposeFutureProvider.createElement",
      "riverpod.AutoDisposeFutureProvider.family",
      "riverpod.AutoDisposeFutureProvider.future",
      "riverpod.AutoDisposeFutureProvider.overrideWith",
      "riverpod.AutoDisposeFutureProvider.selectAsync",
      "riverpod.AutoDisposeFutureProviderElement",
      "riverpod.AutoDisposeFutureProviderElement.AutoDisposeFutureProviderElement.new",
      "riverpod.AutoDisposeFutureProviderElement.maintainState",
      "riverpod.AutoDisposeFutureProviderElement.mayNeedDispose",
      "riverpod.AutoDisposeFutureProviderElement.runOnDispose",
      "riverpod.AutoDisposeFutureProviderFamily",
      "riverpod.AutoDisposeFutureProviderFamily.AutoDisposeFutureProviderFamily.generator",
      "riverpod.AutoDisposeFutureProviderFamily.AutoDisposeFutureProviderFamily.new",
      "riverpod.AutoDisposeFutureProviderFamily.allTransitiveDependencies",
      "riverpod.AutoDisposeFutureProviderFamily.call",
      "riverpod.AutoDisposeFutureProviderFamily.debugGetCreateSourceHash",
      "riverpod.AutoDisposeFutureProviderFamily.dependencies",
      "riverpod.AutoDisposeFutureProviderFamily.getProviderOverride",
      "riverpod.AutoDisposeFutureProviderFamily.name",
      "riverpod.AutoDisposeFutureProviderFamily.overrideWith",
      "riverpod.AutoDisposeFutureProviderFamily.overrideWithProvider",
      "riverpod.AutoDisposeFutureProviderRef",
      "riverpod.AutoDisposeFutureProviderRef.AutoDisposeFutureProviderRef.new",
      "riverpod.AutoDisposeNotifier",
      "riverpod.AutoDisposeNotifier.AutoDisposeNotifier.new",
      "riverpod.AutoDisposeNotifier.build",
      "riverpod.AutoDisposeNotifier.listenSelf",
      "riverpod.AutoDisposeNotifier.ref",
      "riverpod.AutoDisposeNotifier.state",
      "riverpod.AutoDisposeNotifier.stateOrNull",
      "riverpod.AutoDisposeNotifier.updateShouldNotify",
      "riverpod.AutoDisposeNotifierProvider",
      "riverpod.AutoDisposeNotifierProviderElement",
      "riverpod.AutoDisposeNotifierProviderElement.AutoDisposeNotifierProviderElement.new",
      "riverpod.AutoDisposeNotifierProviderElement.maintainState",
      "riverpod.AutoDisposeNotifierProviderElement.mayNeedDispose"
    ]
  }
}

[jakemac53]

There is also a lot of duplication here, I do think we should remove the library name at a minimum because if anything that is likely to confuse the LLM (they might think that is a required thing).

We could also just provide top level names, or provide a nested structure instead of repeating the outer names.

Or, just make this API level information optional.

I do think that having an overview of the actual API (even just names) is likely useful in determining whether a package is a good fit though.

[jakemac53]

After testing a bit myself I definitely agree the current implementation adds too many tokens to the context, and the value is dubious so we should just drop it for now and possibly introduce a new tool to just get the API for a single package or library. And it should have a more compact format as well.