dexa-lex-fridman-agi-3.mp4
Example ChatGPT Plugin to search across all of the Lex Fridman Podcast episodes 鈥撀爌owered by Dexa 馃敟
This is a ChatGPT retrieval plugin which gives ChatGPT access to all of the transcriptions across 360+ episodes of the Lex Fridman Podcast.
It contains a single API route.
More details can be found in the twitter launch thread.
- Dexa API (currently in private beta)
- Cloudflare Workers
- TypeScript
- @cloudflare/itty-router-openapi
Here's an example live manifest file. API endpoints are protected so only OpenAI can access them.
Dexa has already done all the hard work of aggregating, transcribing, processing, and indexing the Lex Fridman Podcast (and many other podcasts!).
Under the hood, they're doing a lot of really awesome, AI-powered data processing:
- Transcriptions with speaker labels (diarization) for attribution (using Assembly)
- Automatic post-processing for common transcription errors
- Advanced chunking based on metadata, topic detection, and sentence structure
- Metadata extraction and enrichment with support for photos of speakers
- Heirarchical clustering and summarization
Lex Fridman Podcast stats from Dexa as of April 5, 2023:
- Total number of episodes: 364
- Total characters transcribed: 45,005,793
- Total audio length: ~36 days
聽聽聽
聽聽聽
MIT 漏 Travis Fischer
If you found this project interesting, please consider sponsoring me or following me on twitter
