Add Havrouta-Talmud link generation#29
Merged
kdroidFilter merged 8 commits intomasterfrom Jan 14, 2026
Merged
Conversation
- Add GenerateHavroutaLinks.kt to generate links between Havrouta commentaries and Talmud tractates - Extract bold text from Havrouta lines (original Talmud text) and match to corresponding Talmud lines - Create bidirectional links: Talmud->Havrouta (COMMENTARY) and Havrouta->Talmud (SOURCE) - Add generateHavroutaLinks Gradle task
Add exception for 'הערות על חברותא' files which are standalone books, not companion notes to be attached to a base book.
Run after appendOtzaria and before buildCatalog to generate Havrouta-Talmud links as part of the full database generation.
Process Otzaria link files to create links between Havrouta commentaries and their corresponding Hearot al Havrouta books.
- Load all books and line IDs into RAM upfront - Preload all link files into RAM - Process all links in memory before batch insert - Use transaction for faster inserts
- Disable foreign_keys, synchronous, and journal_mode during bulk ops - Use insertLinksBatch() for faster bulk inserts - Restore PRAGMA settings after completion
- Adjust line indices from 0-based Otzaria format to 1-based schema - Resolve off-by-one errors in Havrouta link generation
- Add `setHearotAsDefaultCommentators` to associate Hearot books with corresponding Havrouta books by tractate. - Log completion details and update default commentators for matching books in the repository.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
GenerateHavroutaLinks.ktscript to generate links between Havrouta commentaries and Talmud tractatesgenerateHavroutaLinkstask to thegenerateSeforimDbpipelineTest plan
generateSeforimDbpipeline