-
Notifications
You must be signed in to change notification settings - Fork 0
3.1 BETA 2 Release Notes
Release date: January 2024
BETA 2 focuses on enhanced Zotero integration and improved user experience. This release streamlines the workflow from bibliography import to PDF indexing, making it easier to build a comprehensive research database.
Key improvements:
- Seamless PDF download from Zotero
- Batch operations for downloading and indexing
- Better visual indicators and warnings
- Enhanced theme system with automatic switching
- Improved configuration experience
The complete workflow from Zotero to indexed PDFs is now seamless:
Before BETA 2:
Import bibliography → Manually find PDFs → Manually add → Index individually
After BETA 2:
Import bibliography → Click "Download All" → Automatic indexing ✅
New badges show PDF availability at a glance:
- 📎 N: N PDFs available in Zotero (not downloaded yet)
- 📄: Local PDF file attached
- ✅: PDF fully indexed and ready for RAG queries
Process multiple PDFs efficiently:
- Download All Missing PDFs: Download and index all PDFs from Zotero in one operation
- Index All PDFs: Index all local PDFs with progress tracking
- Real-time progress display with current citation being processed
- Light/Dark/Auto modes: Choose your preference or let ClioDeck adapt
-
Time-based auto-switching:
- Dark mode: 8 PM - 6 AM
- Light mode: 6 AM - 8 PM
- Removed: Dense theme (replaced by better spacing in light/dark themes)
Configuration: Settings → Appearance Settings → Theme
- Fixed: Status now correctly shows "Not Installed" or "Installed"
- Improved: Integrated into CollapsibleSection for consistency
- Better UX: Clear installation status and error messages
- New button: Quickly access project folder from Projects panel
- Platform support: Finder on macOS, File Explorer on Windows, file manager on Linux
- Location: Projects panel → ... → "Open in Finder/Explorer"
-
Zotero metadata: Citations now include
zoteroAttachmentsarray -
Attachment info: Each attachment includes:
-
key: Zotero attachment key -
filename: Original filename -
contentType: MIME type (e.g.,application/pdf)
-
Implementation: src/renderer/src/stores/bibliographyStore.ts
- 📎 Badge: Shows count of available Zotero PDFs
- Tooltip: Displays "N PDFs available in Zotero"
- Color coding: Visual distinction between indexed/not indexed
UI Component: src/renderer/src/components/Bibliography/CitationCard.tsx
When a citation has multiple PDFs attached:
- Click "Index PDF" button
- Dialog shows all available PDFs with filenames
- Select the PDF you want
- ClioDeck downloads and indexes automatically
Component: src/renderer/src/components/Bibliography/PDFSelectionDialog.tsx
- Smart detection: Checks if PDF is local or needs downloading
- Automatic download: If PDF is in Zotero but not local, downloads first
- Then indexes: Seamlessly proceeds to indexing after download
- Progress feedback: Shows current status (downloading → indexing → done)
- New button: 📥 Download All in Bibliography panel toolbar
- Batch processing: Downloads and indexes all citations with Zotero PDFs
-
Progress tracking:
- Current citation being processed
- N / Total counter
- Success/skipped/error counts
- Error handling: Continues processing on errors, reports at the end
Store method: downloadAllMissingPDFs(projectPath: string)
- Enhanced UI: Shows current citation title during batch operations
- Real-time stats: ✅ indexed, ⏭️ skipped
- Progress bar: Visual completion indicator
- Responsive: UI remains interactive during operations
When changing the embedding model in Settings:
⚠️ Attention: Changer ce modèle nécessite de ré-indexer tous les PDFs.
Les embeddings ne sont pas compatibles entre modèles différents.
Vous devrez supprimer tous les PDFs indexés et les ré-indexer après le changement.
Modèles recommandés:
• nomic-embed-text - 768 dim, multilingue, recommandé
• mxbai-embed-large - 1024 dim, très performant
• all-minilm - 384 dim, léger et rapide
Location: Settings → Configuration LLM → Modèle d'embedding
When changing chunking strategy:
⚠️ Attention: Changer cette option nécessite de ré-indexer tous les PDFs.
Les chunks existants ne seront pas mis à jour automatiquement.
Location: Settings → Configuration RAG → Stratégie de découpage
- Prominent warnings: Yellow warning boxes that can't be missed
- Clear explanations: Why re-indexing is necessary
- Recommended values: Guidance on best practices
- Consistency: Same warning style across all critical settings
-
New endpoint:
window.electron.zotero.downloadPDF() -
Parameters:
-
userId,apiKey: Zotero credentials -
attachmentKey: Specific attachment to download -
filename: Target filename -
targetDirectory: Project path
-
- Returns: Success status and file path
- Error handling: Graceful failures with detailed error messages
Implementation: src/main/services/zotero-service.ts
New methods added to Zustand store:
-
downloadAllMissingPDFs(): Batch download and index -
downloadAndIndexZoteroPDF(): Download single PDF and index -
refreshIndexedPDFs(): Update indexed status cache -
isFileIndexed(): Check if PDF is already indexed
State management: src/renderer/src/stores/bibliographyStore.ts
New translation keys for BETA 2 features:
-
bibliography.downloadAllMissing: "Download all missing PDFs from Zotero" -
bibliography.confirmDownloadAll: Confirmation dialog -
bibliography.downloadAllComplete: Success message with stats -
bibliography.pdfDownloadedAndIndexed: Individual PDF success -
bibliography.availableInZotero: Tooltip text
Files updated:
public/locales/en/common.jsonpublic/locales/fr/common.json
- Total tasks in original plan: 19 tasks
- Tasks implemented: 11 major features
- Implementation rate: 58%
- Lines of code added: ~800 LOC
- Files modified: 12 files
- New components: 1 (PDFSelectionDialog)
✅ Phase 1: UI improvements (3 tasks) ✅ Phase 2: Zotero PDF detection (2 tasks) ✅ Phase 3: PDF download & indexation (4 tasks) ✅ Phase 4: Configuration improvements (2 tasks)
See BETA2_NOT_IMPLEMENTED.md for detailed list of 8 postponed features.
Key postponed features:
- Bibliography update/sync function
- Modified PDF detection and re-indexation
- Orphan PDF detection and cleanup
- Merge Bibliography and PDFs tabs
- Statistics dashboard
- Multiple embedding model options
- Standalone embeddings without Ollama
Why postponed: Focus on core workflow quality over advanced features. These will be considered for BETA 3 and BETA 4.
- Issue: Status showed "Unknown" instead of proper installation state
- Fix: Corrected state checking logic
- Impact: Users can now see if BERTopic is properly installed
- Issue: Dense theme option was confusing and not well integrated
- Fix: Removed dense theme, improved light/dark themes spacing
- Impact: Cleaner UI, better readability
- Issue: Progress UI didn't show which citation was being processed
- Fix: Added current citation title to progress display
- Impact: Better visibility during long batch operations
-
Zotero Integration Guide: Complete guide for using Zotero features
- Configuration steps
- PDF detection and download
- Batch operations
- Troubleshooting
- Best practices
- Installation Guide: Updated prerequisites (Zotero optional but recommended)
- Technical Architecture: Added Zotero service documentation
None. BETA 2 is fully backward compatible with BETA 1 projects.
However, note:
- Theme setting migration: If you were using "dense" theme, it will default to "auto" (light/dark based on time)
- Configuration warnings: You'll now see prominent warnings when changing embedding models or chunking config
- Backup your projects (recommended)
- Install BETA 2 using your platform's package manager
- Open existing project - no migration needed
-
Configure Zotero (if not already done):
- Settings → Zotero Configuration
- Enter User ID and API Key
- Test connection
-
Re-import bibliography (optional):
- Use merge mode to detect Zotero PDFs
- Download missing PDFs with new batch button
git checkout beta2
npm install
npx electron-rebuild -f
npm run build
npm start1. First-time Zotero setup:
Settings → Zotero → Enter credentials → Test connection
2. Import and download everything:
Bibliography → Zotero Import → Select collection → Sync
Bibliography → Click 📥 Download All → Wait for completion
3. Start writing with RAG:
Open editor → Switch to RAG mode → Ask questions about your PDFs
For large libraries (100+ citations):
- Import specific collections rather than entire library
- Download PDFs in batches of 50-100
- Use "Index All PDFs" after downloading locally
- Monitor disk space
For active research:
- Use merge mode when updating bibliography
- Download PDFs incrementally as you need them
- Re-index if you change chunking configuration
- Keep Zotero in sync with ClioDeck
For optimal performance:
- Configure RAG settings (embedding model, chunking) BEFORE batch indexing
- Use recommended embedding models (see warnings)
- Close other heavy applications during batch operations
- Consider CPU-optimized chunking for faster processing
Based on user feedback and development priorities:
- Bibliography Update/Sync: Automatic detection of changes in Zotero
- Statistics Dashboard: Citation counts, indexing status, storage usage
- Orphan PDF Detection: Find and clean up unused PDFs
- Modified PDF Detection: Re-index when Zotero PDFs are updated
- Merge Bibliography and PDFs panels
- Multiple embedding model options
- Citation editing in ClioDeck
- Export annotated bibliography
See BETA2_NOT_IMPLEMENTED.md for complete list.
BETA 2 development was AI-assisted using Claude (Anthropic). All design decisions, testing, and quality assurance by the ClioDeck team.
Contributors:
- Frédéric Clavert (project lead)
- Claude AI (development assistance)
- No citation editing: Citations must be edited in Zotero, then re-imported
- No automatic sync: Changes in Zotero require manual re-import
- No PDF conflict resolution: If PDF exists locally and in Zotero, manual intervention needed
- Large PDFs: Files over 50 MB may timeout during download
- Editing citations: Edit in Zotero → Export BibTeX → Re-import with merge mode
- Syncing updates: Periodically re-sync collection with merge mode
- PDF conflicts: Delete local PDF first, then download from Zotero
- Large PDFs: Download manually from Zotero, add file path to citation
- Installation issues: See Installation Guide
- Zotero issues: See Zotero Integration Guide
- Bug reports: GitHub Issues
- Feature requests: GitHub Discussions
When reporting issues, please include:
- ClioDeck version (Help → About)
- Operating system and version
- Steps to reproduce
- Expected vs. actual behavior
- Console logs (View → Developer → Developer Tools → Console)
ClioDeck is open source software licensed under LICENSE.
Thank you for using ClioDeck BETA 2!
Your feedback is essential for improving the tool. Please share your experience on GitHub.