Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: email indexation #216

Merged
merged 37 commits into from Sep 14, 2022
Merged

feat: email indexation #216

merged 37 commits into from Sep 14, 2022

Conversation

lsagetlethias
Copy link
Contributor

@lsagetlethias lsagetlethias commented Aug 10, 2022

Objectif(s)

  • remplacement de la récupération des mails "as is" par un moteur d'index
  • ajout d'un client/server pour les workers afin de simplifier leur utilisation
  • ajout d'une db locale pour sauvegarder temporairement les informations au lieu de les serializer entre worker et main
  • ajout d'un worker pour fetch des emails en fonction de leurs indexes
  • changement de la mécanique des vues où une vue utilise une "group function" pour grouper les emails en fonction d'un critère. Les filtres se font ensuite par intersection des grroupes. Les vues peuvent donc être dans n'importe quel ordre et être configurable

Done

  • Worker Client/Server
  • DB client
  • use group functions during extract
  • add "createNewGroup" command to extract worker (or another worker if needed) to lately generate new sets of indexes (by sent/received and deleted when deleted folder is choosed)
  • extract extrem dates as additionalDatas
  • fix DashboardRecap
  • fix exporters
  • fix TagManager
  • fix breadcrumbs
  • new version of archimail-pst-extractor

Won't do:

Next PRs:

  • doc
  • Impact store
  • Recap store
  • stylelint
  • add loading bar for async compute (index generation (new group), export, fetch email)
  • add config screen for views and group functions

@socket-security
Copy link

socket-security bot commented Aug 10, 2022

Socket Security Report

Dependency issues detected. If you merge this pull request, you will not be alerted to the instances of these issues again.

📜 New install scripts detected

A dependency change in this PR is introducing new install scripts to your install step.

Package Script field Location
classic-level@1.2.0 (added) binding.gyp package.json via level@8.0.0
@sentry/cli@1.74.5 (upgraded) install package.json via @sentry/webpack-plugin@1.19.0
classic-level@1.2.0 (added) install package.json via level@8.0.0
🫣 Native code

Contains native code which could be a vector to obscure malicious code, and generally decrease the likelihood of reproducible or reliable installs.

Package Location
classic-level@1.2.0 (added) package.json via level@8.0.0
Socket.dev scan summary
Issue Status
Did you mean? ✅ no new possible package typos
Install scripts ⚠️ 3 new install scripts detected
Telemetry ✅ no new telemetry
Troll package ✅ no new troll packages
Malware ✅ no new malware
Native code ⚠️ 1 new native module detected

Powered by socket.dev

@codecov-commenter
Copy link

Codecov Report

Base: 4.85% // Head: 5.16% // Increases project coverage by +0.31% 🎉

Coverage data is based on head (763ef8f) compared to base (cc90c1d).
Patch coverage: 4.04% of modified lines in pull request are covered.

Additional details and impacted files
@@           Coverage Diff            @@
##             dev    #216      +/-   ##
========================================
+ Coverage   4.85%   5.16%   +0.31%     
========================================
  Files        114     125      +11     
  Lines       2760    3020     +260     
  Branches     414     427      +13     
========================================
+ Hits         134     156      +22     
- Misses      2506    2738     +232     
- Partials     120     126       +6     
Impacted Files Coverage Δ
src/common/constant/event.ts 0.00% <ø> (ø)
src/common/lib/ipc/index.ts 100.00% <ø> (ø)
src/common/modules/FileExporterModule.ts 0.00% <0.00%> (ø)
src/common/modules/I18nModule.ts 0.00% <0.00%> (ø)
src/common/modules/IpcModule.ts 0.00% <0.00%> (ø)
src/common/modules/Module.ts 76.19% <ø> (ø)
src/common/modules/TrackerModule.ts 0.00% <0.00%> (ø)
src/common/modules/UserConfigModule.ts 0.00% <0.00%> (ø)
src/common/modules/exporters/CsvExporter.ts 0.00% <ø> (ø)
src/common/modules/exporters/EmlExporter.ts 0.00% <0.00%> (ø)
... and 67 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

@lsagetlethias lsagetlethias marked this pull request as ready for review September 14, 2022 16:38
@sonarcloud
Copy link

sonarcloud bot commented Sep 14, 2022

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@lsagetlethias lsagetlethias changed the title feat: email indexation + save work feat: email indexation Sep 14, 2022
@lsagetlethias lsagetlethias merged commit 04d0555 into dev Sep 14, 2022
@lsagetlethias lsagetlethias deleted the feature/save-work branch September 14, 2022 16:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Importer des pst jusqu'à 100 Go
3 participants