Adding priorities to statuses while deleting duplicated documents #34
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
pauldechorgnat
force-pushed
the
prioritize-duplicates-deletion
branch
from
97e662a
to
7f5035d
Compare
pauldechorgnat
changed the title
DavidLibeau
reviewed
Aug 22, 2023
| export { cleanDuplicatedDocuments }; | ||
|
|
||
| /** | ||
| * Delete all doubled documents (same source, same documentNumber, same text) |
There was a problem hiding this comment.
C'est encore mentionné "doubled" ici
DavidLibeau
approved these changes
Aug 22, 2023
axel-marbois-octo
pushed a commit
that referenced
this pull request
Nov 9, 2023
* Adding status priority to cleanDuplicated (ex cleanDoubled) * Updating test to assess priority in duplicates deletion * Linting
ajeanneney
added a commit
that referenced
this pull request
Nov 29, 2023
* Fix loss (#1668) * Fix loss * Add test * Add annotator stats panel (#1662) * Add delete button & modify locked/rejected status (#1673) * Fix #1671 (#1675) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * Add summary (#6) * trigger GitHub actions * Add summary * Fix rejected documents (#7) * Remove monitoringEntries (#10) * Fix admin view (#11) * Improve docs (#15) * Add assignation date (#16) * Fix statistics box (#17) * Add ellipsis lines (#19) * Fix job export publishable (#21) * Change route after annotation (#22) * Add importer field (#20) * Add importer field * Add importer field * Fix * Improve personal stats (#23) * Change manual import script (#24) * Clean unused features, remove deprecated & improve docs (#25) * Clean unused script * Remove deprecated * Improve docs & minor fixes * Fix local script * Remove couldBe feature * Remove csvExtractor * Fix INSTALL docs * Fix additionnal annotations (#26) * Fix loss (#28) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * Add juritj (#29) * Fix wording & doc (#18) * Fix wording * Fix doc * Fix anonymizer (#27) * Fix anonymizer * Add replacementTerm module * Fix anonymizer * Add replacementTerm module * Fix cron jobs (#30) * Display checklist (#32) * Display checklist * Fix * Fixes * Fixes * Lint * Improve error page (#33) * Adding priorities to statuses while deleting duplicated documents (#34) * Adding status priority to cleanDuplicated (ex cleanDoubled) * Updating test to assess priority in duplicates deletion * Linting * Fix priority by importer (#35) * Fix priority by importer * Add first mapCourtDecisionToDocument test * Fixes & improve docs (#37) * Fixes & improve docs * Fix docs * Send ids to NLP API (#38) * Send ids to NLP API * Key changes * Remove non public or empty NACCode check (#39) * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * feat: adapt ingresses * feat: deploy via ansible part 1 * feat: use dictionnary for branches env link * feat: add branch.env array in deploy * fix: not use array for link definition * fix: use full path for inventories * fix: adapt rules for label client * fix: typo in label playbook name * init ansible vault for dev and preprod * fix: deploy using inventories selected in case * feat: add deploy files in ansible * fix: yaml typo for disabling build * add public vriables * kube namespace variable to all * add secret * fix: put back build - hash commit image needed * feat: add configmap for label backend * feat: label client configmap init * update secrets * feat: add secrets for label back and client * fix: escape yaml variable * fix: nlp variable * fix: ansible vault file + env branches mapping * fix: typo * add db secret * complete sder database string * fix: add pre hooks for managing rsa keys * fix: update label kube namespace variable name * fix: inject good image variables * fix: nlp api url * fix: nlp api url * fix: string as number definition * fix: solve sder db url syntax * fix: try to suppress spaces in vault * test: test with fake mongodb name * fix: uniformize dev vault * test: echo inventaire * fix: use proper name for inventories * fix: encode with b64 all variable * fix: add ansible definition for deployments * fix: typo triple dash * fix: handle definition of ingresses and services * fix typo triple dash in ingress.yml * fix: triple dash in client ingress * feat: put back builds * feat: use jobs template + map secrets on containers * feat: reconfigure jobs deployment * fix: path for deployment jobs template * fix: error in filename for deployment jobs template * fix: use integers instead of strings for some values in job template * debug: disable build and test with only one job * fix: unquote integer values in jobs template * fix: try to use int as value in defaults.yml * fix: try with int * fix: try another way of casting int * fix: try without dictionary * fix: try to use values set instead of dict * fix: try to cast into int with the new way * test templating * mise à jour gitlab-ci * Correction syntaxe ansible * correction nom fichier * ajout autres jobs * correction gitlab-ci * feat: activate full build and deploy * fix: put good root pathes for label client * fix: change ingressroute override cause name * fix: update sder connection string * fix: fix NLP api URL * try to use correct URL for label in preprod (#52) * use correct host * change label to lbl --------- Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> --------- Co-authored-by: David Libeau <DavidLibeau@users.noreply.github.com> Co-authored-by: Ilias Aaguida <ilias.aaguida@hotmail.fr> Co-authored-by: Axel Marbois <axel.marbois@octo.com> Co-authored-by: Benjamin PILIA <benjamin.pilia@octo.com> Co-authored-by: Paul Déchorgnat <23296889+pauldechorgnat@users.noreply.github.com> Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> Co-authored-by: bepi-octo <71631957+bepi-octo@users.noreply.github.com>
ajeanneney
added a commit
that referenced
this pull request
Dec 6, 2023
* Fix loss (#1668) * Fix loss * Add test * Add annotator stats panel (#1662) * Add delete button & modify locked/rejected status (#1673) * Fix #1671 (#1675) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * Add summary (#6) * trigger GitHub actions * Add summary * Fix rejected documents (#7) * Remove monitoringEntries (#10) * Fix admin view (#11) * Improve docs (#15) * Add assignation date (#16) * Fix statistics box (#17) * Add ellipsis lines (#19) * Fix job export publishable (#21) * Change route after annotation (#22) * Add importer field (#20) * Add importer field * Add importer field * Fix * Improve personal stats (#23) * Change manual import script (#24) * Clean unused features, remove deprecated & improve docs (#25) * Clean unused script * Remove deprecated * Improve docs & minor fixes * Fix local script * Remove couldBe feature * Remove csvExtractor * Fix INSTALL docs * Fix additionnal annotations (#26) * Fix loss (#28) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * Add juritj (#29) * Fix wording & doc (#18) * Fix wording * Fix doc * Fix anonymizer (#27) * Fix anonymizer * Add replacementTerm module * Fix anonymizer * Add replacementTerm module * Fix cron jobs (#30) * Display checklist (#32) * Display checklist * Fix * Fixes * Fixes * Lint * Improve error page (#33) * Adding priorities to statuses while deleting duplicated documents (#34) * Adding status priority to cleanDuplicated (ex cleanDoubled) * Updating test to assess priority in duplicates deletion * Linting * Fix priority by importer (#35) * Fix priority by importer * Add first mapCourtDecisionToDocument test * Fixes & improve docs (#37) * Fixes & improve docs * Fix docs * Send ids to NLP API (#38) * Send ids to NLP API * Key changes * Remove non public or empty NACCode check (#39) * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * feat: adapt ingresses * feat: deploy via ansible part 1 * feat: use dictionnary for branches env link * feat: add branch.env array in deploy * fix: not use array for link definition * fix: use full path for inventories * fix: adapt rules for label client * fix: typo in label playbook name * init ansible vault for dev and preprod * fix: deploy using inventories selected in case * feat: add deploy files in ansible * fix: yaml typo for disabling build * add public vriables * kube namespace variable to all * add secret * fix: put back build - hash commit image needed * feat: add configmap for label backend * feat: label client configmap init * update secrets * feat: add secrets for label back and client * fix: escape yaml variable * fix: nlp variable * fix: ansible vault file + env branches mapping * fix: typo * add db secret * complete sder database string * fix: add pre hooks for managing rsa keys * fix: update label kube namespace variable name * fix: inject good image variables * fix: nlp api url * fix: nlp api url * fix: string as number definition * fix: solve sder db url syntax * fix: try to suppress spaces in vault * test: test with fake mongodb name * fix: uniformize dev vault * test: echo inventaire * fix: use proper name for inventories * fix: encode with b64 all variable * fix: add ansible definition for deployments * fix: typo triple dash * fix: handle definition of ingresses and services * fix typo triple dash in ingress.yml * fix: triple dash in client ingress * feat: put back builds * feat: use jobs template + map secrets on containers * feat: reconfigure jobs deployment * fix: path for deployment jobs template * fix: error in filename for deployment jobs template * fix: use integers instead of strings for some values in job template * debug: disable build and test with only one job * fix: unquote integer values in jobs template * fix: try to use int as value in defaults.yml * fix: try with int * fix: try another way of casting int * fix: try without dictionary * fix: try to use values set instead of dict * fix: try to cast into int with the new way * test templating * mise à jour gitlab-ci * Correction syntaxe ansible * correction nom fichier * ajout autres jobs * correction gitlab-ci * feat: activate full build and deploy * fix: put good root pathes for label client * fix: change ingressroute override cause name * fix: update sder connection string * fix: fix NLP api URL * try to use correct URL for label in preprod (#52) * use correct host * change label to lbl --------- Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> * fix : database connexion * add days arg to export j-4 * Harmonize repo * fix int error * fix api port format * fix : database connexion string parsing * disable CI for dev branch --------- Co-authored-by: David Libeau <DavidLibeau@users.noreply.github.com> Co-authored-by: Ilias Aaguida <ilias.aaguida@hotmail.fr> Co-authored-by: Axel Marbois <axel.marbois@octo.com> Co-authored-by: Benjamin PILIA <benjamin.pilia@octo.com> Co-authored-by: Paul Déchorgnat <23296889+pauldechorgnat@users.noreply.github.com> Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> Co-authored-by: bepi-octo <71631957+bepi-octo@users.noreply.github.com>
ajeanneney
added a commit
that referenced
this pull request
Dec 15, 2023
* New env for dev (#61) * Fix loss (#1668) * Fix loss * Add test * Add annotator stats panel (#1662) * Add delete button & modify locked/rejected status (#1673) * Fix #1671 (#1675) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * Add summary (#6) * trigger GitHub actions * Add summary * Fix rejected documents (#7) * Remove monitoringEntries (#10) * Fix admin view (#11) * Improve docs (#15) * Add assignation date (#16) * Fix statistics box (#17) * Add ellipsis lines (#19) * Fix job export publishable (#21) * Change route after annotation (#22) * Add importer field (#20) * Add importer field * Add importer field * Fix * Improve personal stats (#23) * Change manual import script (#24) * Clean unused features, remove deprecated & improve docs (#25) * Clean unused script * Remove deprecated * Improve docs & minor fixes * Fix local script * Remove couldBe feature * Remove csvExtractor * Fix INSTALL docs * Fix additionnal annotations (#26) * Fix loss (#28) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * Add juritj (#29) * Fix wording & doc (#18) * Fix wording * Fix doc * Fix anonymizer (#27) * Fix anonymizer * Add replacementTerm module * Fix anonymizer * Add replacementTerm module * Fix cron jobs (#30) * Display checklist (#32) * Display checklist * Fix * Fixes * Fixes * Lint * Improve error page (#33) * Adding priorities to statuses while deleting duplicated documents (#34) * Adding status priority to cleanDuplicated (ex cleanDoubled) * Updating test to assess priority in duplicates deletion * Linting * Fix priority by importer (#35) * Fix priority by importer * Add first mapCourtDecisionToDocument test * Fixes & improve docs (#37) * Fixes & improve docs * Fix docs * Send ids to NLP API (#38) * Send ids to NLP API * Key changes * Remove non public or empty NACCode check (#39) * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * feat: adapt ingresses * feat: deploy via ansible part 1 * feat: use dictionnary for branches env link * feat: add branch.env array in deploy * fix: not use array for link definition * fix: use full path for inventories * fix: adapt rules for label client * fix: typo in label playbook name * init ansible vault for dev and preprod * fix: deploy using inventories selected in case * feat: add deploy files in ansible * fix: yaml typo for disabling build * add public vriables * kube namespace variable to all * add secret * fix: put back build - hash commit image needed * feat: add configmap for label backend * feat: label client configmap init * update secrets * feat: add secrets for label back and client * fix: escape yaml variable * fix: nlp variable * fix: ansible vault file + env branches mapping * fix: typo * add db secret * complete sder database string * fix: add pre hooks for managing rsa keys * fix: update label kube namespace variable name * fix: inject good image variables * fix: nlp api url * fix: nlp api url * fix: string as number definition * fix: solve sder db url syntax * fix: try to suppress spaces in vault * test: test with fake mongodb name * fix: uniformize dev vault * test: echo inventaire * fix: use proper name for inventories * fix: encode with b64 all variable * fix: add ansible definition for deployments * fix: typo triple dash * fix: handle definition of ingresses and services * fix typo triple dash in ingress.yml * fix: triple dash in client ingress * feat: put back builds * feat: use jobs template + map secrets on containers * feat: reconfigure jobs deployment * fix: path for deployment jobs template * fix: error in filename for deployment jobs template * fix: use integers instead of strings for some values in job template * debug: disable build and test with only one job * fix: unquote integer values in jobs template * fix: try to use int as value in defaults.yml * fix: try with int * fix: try another way of casting int * fix: try without dictionary * fix: try to use values set instead of dict * fix: try to cast into int with the new way * test templating * mise à jour gitlab-ci * Correction syntaxe ansible * correction nom fichier * ajout autres jobs * correction gitlab-ci * feat: activate full build and deploy * fix: put good root pathes for label client * fix: change ingressroute override cause name * fix: update sder connection string * fix: fix NLP api URL * try to use correct URL for label in preprod (#52) * use correct host * change label to lbl --------- Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> * fix : database connexion * add days arg to export j-4 * Harmonize repo * fix int error * fix api port format * fix : database connexion string parsing * disable CI for dev branch --------- Co-authored-by: David Libeau <DavidLibeau@users.noreply.github.com> Co-authored-by: Ilias Aaguida <ilias.aaguida@hotmail.fr> Co-authored-by: Axel Marbois <axel.marbois@octo.com> Co-authored-by: Benjamin PILIA <benjamin.pilia@octo.com> Co-authored-by: Paul Déchorgnat <23296889+pauldechorgnat@users.noreply.github.com> Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> Co-authored-by: bepi-octo <71631957+bepi-octo@users.noreply.github.com> * replace insee by numeroIdentifiant (#53) * replace insee by numeroIdentifiant * update new category text * filter insee to numeroIdentifiant when map categories * update icon for numeroIdentifiant * lint --------- Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> * Clean deployment files (#62) * Manage sder publish status (#64) * update publishStatus on export * add publishStatusType * lint * sder lib to master commit --------- Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> --------- Co-authored-by: David Libeau <DavidLibeau@users.noreply.github.com> Co-authored-by: Ilias Aaguida <ilias.aaguida@hotmail.fr> Co-authored-by: Axel Marbois <axel.marbois@octo.com> Co-authored-by: Benjamin PILIA <benjamin.pilia@octo.com> Co-authored-by: Paul Déchorgnat <23296889+pauldechorgnat@users.noreply.github.com> Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> Co-authored-by: bepi-octo <71631957+bepi-octo@users.noreply.github.com> Co-authored-by: mauryaland <amaury@fouret.org>
s-diallo
pushed a commit
that referenced
this pull request
Oct 8, 2024
* Adding status priority to cleanDuplicated (ex cleanDoubled) * Updating test to assess priority in duplicates deletion * Linting
s-diallo
pushed a commit
that referenced
this pull request
Oct 8, 2024
* Fix loss (#1668) * Fix loss * Add test * Add annotator stats panel (#1662) * Add delete button & modify locked/rejected status (#1673) * Fix #1671 (#1675) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * Add summary (#6) * trigger GitHub actions * Add summary * Fix rejected documents (#7) * Remove monitoringEntries (#10) * Fix admin view (#11) * Improve docs (#15) * Add assignation date (#16) * Fix statistics box (#17) * Add ellipsis lines (#19) * Fix job export publishable (#21) * Change route after annotation (#22) * Add importer field (#20) * Add importer field * Add importer field * Fix * Improve personal stats (#23) * Change manual import script (#24) * Clean unused features, remove deprecated & improve docs (#25) * Clean unused script * Remove deprecated * Improve docs & minor fixes * Fix local script * Remove couldBe feature * Remove csvExtractor * Fix INSTALL docs * Fix additionnal annotations (#26) * Fix loss (#28) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * Add juritj (#29) * Fix wording & doc (#18) * Fix wording * Fix doc * Fix anonymizer (#27) * Fix anonymizer * Add replacementTerm module * Fix anonymizer * Add replacementTerm module * Fix cron jobs (#30) * Display checklist (#32) * Display checklist * Fix * Fixes * Fixes * Lint * Improve error page (#33) * Adding priorities to statuses while deleting duplicated documents (#34) * Adding status priority to cleanDuplicated (ex cleanDoubled) * Updating test to assess priority in duplicates deletion * Linting * Fix priority by importer (#35) * Fix priority by importer * Add first mapCourtDecisionToDocument test * Fixes & improve docs (#37) * Fixes & improve docs * Fix docs * Send ids to NLP API (#38) * Send ids to NLP API * Key changes * Remove non public or empty NACCode check (#39) * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * feat: adapt ingresses * feat: deploy via ansible part 1 * feat: use dictionnary for branches env link * feat: add branch.env array in deploy * fix: not use array for link definition * fix: use full path for inventories * fix: adapt rules for label client * fix: typo in label playbook name * init ansible vault for dev and preprod * fix: deploy using inventories selected in case * feat: add deploy files in ansible * fix: yaml typo for disabling build * add public vriables * kube namespace variable to all * add secret * fix: put back build - hash commit image needed * feat: add configmap for label backend * feat: label client configmap init * update secrets * feat: add secrets for label back and client * fix: escape yaml variable * fix: nlp variable * fix: ansible vault file + env branches mapping * fix: typo * add db secret * complete sder database string * fix: add pre hooks for managing rsa keys * fix: update label kube namespace variable name * fix: inject good image variables * fix: nlp api url * fix: nlp api url * fix: string as number definition * fix: solve sder db url syntax * fix: try to suppress spaces in vault * test: test with fake mongodb name * fix: uniformize dev vault * test: echo inventaire * fix: use proper name for inventories * fix: encode with b64 all variable * fix: add ansible definition for deployments * fix: typo triple dash * fix: handle definition of ingresses and services * fix typo triple dash in ingress.yml * fix: triple dash in client ingress * feat: put back builds * feat: use jobs template + map secrets on containers * feat: reconfigure jobs deployment * fix: path for deployment jobs template * fix: error in filename for deployment jobs template * fix: use integers instead of strings for some values in job template * debug: disable build and test with only one job * fix: unquote integer values in jobs template * fix: try to use int as value in defaults.yml * fix: try with int * fix: try another way of casting int * fix: try without dictionary * fix: try to use values set instead of dict * fix: try to cast into int with the new way * test templating * mise à jour gitlab-ci * Correction syntaxe ansible * correction nom fichier * ajout autres jobs * correction gitlab-ci * feat: activate full build and deploy * fix: put good root pathes for label client * fix: change ingressroute override cause name * fix: update sder connection string * fix: fix NLP api URL * try to use correct URL for label in preprod (#52) * use correct host * change label to lbl --------- Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> --------- Co-authored-by: David Libeau <DavidLibeau@users.noreply.github.com> Co-authored-by: Ilias Aaguida <ilias.aaguida@hotmail.fr> Co-authored-by: Axel Marbois <axel.marbois@octo.com> Co-authored-by: Benjamin PILIA <benjamin.pilia@octo.com> Co-authored-by: Paul Déchorgnat <23296889+pauldechorgnat@users.noreply.github.com> Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> Co-authored-by: bepi-octo <71631957+bepi-octo@users.noreply.github.com>
s-diallo
pushed a commit
that referenced
this pull request
Oct 8, 2024
* Fix loss (#1668) * Fix loss * Add test * Add annotator stats panel (#1662) * Add delete button & modify locked/rejected status (#1673) * Fix #1671 (#1675) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * Add summary (#6) * trigger GitHub actions * Add summary * Fix rejected documents (#7) * Remove monitoringEntries (#10) * Fix admin view (#11) * Improve docs (#15) * Add assignation date (#16) * Fix statistics box (#17) * Add ellipsis lines (#19) * Fix job export publishable (#21) * Change route after annotation (#22) * Add importer field (#20) * Add importer field * Add importer field * Fix * Improve personal stats (#23) * Change manual import script (#24) * Clean unused features, remove deprecated & improve docs (#25) * Clean unused script * Remove deprecated * Improve docs & minor fixes * Fix local script * Remove couldBe feature * Remove csvExtractor * Fix INSTALL docs * Fix additionnal annotations (#26) * Fix loss (#28) * first commit for the cicd * add deploy and dockerfile * maj ci * feat: ci try in re7 for label * fix: remove comment to comply with gitlab-ci.yml syntax * test: use echos for https proxy * fix: remove backend and client from project name on push * Ajout de l'étape de compilation du front * Ajout proxy pour yarn * Correction gitlab-ci.yml * Correction gitlab-ci.yml * Tentative build * utilisation de node 14 * feat: try to emulate judilibre-ops process * fix: add update in dind build * fix: typo in node name * fix: add yarn in addition of nodejs * fix: add git to packages * debug: ls content after compile * Add juritj (#29) * Fix wording & doc (#18) * Fix wording * Fix doc * Fix anonymizer (#27) * Fix anonymizer * Add replacementTerm module * Fix anonymizer * Add replacementTerm module * Fix cron jobs (#30) * Display checklist (#32) * Display checklist * Fix * Fixes * Fixes * Lint * Improve error page (#33) * Adding priorities to statuses while deleting duplicated documents (#34) * Adding status priority to cleanDuplicated (ex cleanDoubled) * Updating test to assess priority in duplicates deletion * Linting * Fix priority by importer (#35) * Fix priority by importer * Add first mapCourtDecisionToDocument test * Fixes & improve docs (#37) * Fixes & improve docs * Fix docs * Send ids to NLP API (#38) * Send ids to NLP API * Key changes * Remove non public or empty NACCode check (#39) * fix: try changing build path * fix: add login to registry + docker tag for runner * feat: add services for label client and backend * feat: add deploy namespace label * fix: indent * fix: change port for label client * fix: service name errror * fix: use "ugly workaround" to make build work * feat: partially add env variables for label deploy * feat: make backend work in local. TODO : rework prodEnvironment ugly mechanism * feat: initiate mongo from env var instead of json * feat: add jobs deployment * fix: typo in gitlab-ci.yml * fix: move comments for yaml syntax * fix: yaml syntax * fix: temporarily disable backend-client build and deploy * fix: add env var and rules for jobs deploys * test: force redeploy * fix: try escaping job schedules * fix: add quotes to avoid yaml treatment for sched * fix: temporarily disable volume mount config on label * fix: disable volume mounts pt2 * fix: add target for build * fix: add shell tag for label backend * feat: add yarn compile for backend * fix: use docker for build label backend * fix: try node options openssl * fix: apk add npm * fix: add CI false to test yarn build * fix: put back fixed frontend build * feat: add mongodb url in deploy * fix: add quotes for deployment variables * fix: try without curly brackets for mongodb var * fix: try mongodb url withour quotees * test: env var * fix: put back mongodb url * test: test variable on gitlab ci * fix: put back mognodburl * clean: clean code * feat: add connection to nlp pseudonymisation service * fix: use preprod url for label client * fix: add root path in addition of public url * feat: add root path and public url on deploy too * feat: adapt ingresses * feat: deploy via ansible part 1 * feat: use dictionnary for branches env link * feat: add branch.env array in deploy * fix: not use array for link definition * fix: use full path for inventories * fix: adapt rules for label client * fix: typo in label playbook name * init ansible vault for dev and preprod * fix: deploy using inventories selected in case * feat: add deploy files in ansible * fix: yaml typo for disabling build * add public vriables * kube namespace variable to all * add secret * fix: put back build - hash commit image needed * feat: add configmap for label backend * feat: label client configmap init * update secrets * feat: add secrets for label back and client * fix: escape yaml variable * fix: nlp variable * fix: ansible vault file + env branches mapping * fix: typo * add db secret * complete sder database string * fix: add pre hooks for managing rsa keys * fix: update label kube namespace variable name * fix: inject good image variables * fix: nlp api url * fix: nlp api url * fix: string as number definition * fix: solve sder db url syntax * fix: try to suppress spaces in vault * test: test with fake mongodb name * fix: uniformize dev vault * test: echo inventaire * fix: use proper name for inventories * fix: encode with b64 all variable * fix: add ansible definition for deployments * fix: typo triple dash * fix: handle definition of ingresses and services * fix typo triple dash in ingress.yml * fix: triple dash in client ingress * feat: put back builds * feat: use jobs template + map secrets on containers * feat: reconfigure jobs deployment * fix: path for deployment jobs template * fix: error in filename for deployment jobs template * fix: use integers instead of strings for some values in job template * debug: disable build and test with only one job * fix: unquote integer values in jobs template * fix: try to use int as value in defaults.yml * fix: try with int * fix: try another way of casting int * fix: try without dictionary * fix: try to use values set instead of dict * fix: try to cast into int with the new way * test templating * mise à jour gitlab-ci * Correction syntaxe ansible * correction nom fichier * ajout autres jobs * correction gitlab-ci * feat: activate full build and deploy * fix: put good root pathes for label client * fix: change ingressroute override cause name * fix: update sder connection string * fix: fix NLP api URL * try to use correct URL for label in preprod (#52) * use correct host * change label to lbl --------- Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> * fix : database connexion * add days arg to export j-4 * Harmonize repo * fix int error * fix api port format * fix : database connexion string parsing * disable CI for dev branch --------- Co-authored-by: David Libeau <DavidLibeau@users.noreply.github.com> Co-authored-by: Ilias Aaguida <ilias.aaguida@hotmail.fr> Co-authored-by: Axel Marbois <axel.marbois@octo.com> Co-authored-by: Benjamin PILIA <benjamin.pilia@octo.com> Co-authored-by: Paul Déchorgnat <23296889+pauldechorgnat@users.noreply.github.com> Co-authored-by: Antoine Jeanneney <antoine.jeanneney@justice.fr> Co-authored-by: bepi-octo <71631957+bepi-octo@users.noreply.github.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Issue:
Changes