Sim search b2f #72

grololo06 · 2023-12-22T05:53:04Z

PR to discuss about changes

…arity search to object_set/{project_id}/query

…om front to be continued....

py/main.py

moilerat · 2023-12-22T08:40:41Z

@grololo06 : je tente de soumettre ici ce que je m'apprete à faire :

Etape 3/4 de la recherche par similarité :
- Je vais renvoyer des objects EnumeratedObjectSet plutot que DescribedObjectSet,
Etape 4/4 de la recherche par similarité :
- et rajouter un fichier unsupervised.py dans API_models.
- et j'aurai besoin de requete dans PG que j'espère pouvoir glisser dans des fichiers déjà existant et approprié

Je vais aussi devoir refaire l'etape 2 vu que c'est du code généré (mais pour moi ce n'est pas bloquant pour aller jusqu'au bout de mon POC) (ie generate openapi.json depuis le back et généré le code dans le front à partir de openapi.json)
Et tu me dis avoir un bug dans l'etape 1 (front), mais je ne sais pas comment le reproduire.

grololo06

Just a few remarks

.github/workflows/auto_tests.yml

py/main.py

py/DB/CNNFeatureVector.py

py/API_models/UnsupervisedSearch.py

py/API_models/filters.py

…nt change) https://app.clickup.com/t/86bwqp6jp

…cotaxa_back/pull/72/files/64579a46644272002e96bae7b255c960d41ba80f#diff-94bbcc1b33ad7aae0725c6a86f78b32f40d8686cfe46c8594267baefb504c73a

grololo06

J'ai enfin compris comment ça marche!

py/API_operations/imports/Import.py

py/API_operations/SimilaritySearch.py

py/cmds/db_upg/versions/32a0ff0184b6_create_cnnfeature_table_with_pgvector.py

…grololo

…grololo advice

…ge in their config

… sim_search_b2f

…n pg

…dev (from my own's understanding)

# .github/workflows/auto_tests.yml

grololo06 · 2024-02-20T08:47:46Z

To redo but not me.

moilerat and others added 5 commits December 15, 2023 16:09

wip sim search integration

baedf7e

move feature extraction to import

8ce0f33

- JsonDict -> List[Dict]

add930f

samples are not correct, we need to have a similar endpoint for simil…

5fac3bd

…arity search to object_set/{project_id}/query

typo in endpoint that doesn't explain the fact it is not reachable fr…

43ff498

…om front to be continued....

grololo06 temporarily deployed to Env_for_Actions December 22, 2023 05:53 — with GitHub Actions Inactive

grololo06 commented Dec 22, 2023

View reviewed changes

py/main.py Outdated Show resolved Hide resolved

add seed_object_id in filter to get them in api on back

5eaf4b1

moilerat temporarily deployed to Env_for_Actions December 22, 2023 22:49 — with GitHub Actions Inactive

I would rather put out of github the .idea

53ff797

moilerat temporarily deployed to Env_for_Actions December 23, 2023 09:03 — with GitHub Actions Inactive

fix typo in endpoint

6ded9bf

moilerat temporarily deployed to Env_for_Actions December 23, 2023 09:57 — with GitHub Actions Inactive

first working version of unsupervised search in ecotaxa by lovnower, wip

0649bea

moilerat had a problem deploying to Env_for_Actions December 23, 2023 16:38 — with GitHub Actions Failure

cleaning

00180b8

moilerat had a problem deploying to Env_for_Actions December 23, 2023 17:33 — with GitHub Actions Failure

replace obj_cnn_features table with obj_cnn_features_vector

732fa26

emmaamblard had a problem deploying to Env_for_Actions January 11, 2024 15:07 — with GitHub Actions Failure

use postgres docker with pgvector installed for automated tests

5547438

emmaamblard temporarily deployed to Env_for_Actions January 11, 2024 15:20 — with GitHub Actions Inactive

grololo06 commented Jan 12, 2024

View reviewed changes

add basic similarity search as a job + test

eeb5ecb

emmaamblard had a problem deploying to Env_for_Actions January 23, 2024 15:27 — with GitHub Actions Failure

attempt to fix import bug in simsearch test

57bc453

emmaamblard temporarily deployed to Env_for_Actions January 23, 2024 15:57 — with GitHub Actions Inactive

add filters to similarity search

4899815

emmaamblard had a problem deploying to Env_for_Actions January 24, 2024 15:19 — with GitHub Actions Failure

remove print and broken test

ab3ef53

moilerat temporarily deployed to Env_for_Actions February 17, 2024 11:30 — with GitHub Actions Inactive

mention emma and lovnower for ss and cnnvector in license (only comme…

e0475c3

…nt change) https://app.clickup.com/t/86bwqp6jp

moilerat temporarily deployed to Env_for_Actions February 17, 2024 13:13 — with GitHub Actions Inactive

fix check that cnn_features are selected https://github.com/ecotaxa/e…

94bc185

…cotaxa_back/pull/72/files/64579a46644272002e96bae7b255c960d41ba80f#diff-94bbcc1b33ad7aae0725c6a86f78b32f40d8686cfe46c8594267baefb504c73a

moilerat had a problem deploying to Env_for_Actions February 17, 2024 15:52 — with GitHub Actions Failure

trying to take into account @grololo remark #72

a1a9abc

moilerat had a problem deploying to Env_for_Actions February 17, 2024 16:04 — with GitHub Actions Failure

update test value for missing descriptors in test ss #72

e673612

moilerat temporarily deployed to Env_for_Actions February 17, 2024 16:32 — with GitHub Actions Inactive

grololo06 commented Feb 18, 2024

View reviewed changes

moilerat and others added 10 commits February 18, 2024 21:05

using pgvector/pgvector:pg16 docker in NRT github actions tests after @…

a98114f

…grololo advice

remove blank line to force github actions that weren't trigge by chan…

0b8d146

…ge in their config

change version migration after following different advice

e34102b

Merge branch 'sim_search_b2f' of github.com:ecotaxa/ecotaxa_back into…

7068f40

… sim_search_b2f

remove useless migration create and drop linked to 'scories' with R i…

f48d3a2

…n pg

remove 'scories' due to different management of password in prod and …

3707c44

…dev (from my own's understanding)

script migrate data cnnfeature vector

f1c90fe

# Conflicts:

fb7b430

# .github/workflows/auto_tests.yml

fix: upgrade script for new pgvector table

b60f723

Merge branch 'master' into sim_search_b2f

190852f

moilerat temporarily deployed to Env_for_Actions February 19, 2024 17:08 — with GitHub Actions Inactive

grololo06 closed this Feb 20, 2024

moilerat temporarily deployed to Env_for_Actions February 20, 2024 09:00 — with GitHub Actions Inactive

moilerat added a commit that referenced this pull request May 2, 2024

trying to take into account @grololo remark #72

2111b96

moilerat pushed a commit that referenced this pull request May 2, 2024

update test value for missing descriptors in test ss #72

7aeeb25

moilerat added a commit that referenced this pull request May 7, 2024

trying to take into account @grololo remark #72

5e85bc2

moilerat pushed a commit that referenced this pull request May 7, 2024

update test value for missing descriptors in test ss #72

abafb9b

moilerat added a commit that referenced this pull request Jun 15, 2024

trying to take into account @grololo remark #72

52642cb

moilerat pushed a commit that referenced this pull request Jun 15, 2024

update test value for missing descriptors in test ss #72

fda7b2e

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Sim search b2f #72

Sim search b2f #72

grololo06 commented Dec 22, 2023

moilerat commented Dec 22, 2023 •

edited

Loading

grololo06 left a comment

grololo06 left a comment

grololo06 commented Feb 20, 2024

Sim search b2f #72

Sim search b2f #72

Conversation

grololo06 commented Dec 22, 2023

moilerat commented Dec 22, 2023 • edited Loading

grololo06 left a comment

Choose a reason for hiding this comment

grololo06 left a comment

Choose a reason for hiding this comment

grololo06 commented Feb 20, 2024

moilerat commented Dec 22, 2023 •

edited

Loading