Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

task2vec complexity using normalized/standardized values #16

Open
brando90 opened this issue Feb 7, 2023 · 0 comments
Open

task2vec complexity using normalized/standardized values #16

brando90 opened this issue Feb 7, 2023 · 0 comments

Comments

@brando90
Copy link

brando90 commented Feb 7, 2023

I saw the task2vec complexity using l1. But the l1 complexities might not be comparable across data sets. How would you suggest to adjust this metric s.t. its directly comparable accross data sets?

My suggestion is to divide perhaps by the std l1 complexity for that data set e.g.:

standardized_complexity = avg_complexity(task2vecs_list, l1) / unbiased_std_complexity(task2vecs_list, l1)

thoughts? This does assume normality and n>=30. Histograms showing normality might be useful.


related: https://stats.stackexchange.com/questions/604296/how-does-one-create-comparable-metrics-when-the-original-metrics-are-not-compara

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant