Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NDCG and Confusion Matrix Examples #8

Open
wontonswaggie opened this issue Sep 30, 2020 · 3 comments
Open

NDCG and Confusion Matrix Examples #8

wontonswaggie opened this issue Sep 30, 2020 · 3 comments

Comments

@wontonswaggie
Copy link
Contributor

wontonswaggie commented Sep 30, 2020

Create a usage example on how these ranking metrics can be used:

+------------------------------------------------------------+-------------------------------------------------------------------------------+
| Python API                                                 | Description                                                                   |
+============================================================+===============================================================================+
| `metriks.ndcg(y_true, y_prob, k)`                          | A score for measuring the quality of a set of ranked results.                 |
+------------------------------------------------------------+-------------------------------------------------------------------------------+
| `metriks.confusion_matrix_at_k(y_true, y_prob, k)`         | Generates binary predictions from probabilities by evaluating the top k       |
|                                                            | items (in ranked order by y_prob) as true.                                    |
+------------------------------------------------------------+-------------------------------------------------------------------------------+
  1. Identify a dataset that can be used to train a ranking model
  2. Train a ranking model with the data
  3. Use the given metrics above and show results and demonstrate how these metrics can be used
@asaljalilvand
Copy link

Hi, I'm an attendee at the GHC 2020 and I'm interested in working on this issue.

@wontonswaggie wontonswaggie changed the title HelloWorld Examples NDCG and Confusion Matrix Examples Oct 1, 2020
@kshithi03
Copy link

I'm a GHC 2020 attendee and would like to contribute to this issue. Thanks!

@swati-murmu
Copy link

I'm a GHC 2020 attendee and would like to contribute to this issue. Thanks!

Hi. I am a vGHC 2020 attendee too. I have created a slack channel named #opentrack-metriks-8. If you could join that channel, we could start working on it together!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants