Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Added RuSentNE-2023 evaluation #638

Merged
merged 3 commits into from
Jun 23, 2024
Merged

Added RuSentNE-2023 evaluation #638

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
1b50852
Update sentiment-analysis.md
antongolubev5 May 30, 2023
a1f7d02
Update sentiment-analysis.md
antongolubev5 May 30, 2023
90405a0
Update sentiment-analysis.md
antongolubev5 May 30, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 16 additions & 0 deletions russian/sentiment-analysis.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,3 +22,19 @@ The public leaderboard is available at [github repository](https://github.com/ni
| ... Meanwhile <ins>Moscow</ins> has repeatedly emphasized that its activity in the <ins>Baltic Sea</ins> is a response precisely to actions of **<ins>NATO</ins>** and the escalation of the hostile approach to **<ins>Russia</ins>** near its eastern borders ...
| (NATO->Russia, neg), (Russia->NATO, neg) |

## RuSentNE-2023

The dataset for RuSentNE-2023 evaluation is based on the Russian news corpus RuSentNE having rich sentiment-related annotation. The corpus
is annotated with named entities and sentiments towards these entities, along with related effects and emotional states. The dataset contains over 11000 sentences from 400+ large texts.

**Entity-Oriented Sentiment Analysis task:** Given a subset of sentences, in which every sentence includes one or several named entities. For each sentence all of the named entities should be classified into one of three sentiment classes: positive, negative or neutral within the context of a single sentence.

Task paper: https://arxiv.org/pdf/2305.17679.pdf

The public leaderboard is available at [github repository](https://github.com/dialogue-evaluation/RuSentNE-evaluation)

| Example |
|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Notorious figure in the country - <ins>Berlusconi</ins> has been repeatedly accused of financial fraud
| (Berlusconi-> neg)