An M.A. educational project on computational linguistics.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
api_modules
article
crawlers
crowdsourcing
meetups
metadata
ner_markup
presentations
readability
rubric_lists
term_extraxtion
.gitignore
README.md
define_contexts.txt
formalize_contexts.txt
important_notes.md
progress_indicator.md
project_specification.md
test_doc.txt

README.md

Popular science texts compling research

This is an M.A. educational project on computational linguistics. The goal of the project is to analyze the Russian segment of popular science websites using tools and methods of computational linguistics.

The text dataset accumulated over the years serves as a valuable source for solving our research tasks in description below.

Research tasks and methods

1. Do the texts about the same scientific field have similarities? Do they resemble each other?

Responsible: Anna Lapidus

Are the texts from the different sciences different? What texts fall into a different category not relevant to their actual one after clusterization? After using alternative clusterization methods what texts fall into the categories that differ from the ones in the previous analysis?

Methods: text similarity metrics, text clusterization, topic modeling.

Problems: All the sources used in this research have different elements in the rubrication structure that often don't match each other, so we will have to develop our own topic classificator.

Expected result: Conclusions about text similarity, scientific disciplines' graph with nodes representing disciplines and edges representing text similarity.

2. What scientific terms are used by scholars in popular space?

Responsible: Julia Kolomenskaya

Popular text must become understandable for the public, thus it should not be overloaded and overcomplicated with specific terms. The term usage in the educational texts should be restricted so that only the most important ones remain.

Methods: fact extraction.

Problems: A variety of language constructions that are used in different scientific areas to introduce terminology. We will have to read a bunch of texts extracting specific frame templates for term introduction.

Expected result: Term frequency dictionary of popular science texts; terms' graph (nodes will be the extracted terms and edges will be their joint occurrence in the texts), word2vec model and a visualization of terms relations based on it.

3. Who are the most cited researchers in popular texts?

Responsible: Anastasia Kuznetsova

Sometimes the names of scientists who discovered something are mentioned in popular scientific articles, but not all the time. There is an assumption that scientific knowledge is of collective nature and the influence of a certain person is considered to be minimal. We would like to find out whether it is true or not. How frequently is the researcher's name mentioned in popular scientific articles?

Methods: named entity recognition.

Problems: Not all the named entities in articles are personal names and not all the personal names are the names of scientists. How shall we distinguish them?

Expected result: The most cited scientists' chart in comparison with official bibliographical metrics.

4. Popular texts scale of readability. Responsible: Ksenia Samoilenko

Is this true that popular scientific texts are more readable than academic?

Methods: readability metrics.

Expected result: Distribution of the texts on a readability scale; analytic approach (which text are less difficult to read, in what scientific areas, resources etc.); visualization.

Sources

  1. PostNauka: https://postnauka.ru/
  2. Lecture on Polit.ru: http://www.polit.ru/lectures/publ_lect/
  3. ProScience rubric on Polit.ru: http://www.polit.ru/rubric/proscience/
  4. Arzamas: http://arzamas.academy/
  5. Indicator: https://indicator.ru/
  6. Cherdak: https://chrdk.ru/
  7. Hub on Geektimes: https://geektimes.ru/hub/popular_science/
  8. N+1: http://nplus1.ru/

Metadata & Rubrics

Final metatable with unique rubric assigned to each text - https://github.com/ana-kuznetsova/Popular-Science-Texts-Compling-research/blob/master/metadata/meta_rubrics_final.tsv

Team & contacts

Anna Lapidus: anyalapidus@list.ru

Anastasia Kuznetsova: menina.indigena.17@gmail.com

Julia Kolomenskaya: j.kolomenskaya@gmail.com

Ksenia Samoilenko: kssamoylenko@yandex.ru

Research Supervisor

Boris Orekhov: nevmenandr@gmail.com