Skip to content

The objective of this assignment is to extract textual data articles from the given URL and perform text analysis to compute variables that are explained

Notifications You must be signed in to change notification settings

vansh-py04/BlackCoffer-Data-Extraction-and-Text-Analysis-

Repository files navigation

Data Extraction and NLP Text Analysis

To complete this assignment, I will first extract textual data articles from the provided URL and save the extracted article text in separate text files, with the URL_ID as the file name. During extraction, I'll ensure to include only the article title and text, excluding any website header, footer, or other irrelevant content.

Once the extraction is complete, I'll proceed with the text analysis as per the variables defined in the "Text Analysis.docx" file. I'll compute each variable for every extracted article text and organize the results according to the structure specified in the "Output Data Structure.xlsx" file.

My process will involve thorough text processing techniques, including tokenization, sentence segmentation, part-of-speech tagging, named entity recognition, and sentiment analysis, among others, to accurately compute the required variables.

After analyzing each article text and computing the variables, I'll save the output in the specified format, ensuring that the variables are presented in the exact order as specified in the output structure file.

Throughout the process, I'll maintain accuracy, efficiency, and adherence to the provided instructions to produce the desired output.

About

The objective of this assignment is to extract textual data articles from the given URL and perform text analysis to compute variables that are explained

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published