Skip to content

Pjvl99/Con-Prod

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Web scrapping using producers y consumers

Description: It is required to store the relationship between films and actresses in a database. The films in which each actress has worked are defined on each web page of the filmography in which the actress has acted.

  • Diagram:

prodcondiagram

Tools:

  • Go: To create and manage consumers and producers
  • Docker
    • mysql: Store all data

Project Execution

Database - Docker Mysql

docker-compose up

GO - Producers and consumers

./pcb #Producers #Consumers

In #Producers we put the number of producers and in #Consumers the number of consumers. To run this command docker must be running.

Execution

The idea is to create a number of producers who collect the data for each actress and pass it to consumers without a race condition occurring that causes the data to be repeated.

img1

img4

img5

img6

In the database you can see the results, without any repeated actress data.

img2

img3

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages