Skip to content

Repository files navigation

Word2Vec Models: CBOW and SkipGram

Skill Icons

In this repository, two popular Word2Vec architectures are implemented: CBOW (Continuous Bag of Words) and SkipGram. Both models are used for generating vector representations of words, known as embeddings.

Description

CBOW (Continuous Bag Of Words)

CBOW predicts target words from context words. Given a set of context words, CBOW tries to predict the word in the middle.

Example:

  • Sentence: "The cat sleeps on the bed".
  • Context words: "The", "cat", "on", "the".
  • Target word: "sleeps".

SkipGram

SkipGram does the opposite of CBOW. Given a word, it tries to predict the context words.

Example:

  • Sentence: "The cat sleeps on the bed".
  • Target word: "sleeps".
  • Context words: "The", "cat", "on", "the".

Contact

(c) 2023 José Juan Hernández Gálvez
Github: https://github.com/josejuanhernandezgalvez
(c) 2023 Jorge Lang-Lenton Ferreiro
Github: https://github.com/JorgeLLF

About

This repository is dedicated to the exploration and implementation of two foundational Word2Vec architectures: CBOW (Continuous Bag of Words) and SkipGram. Word2Vec is a collection of models that are designed to learn word representations - mapping words or phrases from the vocabulary to vectors of numbers.

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages