Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sentence similarity default widget and pipeline type #52

Merged
merged 3 commits into from
May 25, 2021
Merged

Sentence similarity default widget and pipeline type #52

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
766671e
Add default widget and type for sentence similarity
osanseviero May 25, 2021
ff71d7c
format
osanseviero May 25, 2021
c4ba900
Add other languages
osanseviero May 25, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
100 changes: 100 additions & 0 deletions interfaces/DefaultWidget.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -120,6 +120,16 @@ const MAPPING_EN: PerLanguageMapping = new Map([
`Paris is the <mask> of France.`,
`The goal of life is <mask>.`,
] ],
[ "sentence-similarity", [
{
source_sentence: "That is a happy person",
sentences: [
"That is a happy dog",
"That is a very happy person",
"Today is a sunny day"
]
},
] ],
osanseviero marked this conversation as resolved.
Show resolved Hide resolved
]);

const MAPPING_ZH: PerLanguageMapping = new Map([
Expand Down Expand Up @@ -163,6 +173,16 @@ const MAPPING_ZH: PerLanguageMapping = new Map([
`巴黎是<mask>国的首都。`,
`生活的真谛是<mask>。`
] ],
[ "sentence-similarity", [
{
source_sentence: "那是 個快樂的人",
sentences: [
"那是 條快樂的狗",
"那是 個非常幸福的人",
"今天是晴天"
]
},
] ],
]);

const MAPPING_FR: PerLanguageMapping = new Map([
Expand Down Expand Up @@ -192,6 +212,16 @@ const MAPPING_FR: PerLanguageMapping = new Map([
[ "fill-mask", [
`Paris est la <mask> de la France.`,
] ],
[ "sentence-similarity", [
{
source_sentence: "C'est une personne heureuse",
sentences: [
"C'est un chien heureux",
"C'est une personne très heureuse",
"Aujourd'hui est une journée ensoleillée"
]
},
] ],
]);

const MAPPING_ES: PerLanguageMapping = new Map([
Expand Down Expand Up @@ -233,6 +263,16 @@ const MAPPING_ES: PerLanguageMapping = new Map([
`Mi nombre es <mask> y vivo en Nueva York.`,
`El español es un idioma muy <mask> en el mundo.`,
] ],
[ "sentence-similarity", [
{
source_sentence: "Esa es una persona feliz",
sentences: [
"Ese es un perro feliz",
"Esa es una persona muy feliz",
"Hoy es un día soleado"
]
},
] ],
]);

const MAPPING_RU: PerLanguageMapping = new Map([
Expand Down Expand Up @@ -262,6 +302,16 @@ const MAPPING_RU: PerLanguageMapping = new Map([
[ "fill-mask", [
`Меня зовут <mask> и я инженер живущий в Нью-Йорке.`,
] ],
[ "sentence-similarity", [
{
source_sentence: "Это счастливый человек",
sentences: [
"Это счастливая собака",
"Это очень счастливый человек",
"Сегодня солнечный день"
]
},
] ],
]);

const MAPPING_UK: PerLanguageMapping = new Map([
Expand Down Expand Up @@ -314,6 +364,16 @@ const MAPPING_IT: PerLanguageMapping = new Map([
`Roma è la <mask> d'Italia.`,
`Lo scopo della vita è <mask>.`,
] ],
[ "sentence-similarity", [
{
source_sentence: "Questa è una persona felice",
sentences: [
"Questo è un cane felice",
"Questa è una persona molto felice",
"Oggi è una giornata di sole"
]
},
] ],
]);

const MAPPING_FA: PerLanguageMapping = new Map([
Expand Down Expand Up @@ -383,6 +443,16 @@ const MAPPING_AR: PerLanguageMapping = new Map([
`باريس <mask> فرنسا.`,
`فلسفة الحياة هي <mask>.`,
] ],
[ "sentence-similarity", [
{
source_sentence: "هذا شخص سعيد",
sentences: [
"هذا كلب سعيد",
"هذا شخص سعيد جدا",
"اليوم هو يوم مشمس"
]
},
] ],
]);


Expand Down Expand Up @@ -411,6 +481,16 @@ const MAPPING_BN: PerLanguageMapping = new Map([
`আমি বাংলায় <mask> গাই।`,
`আমি <mask> খুব ভালোবাসি। `,
] ],
[ "sentence-similarity", [
{
source_sentence: "সে একজন সুখী ব্যক্তি",
sentences: [
"সে হ্যাপি কুকুর",
"সে খুব সুখী মানুষ",
"আজ একটি রৌদ্রোজ্জ্বল দিন"
]
},
] ],
]);

const MAPPING_MN: PerLanguageMapping = new Map([
Expand Down Expand Up @@ -468,6 +548,16 @@ const MAPPING_MN: PerLanguageMapping = new Map([
`Энэхүү жишээ нь цаанаа ямар ч утга агуулаагүй болно`,
`Сар шинэдээ сайхан шинэлэж байна уу?`,
] ],
[ "sentence-similarity", [
{
source_sentence: "Энэ бол аз жаргалтай хүн юм",
sentences: [
"Энэ бол аз жаргалтай нохой юм",
"Энэ бол маш их аз жаргалтай хүн юм",
"Өнөөдөр нарлаг өдөр байна"
]
},
] ],
]);

const MAPPING_SI: PerLanguageMapping = new Map([
Expand All @@ -492,6 +582,16 @@ const MAPPING_DE: PerLanguageMapping = new Map([
context: `Der Amazonas-Regenwald, auf Englisch auch als Amazonien oder Amazonas-Dschungel bekannt, ist ein feuchter Laubwald, der den größten Teil des Amazonas-Beckens Südamerikas bedeckt. Dieses Becken umfasst 7.000.000 Quadratkilometer (2.700.000 Quadratmeilen), von denen 5.500.000 Quadratkilometer (2.100.000 Quadratmeilen) vom Regenwald bedeckt sind. Diese Region umfasst Gebiete von neun Nationen. Der größte Teil des Waldes befindet sich in Brasilien mit 60% des Regenwaldes, gefolgt von Peru mit 13%, Kolumbien mit 10% und geringen Mengen in Venezuela, Ecuador, Bolivien, Guyana, Suriname und Französisch-Guayana. Staaten oder Abteilungen in vier Nationen enthalten "Amazonas" in ihren Namen. Der Amazonas repräsentiert mehr als die Hälfte der verbleibenden Regenwälder des Planeten und umfasst den größten und artenreichsten tropischen Regenwald der Welt mit geschätzten 390 Milliarden Einzelbäumen, die in 16.000 Arten unterteilt sind.`,
}
] ],
[ "sentence-similarity", [
{
source_sentence: "Das ist eine glückliche Person",
sentences: [
"Das ist ein glücklicher Hund",
"Das ist eine sehr glückliche Person",
"Heute ist ein sonniger Tag"
]
},
] ],
]);

const MAPPING_DV: PerLanguageMapping = new Map([
Expand Down
2 changes: 2 additions & 0 deletions interfaces/Types.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,7 @@ export enum PipelineType {
"text-generation" = "text-generation",
"text2text-generation" = "text2text-generation",
"fill-mask" = "fill-mask",
"sentence-similarity" = "sentence-similarity",
/// audio
"text-to-speech" = "text-to-speech",
"automatic-speech-recognition" = "automatic-speech-recognition",
Expand Down Expand Up @@ -42,6 +43,7 @@ export const PIPELINE_TYPE_PRETTY_NAMES: { [key in PipelineType]: string } = {
"text-generation": "Text Generation",
"text2text-generation": "Text2Text Generation",
"fill-mask": "Fill-Mask",
"sentence-similarity": "Sentence Similarity",
/// audio
"text-to-speech": "Text-to-Speech",
"automatic-speech-recognition": "Automatic Speech Recognition",
Expand Down