/
airbyte.yml
294 lines (294 loc) · 9.53 KB
/
airbyte.yml
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
capabilities:
- about
- catalog
- discover
- schema-flattening
- state
- stream-maps
description: News API
domain_url: https://gnews.io/
executable: tap-airbyte
keywords:
- airbyte_protocol
- meltano_sdk
label: GNews
logo_url: /assets/logos/extractors/gnews.png
maintenance_status: beta
name: tap-gnews
namespace: tap_airbyte
next_steps: ''
pip_url: git+https://github.com/MeltanoLabs/tap-airbyte-wrapper.git
quality: bronze
repo:
https://github.com/airbytehq/airbyte/tree/master/airbyte-integrations/connectors/source-gnews
settings:
- description: API Key
kind: password
label: Airbyte Config Api Key
name: airbyte_config.api_key
sensitive: true
- description: This parameter allows you to specify the country where the news articles
returned by the API were published, the contents of the articles are not necessarily
related to the specified country. You have to set as value the 2 letters code
of the country you want to filter.
kind: options
label: Airbyte Config Country
name: airbyte_config.country
options:
- label: Au
value: au
- label: Br
value: br
- label: Ca
value: ca
- label: Cn
value: cn
- label: Eg
value: eg
- label: Fr
value: fr
- label: De
value: de
- label: Gr
value: gr
- label: Hk
value: hk
- label: In
value: in
- label: Ie
value: ie
- label: Il
value: il
- label: It
value: it
- label: Jp
value: jp
- label: Nl
value: nl
- label: No
value: no
- label: Pk
value: pk
- label: Pe
value: pe
- label: Ph
value: ph
- label: Pt
value: pt
- label: Ro
value: ro
- label: Ru
value: ru
- label: Sg
value: sg
- label: Es
value: es
- label: Se
value: se
- label: Ch
value: ch
- label: Tw
value: tw
- label: Ua
value: ua
- label: Gb
value: gb
- label: Us
value: us
- description: 'This parameter allows you to filter the articles that have a publication
date smaller than or equal to the specified value. The date must respect the
following format: YYYY-MM-DD hh:mm:ss (in UTC)'
kind: string
label: Airbyte Config End Date
name: airbyte_config.end_date
- description: This parameter allows you to choose in which attributes the keywords
are searched. The attributes that can be set are title, description and content.
It is possible to combine several attributes.
kind: array
label: Airbyte Config In
name: airbyte_config.in
- description: ''
kind: options
label: Airbyte Config Language
name: airbyte_config.language
options:
- label: Ar
value: ar
- label: Zh
value: zh
- label: Nl
value: nl
- label: En
value: en
- label: Fr
value: fr
- label: De
value: de
- label: El
value: el
- label: He
value: he
- label: Hi
value: hi
- label: It
value: it
- label: Ja
value: ja
- label: Ml
value: ml
- label: Mr
value: mr
- label: No
value: no
- label: Pt
value: pt
- label: Ro
value: ro
- label: Ru
value: ru
- label: Es
value: es
- label: Sv
value: sv
- label: Ta
value: ta
- label: Te
value: te
- label: Uk
value: uk
- description: This parameter allows you to specify the attributes that you allow
to return null values. The attributes that can be set are title, description
and content. It is possible to combine several attributes
kind: array
label: Airbyte Config Nullable
name: airbyte_config.nullable
- description: "This parameter allows you to specify your search keywords to find
the news articles you are looking for. The keywords will be used to return the
most relevant articles. It is possible to use logical operators with keywords.
- Phrase Search Operator: This operator allows you to make an exact search. Keywords
surrounded by \n quotation marks are used to search for articles with the exact
same keyword sequence. \n For example the query: \"Apple iPhone\" will return
articles matching at least once this sequence of keywords.\n- Logical AND Operator:
This operator allows you to make sure that several keywords are all used in the
article\n search. By default the space character acts as an AND operator, it
is possible to replace the space character \n by AND to obtain the same result.
For example the query: Apple Microsoft is equivalent to Apple AND Microsoft\n
- Logical OR Operator: This operator allows you to retrieve articles matching
the keyword a or the keyword b.\n It is important to note that this operator
has a higher precedence than the AND operator. For example the \n query: Apple
OR Microsoft will return all articles matching the keyword Apple as well as all
articles matching \n the keyword Microsoft\n- Logical NOT Operator: This operator
allows you to remove from the results the articles corresponding to the\n specified
keywords. To use it, you need to add NOT in front of each word or phrase surrounded
by quotes.\n For example the query: Apple NOT iPhone will return all articles
matching the keyword Apple but not the keyword\n iPhone"
kind: string
label: Airbyte Config Query
name: airbyte_config.query
- description: "This parameter allows you to choose with which type of sorting the
articles should be returned. Two values are possible:\n - publishedAt = sort
by publication date, the articles with the most recent publication date are returned
first\n - relevance = sort by best match to keywords, the articles with the best
match are returned first"
kind: options
label: Airbyte Config Sortby
name: airbyte_config.sortby
options:
- label: Publishedat
value: publishedAt
- label: Relevance
value: relevance
- description: 'This parameter allows you to filter the articles that have a publication
date greater than or equal to the specified value. The date must respect the
following format: YYYY-MM-DD hh:mm:ss (in UTC)'
kind: string
label: Airbyte Config Start Date
name: airbyte_config.start_date
- description: "This parameter allows you to specify your search keywords to find
the news articles you are looking for. The keywords will be used to return the
most relevant articles. It is possible to use logical operators with keywords.
- Phrase Search Operator: This operator allows you to make an exact search. Keywords
surrounded by \n quotation marks are used to search for articles with the exact
same keyword sequence. \n For example the query: \"Apple iPhone\" will return
articles matching at least once this sequence of keywords.\n- Logical AND Operator:
This operator allows you to make sure that several keywords are all used in the
article\n search. By default the space character acts as an AND operator, it
is possible to replace the space character \n by AND to obtain the same result.
For example the query: Apple Microsoft is equivalent to Apple AND Microsoft\n
- Logical OR Operator: This operator allows you to retrieve articles matching
the keyword a or the keyword b.\n It is important to note that this operator
has a higher precedence than the AND operator. For example the \n query: Apple
OR Microsoft will return all articles matching the keyword Apple as well as all
articles matching \n the keyword Microsoft\n- Logical NOT Operator: This operator
allows you to remove from the results the articles corresponding to the\n specified
keywords. To use it, you need to add NOT in front of each word or phrase surrounded
by quotes.\n For example the query: Apple NOT iPhone will return all articles
matching the keyword Apple but not the keyword\n iPhone"
kind: string
label: Airbyte Config Top Headlines Query
name: airbyte_config.top_headlines_query
- description: This parameter allows you to change the category for the request.
kind: options
label: Airbyte Config Top Headlines Topic
name: airbyte_config.top_headlines_topic
options:
- label: Breaking News
value: breaking-news
- label: World
value: world
- label: Nation
value: nation
- label: Business
value: business
- label: Technology
value: technology
- label: Entertainment
value: entertainment
- label: Sports
value: sports
- label: Science
value: science
- label: Health
value: health
- description: Airbyte image to run
kind: string
label: Airbyte Spec Image
name: airbyte_spec.image
value: airbyte/source-gnews
- description: Airbyte image tag
kind: string
label: Airbyte Spec Tag
name: airbyte_spec.tag
value: latest
- description: Docker mounts to make available to the Airbyte container. Expects a
list of maps containing source, target, and type as is documented in the docker
--mount documentation
kind: array
label: Docker Mounts
name: docker_mounts
- description: "'True' to enable schema flattening and automatically expand nested
properties."
kind: boolean
label: Flattening Enabled
name: flattening_enabled
- description: The max depth to flatten schemas.
kind: integer
label: Flattening Max Depth
name: flattening_max_depth
- description: User-defined config values to be used within map expressions.
kind: object
label: Stream Map Config
name: stream_map_config
- description: Config object for stream maps capability. For more information check
out [Stream Maps](https://sdk.meltano.com/en/latest/stream_maps.html).
kind: object
label: Stream Maps
name: stream_maps
settings_group_validation:
- - airbyte_config.api_key
- airbyte_config.query
- airbyte_spec
- airbyte_spec.image
settings_preamble: ''
usage: ''
variant: airbyte