/
infrastructure.txt
273 lines (202 loc) · 9.85 KB
/
infrastructure.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
How the GRASS Webserver and related infrastructure works
written by M. Neteler
Last changed: $Date$
Related Wiki documents:
* http://grass.osgeo.org/wiki/GRASS_Migration_to_OSGeo (historical document)
== GRASS Web server ==
Maintainer: M. Neteler
* http://grass.osgeo.org
** Shared virtual OSGeo machine (osgeo6) hosted at Oregon State University Open Source Lab
(server: osgeo6.osgeo.osuosl.org)
** OSGeo SAC page: http://wiki.osgeo.org/wiki/SAC_Service_Status
http://wiki.osgeo.org/index.php/SAC
** Login: via OSGeo LDAP, there is a "grass" LDAP group
** Software:
*** OS: Debian Wheezy
*** Apache Server with PHP
** Further addresses: http://www.grass-gis.org
*** points through Apache rewrite engine to http://grass.osgeo.org
* Backup:
** VERIFY 2010: grass.osgeo.org is backup'ed via rsync to XXXX: http://wiki.osgeo.org/wiki/SAC:Backups#download.osgeo.org
** Wiki backup, via rsync to http://josef.fsv.cvut.cz/WIKI/grass-osgeo/index.php/Main_Page
* Web pages:
** CMSMS: http://grass.osgeo.org/home/imprint/
** mirrored from Wroclav university via httrack (tier-1),
then offered as rsync mirror (tier-2) to other mirror sites
** RSS feed: offered by CMSMS
* Weekly snapshots (generated Saturday morning California time):
** Source code tarball of SVN HEAD
** Linux binary snapshot is compiled
*** GRASS is compiled with GDAL, PROJ, SQLite, MySQL, PostgreSQL, FFTW, C++ support
*** binary tar.gz and manuals are moved into Web space
* GRASS user manual HTML:
** generated during compilation of weekly Linux binary snapshot
* GRASS programmer's manual (http://grass.osgeo.org/programming7/)
** HTML: cronjob run Wednesday morning California time
** HTML: cronjob run Saturday morning California time
** disabled: PDF: cronjob run Saturday morning California time
* i18N translation statistics (http://grass.osgeo.org/development/translations/#statistics)
** generated during compilation of Linux binary snapshot, stats of
(cd locale; make) are extracted into text file
** text file parsed by PHP page and shown as table
** GRASS version is coded in devel/i18n_stats.inc
* Mailman mailing lists + greylisting (at lists.osgeo.org since 11/2007)
** Mailman is doing the job, only registered users can post
** messages from unsubscribed people is auto-discarded without notification
** the open "weblist" operates instead like this:
User -> grass-web at lists osgeo.org -> greylisting -> Mailman
* Backup of mailing lists (mbox files)
** manually done by MN
** nightly backup at OSGeo.org, bacula
** TODO: Establish solution via local cp on lists.osgeo.org (SAC ticket todo)
* Web statistics
** See URL at http://wiki.osgeo.org/wiki/Project_Stats
** OSGeo: awstats (http://grass.osgeo.org/stats/awstats.pl)
*** configuration at: /etc/awstats/awstats.grass.osgeo.org.conf
*** /etc/httpd/conf.d/sites/grass.osgeo.org.conf
*** /etc/apache2/includes/grass.osgeo.org.inc
*** httpd logs: /var/log/httpd/grass_*
*** awstats processed log files: /osgeo/download/logs - https://grass.osgeo.org/stats/
*** cronjob script: /osgeo/scripts/update_logs.sh
** OLD FBK Mirror: Webalizer (http://grass.fbk.eu/webalizer/) runs daily as cronjob
** OLD: Sitemeter: http://www.sitemeter.com/?a=stats&s=s24grassgis
Summary: The system should run almost autonomously.
== GRASS Mailing lists ==
Maintainer: Markus Neteler
Available lists:
* at OSGeo.org (http://lists.osgeo.org/mailman/listinfo):
grass-abm Integration of GRASS with JAVA based agent based modeling (ABM)
grass-announce GRASS announcements
grass-commit Mailing list to distribute GRASS-CVS commits
grass-dev GRASS GIS Development mailing list
grass-es La lista de correo de GRASS GIS en español
grass-psc GRASS-PSC: GRASS Project Steering Committee
grass-stats GRASS and statistical software
grass-translations Translation of GRASS (i18N)
grass-user GRASS user list
grass-web GRASS website mailing list
* OLD, UNUSED: at FBK-irst (http://grass.fbk.eu/mailman/admin/):
grass-commit-addons Mailing list to distribute GRASS Addons-SVN commits
grass-gui GRASSGUI mailing list
grass-qa GRASS Quality Assessment and monitoring list
grass-windows winGRASS - Using GRASS on MS-Windows systems mailing list
Notes:
* grass-announce:
* moderated by M. Neteler
* has monthly password reminder disabled to avoid leakage into publicly archived lists
* grass-commit is receiving posts from the GRASS SVN at osgeo.org.
Not open for other postings, they will be trashed automatically
* grass-web is an open list (posting without subscription possible) with (Google) spam filter
* OLD, UNUSED: grass-qa is receiving posts from the GRASS Quality Control System at
Ecole Polytechnique de Montreal, Canada. Not open for other postings.
== GRASS Wiki ==
Maintainer: Martin Landa, Markus Neteler
* http://grasswiki.osgeo.org
* Mediawiki
* mirrored at CZ Tech University
* requires registration to keep spammers out
Summary: The system should run almost autonomous. An eye must be
be kept on people trying to spam the site
Macro for manual pages: https://grasswiki.osgeo.org/wiki/Template:Cmd
== GRASS IRC ==
Channel: irc://irc.freenode.net/grass
Web based client: See http://grasswiki.osgeo.org/wiki/IRC
* channel owner: Alessandro Frigeri <afrigeri unipg.it> ("geoalf")
* quasi guru: Markus Neteler ("markusN")
* further operators:
- Jachym ("jachym")
- Luca ("doktoreas")
- Soeren ("huhabla")
- Brad ("bdouglas")
== GRASS Source code repository ==
Maintainer: Markus Neteler, Martin Landa, OSGeo-SAC, http://wiki.osgeo.org/wiki/SAC
* https://trac.osgeo.org/grass/browser
* SVN: https://trac.osgeo.org/grass/wiki/HowToSVN
Trac Wiki Macro definitions for manual pages G7:modulename
* https://trac.osgeo.org/grass/wiki/InterMapTxt
ZIP file download support in trac (needed for g.extension) - on trac.osgeo.org:
/var/www/trac/grass/conf/trac.ini
[browser]
downloadable_paths = /grass-addons/grass7/*/*,/sandbox/*/*
Statistics:
https://trac.osgeo.org/grass/stats/code
== GRASS Bugtracker ==
Current bugtracker (Jan 2008 - today):
* https://trac.osgeo.org/grass/report
* Trac
* posts new bugs and comments to grass-dev list
* Settings:
tracsvn (OSGeo server)
/var/www/trac/env/grass/conf/trac.ini
downloadable_paths = /grass-addons/grass7/*/*,/sandbox/*/*
path = /var/www/grass/htdocs
link = https://grass.osgeo.org/
src = site/grasslogo_vector_small.png
smtp_always_cc = grass-dev@lists.osgeo.org
smtp_replyto = grass-dev@lists.osgeo.org
url = https://grass.osgeo.org
.dir = /var/www/svn/repos/grass
base_url = https://trac.osgeo.org/grass/
database = postgres://postgres@/trac_grass
Old bugtracker (Jan 2007 - Dec 2008):
* http://wald.intevation.org/tracker/?group_id=21
* gforce, sponsored by Intevation GmbH, Germany
* spamassasin spamfilter locally, bogofilter at grass-dev list
* needs 'noreply*wald.intevation.org' to be enabled as alias in Mailman
Very old bugtracker (Dec 2000 - Dec 2006):
* https://intevation.de/rt/webrt?q_queue=grass
* webRT, sponsored by Intevation GmbH, Germany
* spamassasin spamfilter locally, bogofilter at grass-dev list
* reports are directly sent to GRASS Developers mailing list for notification
* TODO: migrate to trac
== GRASS Addons ==
Maintainer: Martin Landa
Details:
grass-addons/tools/addons/README.txt
Installed with g.extension
Manuals: https://grass.osgeo.org/grass7/manuals/addons/
The redirect to the latest directory is defined on grass.osgeo.org:
/etc/apache2/includes/grass.osgeo.org.inc
Procedure building of binaries (Windows):
Addons module are compiled on build server, currently at the CTU in Prague)
and publishing their manual pages on publishing server, i.e. grass.osgeo.org.
A new compilation is triggered everytime when a commit is done in the Addons-SVN.
Procedure of granting write access to Addons DVN repo:
* Request procedure: https://trac.osgeo.org/grass/wiki/HowToContribute#WriteaccesstotheGRASS-Addons-SVNrepository
* Adding OSGeo-ID: https://www.osgeo.org/cgi-bin/auth/ldap_group.py?group=grass_addons
* Adding contributor: https://trac.osgeo.org/grass/browser/grass-addons/contributors.csv (via SVN commit)
* Confirm request in grass-psc and give instructions concerning code style etc (see archive for examples)
XML file for g.extension: http://grass.osgeo.org/addons/grass7/modules.xml
- generated in grass-addons/tools/addons/grass-addons-publish.sh
== GRASS Travis CI ==
Maintainer: Martin Landa
* https://travis-ci.org/GRASS-GIS
* https://github.com/GRASS-GIS/grass-ci
* https://svn.osgeo.org/grass/grass-addons/tools/grass-ci/
Travis CI control files:
trunk/.travis/
linux.before_install.sh
linux.install.sh
linux.script.sh
Maintenance script:
* https://svn.osgeo.org/grass/grass-addons/tools/grass-ci/grass-ci.sh
The github update is run as a cronjob on server "geo102" (CTU, CZ).
== GRASS Coverity Scan ==
Maintainer: Markus Neteler
* https://scan.coverity.com/projects/grass?tab=overview
== OLD: GRASS Quality Control ==
Maintainer: Prof. Giulio Antoniol
- offline -
* http://web.soccerlab.polymtl.ca/grass-evolution/grass-browsers/grass-index-en.html
implemented and sponsored by Ecole Polytechnique de Montreal, Canada
* Realtime analysis is sent to: http://lists.osgeo.org/mailman/listinfo/grass-qa
Further notification/functionality test systems:
** posts into #grass IRC channel
** posts into #osgeo-commits IRC channel
== Previous hosting sponsors ==
Since 2010 the GRASS GIS project is hosted at the Oregon State University Open Source Lab (OSUOSL), Oregon, USA
Numerous institutions have sponsored the GRASS Project with Hardware/Bandwidth (list of master site hosting):
* 1997-1999: Institut fuer Landschaftspflege und Naturschutz (ILN), Universitaet Hannover, Germany
* 1999-2001: Institut fuer Physische Geographie und Landschaftsoekologie, Universitaet Hannover, Germany
* 2001-2008: ITC-irst, Trento, Italy
* 2009-2010: Telascience.org at San Diego Supercomputer Center, California, USA