Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug] HTTP Error 403: rate limit exceeded when compiling 8.0.0 #2188

Closed
okanisis opened this issue Feb 11, 2022 · 4 comments
Closed

[Bug] HTTP Error 403: rate limit exceeded when compiling 8.0.0 #2188

okanisis opened this issue Feb 11, 2022 · 4 comments
Labels
bug Something isn't working duplicate This issue or pull request already exists
Milestone
8.0.1

Comments

@okanisis
Copy link

Describe the bug
Lots of errors in module output and fails to compile GRASS 8.0.0. RC1 and RC2 compiled fine previously.

GRASS GIS 8.0.0 exported compilation log
--------------------------------------------------
Started compilation: Thu 10 Feb 2022 07:19:33 PM MST
--
Errors in:
/tmp/makepkg/grass/src/grass-8.0.0/lib/vector
/tmp/makepkg/grass/src/grass-8.0.0/lib/imagery
/tmp/makepkg/grass/src/grass-8.0.0/lib/cluster
/tmp/makepkg/grass/src/grass-8.0.0/lib/rst/interp_float
/tmp/makepkg/grass/src/grass-8.0.0/lib/lidar
/tmp/makepkg/grass/src/grass-8.0.0/lib/raster3d/test
/tmp/makepkg/grass/src/grass-8.0.0/lib/ogsf
/tmp/makepkg/grass/src/grass-8.0.0/lib/nviz
/tmp/makepkg/grass/src/grass-8.0.0/lib/manage
/tmp/makepkg/grass/src/grass-8.0.0/python/libgrass_interface_generator
/tmp/makepkg/grass/src/grass-8.0.0/db
/tmp/makepkg/grass/src/grass-8.0.0/display
/tmp/makepkg/grass/src/grass-8.0.0/general/g.access
/tmp/makepkg/grass/src/grass-8.0.0/general/g.cairocomp
/tmp/makepkg/grass/src/grass-8.0.0/general/g.copy
/tmp/makepkg/grass/src/grass-8.0.0/general/g.dirseps
/tmp/makepkg/grass/src/grass-8.0.0/general/g.filename
/tmp/makepkg/grass/src/grass-8.0.0/general/g.findetc
/tmp/makepkg/grass/src/grass-8.0.0/general/g.findfile
/tmp/makepkg/grass/src/grass-8.0.0/general/g.gisenv
/tmp/makepkg/grass/src/grass-8.0.0/general/g.gui
/tmp/makepkg/grass/src/grass-8.0.0/general/g.list
/tmp/makepkg/grass/src/grass-8.0.0/general/g.mapset
/tmp/makepkg/grass/src/grass-8.0.0/general/g.mapsets
/tmp/makepkg/grass/src/grass-8.0.0/general/g.message
/tmp/makepkg/grass/src/grass-8.0.0/general/g.mkfontcap
/tmp/makepkg/grass/src/grass-8.0.0/general/g.parser
/tmp/makepkg/grass/src/grass-8.0.0/general/g.pnmcomp
/tmp/makepkg/grass/src/grass-8.0.0/general/g.ppmtopng
/tmp/makepkg/grass/src/grass-8.0.0/general/g.proj
/tmp/makepkg/grass/src/grass-8.0.0/general/g.region
/tmp/makepkg/grass/src/grass-8.0.0/general/g.remove
/tmp/makepkg/grass/src/grass-8.0.0/general/g.rename
/tmp/makepkg/grass/src/grass-8.0.0/general/g.tempfile
/tmp/makepkg/grass/src/grass-8.0.0/general/g.version
/tmp/makepkg/grass/src/grass-8.0.0/general/manage/lister
/tmp/makepkg/grass/src/grass-8.0.0/raster
/tmp/makepkg/grass/src/grass-8.0.0/raster3d
/tmp/makepkg/grass/src/grass-8.0.0/vector
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.cogo
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.measure
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.nviz.image
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.nviz.script
/tmp/makepkg/grass/src/grass-8.0.0/misc/m.transform
/tmp/makepkg/grass/src/grass-8.0.0/imagery
/tmp/makepkg/grass/src/grass-8.0.0/ps/ps.map
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.correlate
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.frame
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.out.file
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.to.rast
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.polar
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.rast.edit
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.rast.leg
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.redraw
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.shade
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.what.rast
/tmp/makepkg/grass/src/grass-8.0.0/scripts/d.what.vect
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.dropcolumn
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.droptable
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.in.ogr
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.out.ogr
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.test
/tmp/makepkg/grass/src/grass-8.0.0/scripts/db.univar
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.download.location
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.extension
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.extension.all
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.manual
/tmp/makepkg/grass/src/grass-8.0.0/scripts/g.search.modules
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.band.library
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.colors.enhance
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.image.mosaic
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.in.spotvgt
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.oif
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.pansharpen
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.spectral
/tmp/makepkg/grass/src/grass-8.0.0/scripts/i.tasscap
/tmp/makepkg/grass/src/grass-8.0.0/scripts/m.proj
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.blend
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.buffer.lowmem
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.colors.stddev
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.drain
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.fillnulls
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.grow
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.import
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.in.aster
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.in.srtm
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.in.wms
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.mapcalc.simple
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.mask
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.out.xyz
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.pack
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.plane
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.reclass.area
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.rgb
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.semantic.label
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.shade
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.tileset
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r.unpack
/tmp/makepkg/grass/src/grass-8.0.0/scripts/r3.in.xyz
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.build.all
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.centroids
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.clip
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.addcolumn
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.addtable
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.join
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.dropcolumn
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.droprow
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.droptable
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.renamecolumn
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.reconnect.all
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.univar
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.db.update
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.dissolve
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.import
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.e00
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.geonames
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.mapgen
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.wfs
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.rast.stats
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.report
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.pack
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.to.lines
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.unpack
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.what.strds
/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.what.vect
/tmp/makepkg/grass/src/grass-8.0.0/temporal
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/docs
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/animation
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/datacatalog
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/mapswipe
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/gmodeler
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/rlisetup
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/psmap
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/dbmgr
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/vdigit
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/rdigit
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/iclass
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/gcp
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/timeline
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/tplot
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/photo2image
/tmp/makepkg/grass/src/grass-8.0.0/gui/wxpython/image2target

and further up it has a lot of:

r.in.gdal: Unable to fetch interface description for command '<r.in.gdal>'.

Details: <[Errno 2] No such file or directory: 'r.in.gdal'>
r.in.xyz: Unable to fetch interface description for command '<r.in.xyz>'.

Details: <[Errno 2] No such file or directory: 'r.in.xyz'>
r.in.ascii: Unable to fetch interface description for command '<r.in.ascii>'.

Details: <[Errno 2] No such file or directory: 'r.in.ascii'>
...

and also contains a lot of:

make -C v.in.lines || echo /tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines >> /tmp/makepkg/grass/src/grass-8.0.0/error.log
make[3]: Entering directory '/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines'
/usr/bin/install -c  v.in.lines.py /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts/v.in.lines
if [ "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts/v.in.lines" != "" ] ; then GISRC=/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/demolocation/.grassrc80 GISBASE=/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu PATH="/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/bin:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/bin:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts:$PATH" PYTHONPATH="/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/etc/python:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/gui/wxpython:$PYTHONPATH" LD_LIBRARY_PATH="/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/bin:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/bin:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/lib:/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/lib:.::/jre/lib" LC_ALL=C LANG=C LANGUAGE=C /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/scripts/v.in.lines --html-description < /dev/null | grep -v '</body>\|</html>' > v.in.lines.tmp.html ; fi
VERSION_NUMBER=8.0.0 VERSION_DATE=2022 MODULE_TOPDIR=../.. \
        python3 /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py v.in.lines > /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/docs/html/v.in.lines.html
Traceback (most recent call last):
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 141, in download_git_commit
    response = urlopen(url, *args, **kwargs)
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 113, in urlopen
    return urlrequest.urlopen(request, *args, **kwargs)
  File "/usr/lib/python3.10/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python3.10/urllib/request.py", line 525, in open
    response = meth(req, response)
  File "/usr/lib/python3.10/urllib/request.py", line 634, in http_response
    response = self.parent.error(
  File "/usr/lib/python3.10/urllib/request.py", line 563, in error
    return self._call_chain(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 496, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.10/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 403: rate limit exceeded

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 658, in <module>
    git_commit = get_last_git_commit(
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 232, in get_last_git_commit
    response = download_git_commit(
  File "/tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/utils/mkhtml.py", line 168, in download_git_commit
    gs.warning(
AttributeError: 'NoneType' object has no attribute 'warning'
make[3]: *** [../../include/Make/Html.make:7: /tmp/makepkg/grass/src/grass-8.0.0/dist.x86_64-pc-linux-gnu/docs/html/v.in.lines.html] Error 1
rm v.in.lines.tmp.html
make[3]: Leaving directory '/tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines'

To Reproduce
Steps to reproduce the behavior:

Compile from PKGBUILD using makepkg:

# Maintainer: saultdon <sault.don at gmail>
# Contributor: Sylvain POULAIN <sylvain dot poulain at giscan dot com>
# Contributor: Doug Newgard <scimmia at archlinux dot org>
# Contributor: Maciej Sieczka <msieczka at sieczka dot org>

pkgname=grass
pkgver=8.0.0
pkgrel=1
#_shortver=${pkgver%.*}; _shortver=${_shortver/./}
pkgdesc='Geospatial data management and analysis, image processing, graphics/maps production, spatial modeling and visualization'
arch=('i686' 'x86_64')
url='http://grass.osgeo.org/'
license=('GPL')
depends=('bzip2' 'cairo' 'fftw' 'fontconfig' 'freetype2' 'gcc-libs' 'gdal' 'geos' 'glibc' 'glu'
         'libpng' 'libtiff' 'libx11' 'libgl' 'netcdf' 'proj' 'python-gdal' 'python-numpy'
         'python-pillow' 'python-wxpython' 'readline' 'zlib' 'zstd')
makedepends=('libxt' 'opencl-headers')
optdepends=('postgresql: PostgreSQL database interface'
            'sqlite: SQLite database interface'
            'openmpi: openmp support')
source=("https://github.com/OSGeo/${pkgname}/archive/refs/tags/${pkgver}.tar.gz")
md5sums=('cb79d510eddbf93719f78b1e7202e1c1')
options=('!makeflags')

build() {
  cd $pkgname-$pkgver

  # Ancient autoconf used upstream can't handle CPPFLAGS correctly, so set CPP to ignore warnings
  CPP="gcc -E -w" \
  ./configure \
    --prefix=/opt/$pkgname \
    --with-freetype-includes=/usr/include/freetype2 \
    --with-wxwidgets \
    --with-readline \
    --with-pthread \
    --with-netcdf \
    --with-nls \
    --with-geos \
    --with-postgres \
    --with-bzlib \
    --with-zstd \
    --with-opencl \
    --with-openmp

  make
}

package() {
  cd $pkgname-$pkgver

  make exec_prefix="$pkgdir/usr" INST_DIR="$pkgdir/opt/$pkgname" install

  # Install linker config file, needed for qgis to find grass
  install -d "$pkgdir/etc/ld.so.conf.d/"
  echo "/opt/$pkgname/lib" > "$pkgdir/etc/ld.so.conf.d/$pkgname.conf"

  cd "$pkgdir/opt/$pkgname"

  # Put freedesktop.org files in correct location
  mv share "$pkgdir/usr"

  # Fix some paths that get hard coded by make install
  sed -i "s|$pkgdir||g" demolocation/.grassrc$_shortver \
                        include/Make/{Platform,Grass}.make \
                        etc/fontcap \
                        "$pkgdir/usr/bin/grass"
}

Expected behavior
Successfully compile like RC1 and RC2 and spit out those binaries, libs and scripts =)

System description (please complete the following information):

  • Operating System: Arch Linux

  • uname -a Linux archasus 5.16.8-arch1-1 #1 SMP PREEMPT Tue, 08 Feb 2022 21:21:08 +0000 x86_64 GNU/Linux

  • GRASS GIS version 8.0.0

  • details about further software components

python3 -c "import sys, wx; print(sys.version); print(wx.version())"
3.10.2 (main, Jan 15 2022, 19:56:27) [GCC 11.1.0]
4.1.1 gtk3 (phoenix) wxWidgets 3.1.5

Additional context
If I cd into /tmp/makepkg/grass/src/grass-8.0.0/lib/vector or /tmp/makepkg/grass/src/grass-8.0.0/scripts/v.in.lines and use make it works without error.
@okanisis okanisis added the bug Something isn't working label Feb 11, 2022
@nilason
Copy link
Contributor

nilason commented Feb 11, 2022

This is a very unfortunate bug, already reported in #2137 and addressed for 8.0.1.

@nilason nilason added the duplicate This issue or pull request already exists label Feb 11, 2022
@tmszi
Copy link
Member

tmszi commented Feb 11, 2022

Could @okanisis apply this patch.zip to source code in your PKGBUILD, please?

Test:

patch -p1 --dry-run < /your_patches_dir/grass-8.0.0-mkhtml.patch

Apply:

patch -p1 < /your_patches_dir/grass-8.0.0-mkhtml.patch

@okanisis
Copy link
Author

patch -p1 < /your_patches_dir/grass-8.0.0-mkhtml.patch

thank you. compiled successfully =)

@okanisis
Copy link
Author

the updated prepare() function in the PKGBUILD

prepare() {
   cd "${srcdir}"/$pkgbase-$pkgver
   patch -Np1 -i "${srcdir}"/grass-8.0.0-mkhtml.patch
}

@neteler neteler added this to the 8.0.1 milestone Feb 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working duplicate This issue or pull request already exists
Projects
None yet
Milestone
8.0.1
Development

No branches or pull requests
4 participants
@neteler @okanisis @nilason @tmszi