Skip to content

v3.2.7 - Zero Rate Limits via Static Endpoint

Choose a tag to compare

View all tags
@SpatialCollectiveLtd SpatialCollectiveLtd released this 06 Jan 14:01
· 2 commits to main since this release
v3.2.7
622bb61

DPW Validation Tool v3.2.7 - Zero Rate Limits Solution

Release Date: January 6, 2026

🎯 Major Improvement: ZERO Rate Limits

Problem Solved

Even after fixing the URL construction bug in v3.2.6, Vercel's DDoS protection was still causing intermittent HTTP 429 errors. The backend team created a static JSON file that completely bypasses all rate limiting.

Solution: Static Endpoint on GitHub Pages

The plugin now uses a static JSON file hosted on GitHub Pages:

  • ✅ Zero rate limits - GitHub Pages has no API throttling
  • ✅ Global CDN - Fast access worldwide (10-50ms response times)
  • ✅ Independent of Vercel - Not affected by Vercel DDoS protection
  • ✅ Auto-updated - Regenerates every 15 minutes via GitHub Actions
  • ✅ Same data format - No breaking changes to response structure

🔧 Technical Changes

New Endpoint (GitHub Pages)

Before (v3.2.6):

GET https://app.spatialcollective.com/api/users?exclude_managers=true&status=Active

Subject to Vercel rate limiting ❌

After (v3.2.7):

GET https://spatialcollectiveltd.github.io/api/users.json

Hosted on GitHub Pages CDN - NO rate limits ✅

Response Format

Same JSON structure as before:

{
  "success": true,
  "data": [
    {
      "user_id": 342,
      "osm_username": "FTM_SC",
      "settlement": "Kariobangi",
      "role": "Validator",
      "status": "Active",
      ...
    }
  ],
  "count": 306,
  "generated_at": "2026-01-06T13:51:25.381Z",
  "cache_info": "Static file - zero rate limits, updated every 15 minutes"
}

Client-Side Filtering

Since the static endpoint returns ALL users (not just Active ones), the plugin now implements client-side filtering to:

  • ✅ Only include users with "status": "Active"
  • ✅ Exclude users with "role": "Manager" (security requirement)

📋 What Changed

Files Modified:

  1. DPWAPIClient.java

    • Updated endpoint from /users?exclude_managers=true&status=Active to /users.json
    • Added client-side filtering for Active status and Manager role
    • Added comments explaining zero rate limit benefit

  2. ValidationToolPanel.java

    • Updated endpoint to /users.json
    • Added client-side filtering logic
    • Maintains backward compatibility

  3. Version Updates

    • UpdateChecker.java: 3.2.6 → 3.2.7
    • build.xml: 3.2.6 → 3.2.7

✅ Benefits

Feature Old Endpoint New Static Endpoint
Rate Limits ⚠️ Vercel DDoS protection ✅ None
Response Time 200-500ms 10-50ms (CDN)
Availability 99.9% 99.99% (static)
Freshness Real-time Max 15min delay
Error Rate Occasional 429s Near zero

🔄 Data Freshness

  • Auto-Update: Every 15 minutes via Vercel cron
  • Manual Trigger: Backend team can force-update anytime
  • Build-Time: Regenerates on every deployment
  • Max Delay: 15 minutes from database changes

For validation workflows, a 15-minute delay is acceptable since mapper lists don't change frequently.

🛡️ Security

Same security measures as before:

  • ✅ Managers excluded via client-side filtering
  • ✅ Sensitive fields removed (password, phone, email, etc.)
  • ✅ Only Active users shown to validators
  • ✅ Public endpoint (no authentication required)

🔄 Upgrade Instructions

  1. Download DPWValidationTool.jar from this release
  2. Replace in JOSM plugins directory: ~/.josm/plugins/DPWValidationTool.jar
  3. Restart JOSM completely
  4. Test mapper list refresh - should work instantly with no errors

📊 Expected Behavior

After upgrade:

  • ✅ Mapper list loads in <100ms (was 200-500ms)
  • ✅ No more HTTP 429 errors
  • ✅ No rate limit warnings in logs
  • ✅ Refresh button works unlimited times
  • ✅ Same user data as before

🐛 Troubleshooting

If mapper list is empty or stale:

  1. Check backend: https://app.spatialcollective.com/api/users.json
  2. Verify generated_at timestamp is recent (within 15 minutes)
  3. If older than 30 minutes, contact backend team
  4. Temporary workaround: Use old endpoint if needed

🙏 Acknowledgments

Special thanks to the DPW backend team for implementing the static JSON file solution, which permanently eliminates all rate limiting issues while maintaining security and data freshness.

Version: 3.2.7
Build Date: January 6, 2026
Compatibility: JOSM 18823+
Status: Production Ready - Zero Rate Limits ✅

Assets 3
Loading