NoRisk Insurance Form Automation

Playwright-based backend proxy for automating NoRisk international event insurance form submissions. This system acts as an intermediary between an Italian frontend and the Dutch NoRisk backend.

🎯 Purpose

Navigate NoRisk's multi-step insurance form via agent portal
Authenticate with NoRisk agent credentials
Extract CSRF tokens and maintain session state
Fill event, location, and coverage details
Submit proposals and extract quote codes
Receive PDFs via IMAP and forward to users via SMTP
Provide admin dashboard for quote management
Support headless and debug modes

🏗️ Architecture

Italian Frontend (IT) → Express API → Playwright Automation → NoRisk Agent Portal (NL)
                                     ↓
                               SQLite Database (quotes, sessions)
                                     ↓
                           IMAP (receive) / SMTP (send) Email
                                     ↓
                               Proposal HTML + PDF (returned)

📁 Project Structure

src/
├── index.js              # Main Express server entry point
├── config/
│   └── constants.js      # Configuration, selectors, environment variables
├── automation/
│   ├── scraper.js        # Main automation orchestration
│   └── formFiller.js     # Form filling utilities
├── utils/
│   ├── dataMapper.js     # Italian → Dutch data mapping & validation
│   ├── logger.js         # Winston logging configuration
│   ├── storage.js        # Quote persistence (SQLite)
│   ├── db.js             # Database initialization & queries
│   ├── emailSender.js    # SMTP email sending
│   └── emailReceiver.js  # IMAP email polling
└── admin/
    ├── middleware/
    │   └── auth.js       # Admin authentication middleware
    ├── routes/
    │   ├── login.js      # Admin login routes
    │   ├── dashboard.js  # Dashboard API routes
    │   └── users.js      # User management routes
    └── public/
        ├── index.html    # Admin dashboard UI
        └── admin.js      # Dashboard frontend JavaScript

📋 Prerequisites

Node.js v18 or higher
Windows/Linux/macOS
Internet connection
NoRisk agent account credentials
IMAP/SMTP credentials (for email features)

🚀 Installation

Install dependencies:

npm install

Install Playwright browsers:

npx playwright install chromium

Create environment file:

cp .env.example .env

Configure .env file:

# Server Configuration
NODE_ENV=development
PORT=3000
DOMAIN=http://localhost:3000

# NoRisk Agent Portal Authentication
NORISK_EMAIL=your_agent@example.com
NORISK_PASSWORD=your_password

# Target URLs
LOGIN_URL=https://verzekeren.norisk.eu/agents
FORM_URL=https://verzekeren.norisk.eu/en/agents/product/event-int
NORISK_TP_PARAM=30028

# Playwright Configuration
HEADLESS=false
TIMEOUT=30000
SLOW_MO=100
FIELD_DELAY=500

# Logging
LOG_LEVEL=debug

# Automation Mode
COMPLETED=false

# Email Reception (IMAP)
IMAP_HOST=imap.gmail.com
IMAP_PORT=993
IMAP_USER=your_email@example.com
IMAP_PASS=your_app_password
IMAP_TLS=true
IMAP_CHECK_INTERVAL=30000
IMAP_MAX_WAIT=300000

# Email Sending (SMTP)
SMTP_HOST=smtp.gmail.com
SMTP_PORT=587
SMTP_USER=your_email@example.com
SMTP_PASS=your_app_password
SMTP_FROM=noreply@example.com
SMTP_SECURE=false

# Storage
STORAGE_DIR=./storage
PDF_STORAGE_DIR=./storage/pdfs

# Admin Dashboard
ADMIN_ENABLED=true
ADMIN_USER=admin
ADMIN_PASSWORD_HASH=
ADMIN_SESSION_SECRET=change-this-to-a-random-secret

🧪 Testing

Manual Test Script

npm test

This runs the automation without starting the server. Great for debugging.

Full Server Test

Start the server:

npm start

Send a POST request:

curl -X POST http://localhost:3000/api/quote \
  -H "Content-Type: application/json" \
  -d '{
    "initials": "M",
    "lastName": "Rossi",
    "phone": "+39 06 1234567",
    "email": "mario.rossi@example.it",
    "role": "event_organiser",
    "eventName": "Festival Estivo Roma 2026",
    "eventType": "18",
    "startDate": "2026-06-15",
    "days": 3,
    "visitors": 500,
    "description": "Festival musicale all'aperto",
    "venueDescription": "Parco pubblico",
    "address": "Via dei Fori Imperiali",
    "houseNumber": "1",
    "zipcode": "00186",
    "city": "Roma",
    "country": "it",
    "environment": "outdoor",
    "coverages": {
      "liability": true,
      "accident": true
    }
  }'

📝 API Endpoints

`POST /api/quote`

Submits form data and returns proposal information.

Request Body:

{
  "initials": "M",
  "lastName": "Rossi",
  "phone": "+39 06 1234567",
  "email": "mario.rossi@example.it",
  "role": "event_organiser",
  "roleCompany": "",
  "roleVerification": "",
  "eventName": "Festival Estivo Roma 2026",
  "eventType": "18",
  "startDate": "2026-06-15",
  "days": 3,
  "visitors": 500,
  "description": "Festival musicale all'aperto",
  "venueDescription": "Parco pubblico",
  "address": "Via dei Fori Imperiali",
  "houseNumber": "1",
  "zipcode": "00186",
  "city": "Roma",
  "country": "it",
  "environment": "outdoor",
  "coverages": {
    "cancellation_costs": false,
    "cancellation_non_appearance": false,
    "cancellation_weather": false,
    "cancellation_income": false,
    "liability": true,
    "equipment": false,
    "money": false,
    "accident": true
  }
}

Response:

{
  "success": true,
  "quoteKey": "nr-12345678",
  "proposalUrl": "https://verzekeren.norisk.eu/en/agents/product/event-int/proposal?key=...",
  "pricing": {
    "sumExcl": "100.00",
    "policyCosts": "10.00",
    "insuranceTax": "11.00",
    "total": "121.00"
  },
  "status": "pending_email",
  "htmlContent": "<!DOCTYPE html>...",
  "pdfPath": "./storage/pdfs/quote-nr-12345678.pdf",
  "message": "Quote submitted. Waiting for PDF email...",
  "duration": "25340ms"
}

`POST /api/quote/send`

Sends the stored PDF quote to the user's email address.

Request Body:

{
  "quoteKey": "nr-12345678"
}

Response:

{
  "success": true,
  "message": "Preventivo inviato con successo via email",
  "sentTo": "mario.rossi@example.it",
  "duration": "1200ms"
}

`GET /api/quote/:quoteKey/status`

Checks the status of a quote.

Response:

{
  "success": true,
  "quoteKey": "nr-12345678",
  "status": "completed",
  "hasPdf": true,
  "createdAt": "2026-03-03T10:30:00.000Z",
  "updatedAt": "2026-03-03T10:35:00.000Z"
}

`GET /health`

Health check endpoint with environment details.

Admin Endpoints

When ADMIN_ENABLED=true:

GET /admin - Admin dashboard (requires login)
POST /admin/login - Admin authentication
POST /admin/logout - Admin logout
GET /admin/api/stats - Dashboard statistics
GET /admin/api/quotes - List all quotes

🐛 Debug Mode

To run with visible browser window:

# In .env file
HEADLESS=false
SLOW_MO=500
LOG_LEVEL=debug

This will:

Show the browser window in real-time
Slow down actions for observation
Output detailed logs to console
Take screenshots at each major step

🔍 Workflow

Session Initialization: Navigate to NoRisk agent login, authenticate
CSRF Token Extraction: Extract token from the form page
Step 1 - Personal Details: Fill contact and role information
Step 2 - Event Details: Fill event type, dates, visitors, description
Step 3 - Location: Fill venue and address information
Coverage Selection: Navigate to coverage page, toggle insurance modules
Proposal Page: Extract pricing information and quote code
Submission: If COMPLETED=true, submit proposal and wait for email
PDF Retrieval: Poll IMAP for NoRisk PDF email
Storage: Save quote to SQLite database

📊 Logging

Logs are written to:

Console: Colored, human-readable format
logs/automation.log: All log levels
logs/errors.log: Error-level only

Log levels: error, warn, info, debug

🖼️ Screenshots

Automatic screenshots are taken at:

Initial page load
After form filling
Coverages page
After coverage selection
Proposal page
Error states

Screenshots saved to: screenshots/

💾 Storage

Quotes and their metadata are stored in SQLite:

Database: database/quotes.db
PDFs: storage/pdfs/
Sessions: database/sessions.db

⚠️ Important Notes

Country Code Handling

The backend expects country codes with a trailing space (e.g., "it ", "nl "), except for "us" and "gb". The dataMapper.js handles this automatically.

Event Type IDs

Event types must match the IDs expected by NoRisk. See the form page source or browser network tab for valid values.

Role Types

event_organiser - Default, no additional fields required
intermediary - Requires roleCompany and roleVerification
proxy - Requires roleCompany and roleVerification

COMPLETED Mode

COMPLETED=false: Stops after extracting quote code (manual review)
COMPLETED=true: Submits proposal and waits for PDF email

Admin Password Hash

Generate a bcrypt hash for the admin password:

node -e "console.log(require('bcrypt').hashSync('yourpassword', 10))"

🔧 Troubleshooting

"Element not found" errors

Set HEADLESS=false to see what's happening
Check screenshots in screenshots/ folder
Verify selectors in src/config/constants.js

"Navigation timeout" errors

Increase TIMEOUT in .env
Check internet connection
Verify NoRisk site is accessible

CSRF token errors

Check logs for token extraction step
Verify form URL is correct
Ensure no CAPTCHA is blocking access

Email not received

Verify IMAP credentials
Check IMAP_CHECK_INTERVAL and IMAP_MAX_WAIT
Ensure NoRisk email is not in spam folder

📄 License

MIT

👤 Author

Your Name / Organization

Name		Name	Last commit message	Last commit date
Latest commit History 158 Commits
database		database
docs		docs
norisk-wordpress		norisk-wordpress
scripts		scripts
src		src
.env.example		.env.example
.gitignore		.gitignore
Dockerfile		Dockerfile
README.md		README.md
deploy-to-vps.sh		deploy-to-vps.sh
package.json		package.json

Folders and files

Latest commit

History

Repository files navigation

NoRisk Insurance Form Automation

🎯 Purpose

🏗️ Architecture

📁 Project Structure

📋 Prerequisites

🚀 Installation

🧪 Testing

Manual Test Script

Full Server Test

📝 API Endpoints

POST /api/quote

POST /api/quote/send

GET /api/quote/:quoteKey/status

GET /health

Admin Endpoints

🐛 Debug Mode

🔍 Workflow

📊 Logging

🖼️ Screenshots

💾 Storage

⚠️ Important Notes

Country Code Handling

Event Type IDs

Role Types

COMPLETED Mode

Admin Password Hash

🔧 Troubleshooting

"Element not found" errors

"Navigation timeout" errors

CSRF token errors

Email not received

📄 License

👤 Author

About

Resources

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Contributors

Uh oh!

Languages

`POST /api/quote`

`POST /api/quote/send`

`GET /api/quote/:quoteKey/status`

`GET /health`

Packages