250810

fixed the image scraping method

Smarter Scraping, Easier Imports

📌 Plugin Name
AJDWP Auto Product Maker

📦 Version
250702

🧑‍💻 Author
Arash Javadi

📝 Description
AJDWP Auto Product Maker is a powerful WordPress plugin designed for WooCommerce store owners to automate the creation of product listings by scraping product data from external sources. It supports both bulk and single product imports using custom templates with CSS selectors. The plugin integrates with dynamic scraping tools (e.g., Playwright/Node.js) and includes a visual admin UI for mapping selectors and managing imports with ease.

🚀 Features
🔍 1. Smart Product Scraping
Scrapes product data (title, description, images, price, etc.) from any URL using user-defined selectors.

Supports dynamic JavaScript-rendered content using Node.js + Playwright backend.

Multiple scraping methods supported (e.g., auto, dom, or custom).

🧩 2. Template-Based Selector System
Admins can create and manage reusable scraping templates.

Each template stores CSS selectors and configurations for:

Title

Short Description

Long Description

Main Image

Gallery Images

Price and price multiplier

Scraping method (auto/manual)

🛠️ 3. Product Creation & Update
Automatically creates WooCommerce products from scraped data.

If the product already exists (based on URL), it updates the product instead of duplicating.

Stores product URL metadata in a custom database table (ajdwp_template_urls).

🖼️ 4. Preview Before Import
Visual preview of scraped data before creating the product.

Confirms formatting and accuracy before insertion.

🧵 5. Bulk URL Import
Admin UI to paste multiple product URLs.

Sequentially scrapes and creates or updates each product.

Displays live status messages for each row.

🧪 6. AJAX-Driven Admin UI
Full support for AJAX interactions (no page reloads).

Sections include:

Scrape Preview

Confirm & Add

Bulk Add URLs

Template management

🧾 7. Secure & Optimized
Uses nonces for all AJAX endpoints.

Escapes, sanitizes, and validates all user input.

Performance-optimized using batch operations and selective updates.

ajdwp-auto-product-maker/
├── admin/
│ ├── settings-page.php
│ ├── tab1-product-scrape-form-ajax.php
│ ├── tab2-product-manager-ajax.php
│ └── tab3-add-edit-template-ajax.php
├── assets/
│ ├── css/style.css
│ └── js/
│ ├── admin.js
│ ├── tab1-product-scrape-form.js
│ ├── tab2-product-manager.js
│ └── tab3-add-edit-template.js
├── includes/
│ ├── helpers.php
│ ├── product-creator.php
│ ├── scraper.php
│ └── simple_html_dom.php
├── templates/
│ ├── create-db-on-activation.php
│ ├── tab1-product-scrape-form.php
│ ├── tab2-product-manager.php
│ └── tab3-add-edit-template.php
├── ajdwp-auto-product-maker.php
├── uninstall.php
├── package.json
├── composer.json
└── readme.txt

🔐 Security
✅ Nonces and capability checks on all AJAX endpoints.

✅ Strict input sanitation using sanitize_text_field, esc_url_raw, intval, etc.

✅ Database operations using $wpdb->prepare() to prevent SQL injection.

💡 Roadmap (Next Release Ideas)
🔁 Scheduled scraping (CRON-based re-scrape)

🧠 AI-based auto-selector detection (auto-suggest title, price, etc.)

🌐 eBay/Amazon/Facebook Marketplace direct scraping integration

📸 Auto-upload of images to Media Library or external CDNs

📦 WooCommerce category/tags mapping per template

Added static and Dynamic Scrape modes

250624

deleted

Dynamic Scraping with Playwright Integration

This release introduces major improvements to the scraping engine of AJDWP Auto Product Maker, enabling accurate product data extraction from a wide range of modern, JavaScript-rendered websites such as Eneba and WooCommerce-based stores.

🧠 Key Features:
✅ Playwright Integration (Local Runtime):
Added Node.js + Playwright support to scrape rendered HTML reliably from dynamic pages.

🔍 Custom & Default Selectors:
Supports both user-defined and intelligent fallback selectors for:

Product Title

Price (including original and discounted values)

Short Description

Long Description

Featured Image

Image Gallery

💸 Dual Price Handling:
Automatically scrapes both the regular and discounted prices, allowing you to choose which one to insert into WooCommerce (default: discounted).

🖼️ High-Resolution Gallery Images:
Automatically selects the best quality image available (data-large_image, data-src, src).

🛡️ Enhanced Validation & Feedback:
Improved backend logging and user messages for missing selectors or scraping errors.

🔄 Preview Before Insertion:
Secure preview stage lets you confirm all scraped content before saving as a WooCommerce product.

⚙️ Setup Requirements:
Node.js and Playwright must be installed locally.

Run npx playwright install after installing the plugin to fetch necessary browser binaries.

Ensure your scraper path and Node binary path are correctly set in scraper.php.

This update ensures broader compatibility, better accuracy, and more control when creating products from external sources. Perfect for affiliate marketers, resellers, and WooCommerce store managers.

Html & PHP wb scraper engines

Current Status and Future Development

The current version of the plugin successfully scrapes websites built using traditional technologies such as PHP and static HTML. In the next release, the scraping engine will be enhanced to handle more complex, JavaScript-driven websites—such as those built with frameworks like Django (Python) or React—by integrating advanced Node.js libraries like Playwright, which can render and extract content from dynamic pages.