Link Preview Generator

This Go program processes Telegram messages with URLs, validates them, and generates link previews. It outputs cleaned, unique URLs and their previews to JSON files.

Features

• Extracts and validates URLs from Telegram messages.
• Removes session-related query strings.
• Ensures unique, valid URLs.
• Generates link previews.
• Configurable via command-line arguments or environment variables.

Usage

Command-Line Arguments

Import/Export

• -import-urls: Import URLs from a JSON file (default: imports/export.json) and output cleaned URLs (default: dist/urls.json).
• -import-input: Input JSON file path (default: imports/export.json).
• -import-output: Output JSON file path (default: dist/urls.json).

Link Previews

• -generate-preview: Generate link previews.
• -preview-input: Input JSON file for URLs (default: dist/urls.json).
• -preview-output: Output JSON file for previews (default: dist/previews.json).

Examples

Import/Export URLs

export IMPORT_IGNORE=".*example.com.*"
go run . -import-urls -import-input=imports/export.json -import-output=dist/urls.json

Generate Previews

export DEBUG=true
go run . -generate-preview -preview-input=dist/urls.json -preview-output=dist/previews.json

Environment Variables

• IMPORT_IGNORE: Regex to ignore URLs.
  • Example: export IMPORT_IGNORE=".*example.com.*"
  • Default: No URLs ignored.
• DEBUG: Enable debug logging.
  • Example: export DEBUG=true
  • Default: false.

Development

Prerequisites

• Go 1.24.2 or later.
• Make (optional): For running Makefile commands.

Setup and Hooks

make setup
make hooks

The pre-commit hook will run tests and linting before each commit. You can also run them manually:

make test
make lint

or

make lint-fix

to automatically fix linting issues.

The commit-msg hook will ensure that your commit messages follow the conventional commit format. If you want to skip this check, you can use the --no-verify flag when committing.

Project Structure

$ tree -d
.
├── bin
├── dist
├── imports
├── internal
│   ├── imports
│   ├── previews
│   ├── types
│   ├── utils
│   └── validation
└── scripts

License

This project is licensed under the MIT License. See the LICENSE file for details.