Scrapes eBay search pages and sends you a notification when a new item appears so you don't have to keep revisiting the search pages manually.
This project hasn't been updated in 3 years, so I cannot guarantee it will still work. When it worked, I tested it on the Belgian and UK eBay sites. For other regions, it could be that the bot never worked depending on whether the HTML structure matched the regions I tested it on.
At the moment, I don't really have an incentive to update the project. The goal of this project was for me to experiment with and learn a new programming, Go, and I feel like I accomplished that goal. This was my first time writing code in a compiled language and being exposed to concepts such as pointers, implicit interfaces and slices. At the time, I was only used to writing in languages that were run with interpreters such as PHP or JavaScript. This was a great introduction to a slightly lower level language. One of my courses at university was about operating systems which involved a lot of writing C, and both of those experiences went hand in hand with making me grasp how computers actually work, learning about memory management, compilers, garbage collection, compilation targets and so on.
For those that would like to update this project: feel free! I am open to accepting PR's.
Change directory to where you would like to install the program and then run the following commands.
curl -OL https://github.com/samjmckenzie/ebay-monitor/releases/latest/download/ebay-monitor-linux-armv6l.zip
curl -OL https://github.com/samjmckenzie/ebay-monitor/releases/latest/download/config-files.zip
unzip ebay-monitor-linux-armv6l.zip
unzip config-files.zip
rm ebay-monitor-linux-armv6l.zip config-files.zip
chmod +x ebay-monitor telegram-chat-id- Download the latest release for your system architecture as well as the config files here.
- Unzip the binary and config zip files.
- Add execute permissions to the binary files by running
chmod +x ebay-monitorandchmod +x telegram-chat-id.
The main purpose of the program is to notify you whenever a new listing appears on an eBay search page. We will be using the Telegram messaging app to send these notifications as the app easily allows you to create bots. You can either download the app on desktop or on mobile. I'd suggest using the desktop for the setup as you will need to copy an API key.
Once you've downloaded the app and have setup an account, you can create the bot by sending a message to BotFather. You can do this by either opening this link or by looking up the name "BotFather" when trying to send a new message.
After you select its name, click on the start button at the bottom of your screen. Send the message "/newbot" to it and it will guide you through the bot creation process.
When you finish the creation process, you should receive a message that contains a token to access the HTTP API token. Copy this token and paste it into the TELEGRAM_TOKEN field of your .env so it looks like this:
TELEGRAM_TOKEN="1222533313:AAFwNd_HsPtpxBy35vEaZoFzUUB74v5mBpW"Now you need to get the chat ID which the bot will send messages to. You can get this by sending your bot a message and then running the telegram-chat-id binary, after which you will see a message like this in your terminal:
From YOUR-TELEGRAM
667630712
The last line of the message is the Telegram chat ID. Your .env file should automatically be updated after running the binary. If it isn't, paste it into the TELEGRAM_CHAT_ID field.
You can make the program search for new item listings by simply searching for that item like you normally would and then sorting by newly listed.
Now copy the URL and add the following to config.toml:
[[searches]]
url = "copied URL"You can also use filters as they are visible in the URL.
If, for example, I wanted the program to search for new listings of "duct tape" and "macbook pro", the bottom of config.toml would look like this:
[[searches]]
url = "https://www.ebay.co.uk/sch/i.html?_from=R40&_nkw=duct+tape&_sacat=0&_sop=10"
[[searches]]
url = "https://www.ebay.co.uk/sch/i.html?_from=R40&_nkw=macbook+pro&_sacat=0&_sop=10"The other keys in config.toml will be explained here:
intervalis the interval in seconds between each loop of scrapingmessageis the format of the Telegram messageweb-serverindicates whether the web server will be ran from which you can pull new listings. This can act as an alternative to the Telegram messages.track-scraped-urlswill add scraped URLs to scraped.json to save the last position, but it is not essential to running the program
To run the program, change directory to the folder with all the program files and run ebay-monitor.