Public, free to use, repository with diggers configs for web scraping various e-commerce websites and online stores
All configs can be used with Diggernaut service to retrieve products information.
- You need to create free account at Diggernaut
- Login to your account
- Create a project with any name and description you want
- Get into your new project by clicking it and create new digger with any name
- Then you will see 3 options suggested to you, you need to use one where you will use meta-language
- Config editor will open and you can simply copy and paste config code and click on save button.
- Switch mode for digger from Debug to Active and then run your digger.
- Wait for completion.
- Download data.
- Schedule your runs if required.
List of sites:
- abercrombie.com
- adidas.com
- adidashardware.com
- ae.com
- alexandermcqueen.com
- americanapparel.net
- anntaylor.com
- anthropologie.com
- asos.com
- athleta.gap.com
- avito.ru
- bananarepublic.gap.com
- bedbathandbeyond.com
- benmeadows.com
- betseyjohnson.com
- bloomingdales.com
- burton.com
- cabelas.com
- calypsostbarth.com
- cartier.com
- chanel.com
- covergirl.com
- debshops.com
- desigual.com
- diesel.com
- dior.com
- donnakaran.com
- dwell.co.uk
- eddiebauer.com
- eloquii.com
- esteelauder.com
- faithfullthebrand.com
- farfetch.com
- ferragamo.com
- footlocker.com
- forever21.com
- freepeople.com
- gap.com
- gapfactory.com
- gentrynyc.com
- gilt.com
- global.tommy.com
- guess.com
- guessbymarciano.guess.com
- happysocks.com
- hermanmiller.com
- hermes.com
- hm.com
- hollisterco.com
- hugoboss.com
- ikea.com
- jaanuu.com
- jcrew.com
- joesjeans.com
- johnstonmurphy.com
- johnvarvatos.com
- romwe.com
- patagonia.com
- vans.com
To be released:
- karenwalker.com
- karl.com
- katespade.com
- kennethcole.com
- kohls.com
- lancome-usa.com
- levi.com
- llbean.com
- lornajane.de
- lululemon.com
- macys.com
- mango.com
- marcjacobs.com
- marketplace.asos.com
- matthewwilliamson.com
- maybelline.com
- michaelkors.com
- nastygal.com
- nautica.com
- neimanmarcus.com
- nike.com
- nordstrom.com
- oldnavi.gap.com
- onekingslane.com
- paulsmith.com
- pier1.com
- potterybarn.com
- quiksilver.com
- rainbowshops.com
- ralphlauren.com
- ralphlaurenhome.com
- rei.com
- revlon.com
- revolve.com
- riverisland.com
- roomandboard.com
- rue21.com
- scotch-soda.com
- sephora.com
- shopbop.com
- eastdane.com
- sonos.com
- stellamccartney.com
- stevemadden.com
- style.com
- sunglasshut.com
- superdry.com
- surlatable.com
- target.com
- tedbaker.com
- timberland.com
- tomford.com
- topman.com
- topshop.com
- toysrus.com
- uk.tommy.com
- underarmour.com
- uniqlo.com
- urbanoutfitters.com
- us.benetton.com
- us.burberry.com
- us.louisvuitton.com
- us.nextdirect.com
- us.shein.com
- valentino.com
- versace.com
- victoriassecret.com
- vineyardvines.com
- walmart.com
- westelm.com
- whitehouseblackmarket.com
- williams-sonoma.com
- ysl.com
- zalando.de
- zappos.com
- zara.com
- zarahome.com