diff --git a/README.md b/README.md index 08df168c..2985e4de 100644 --- a/README.md +++ b/README.md @@ -23,7 +23,7 @@ historical archival. # mix.exs defp deps do [ - {:crawly, "~> 0.7.0"} + {:crawly, "~> 0.8.0"} ] end ``` @@ -67,7 +67,6 @@ historical archival. config :crawly, closespider_timeout: 10, concurrent_requests_per_domain: 8, - follow_redirect: true, closespider_itemcount: 1000, middlewares: [ Crawly.Middlewares.DomainFilter, @@ -103,8 +102,8 @@ You can read more here: ## Roadmap -1. [ ] Pluggable HTTP client -2. [ ] Retries support +1. [x] Pluggable HTTP client +2. [x] Retries support 3. [ ] Cookies support 4. [ ] XPath support 5. [ ] Project generators (spiders) diff --git a/documentation/introduction.md b/documentation/introduction.md index 202d349a..fa870199 100644 --- a/documentation/introduction.md +++ b/documentation/introduction.md @@ -11,7 +11,7 @@ Crawly requires Elixir v1.7 or higher. 1. Add Crawly to you mix.exs file ```elixir def deps do - [{:crawly, "~> 0.7.0"}] + [{:crawly, "~> 0.8.0"}] end ``` 2. Update your dependencies with `mix deps.get` diff --git a/documentation/quickstart.md b/documentation/quickstart.md index bbd2de31..38c1479f 100644 --- a/documentation/quickstart.md +++ b/documentation/quickstart.md @@ -12,7 +12,7 @@ Goals: # mix.exs defp deps do [ - {:crawly, "~> 0.7.0"} + {:crawly, "~> 0.8.0"} ] end ``` diff --git a/documentation/tutorial.md b/documentation/tutorial.md index 94c635aa..b9d75bd6 100644 --- a/documentation/tutorial.md +++ b/documentation/tutorial.md @@ -54,7 +54,7 @@ file with the following code: ```elixir def deps do - [{:crawly, "~> 0.7.0"}] + [{:crawly, "~> 0.8.0"}] end ``` diff --git a/mix.exs b/mix.exs index 9d087308..078af8d0 100644 --- a/mix.exs +++ b/mix.exs @@ -1,7 +1,7 @@ defmodule Crawly.Mixfile do use Mix.Project - @version "0.8.0-dev" + @version "0.8.0" def project do [