Permalink
Browse files

Made the arc library compatible with the existing liveweb proxy data.

  • Loading branch information...
1 parent f4dbc04 commit a46cf05e02646681d7f4df31009a0373b5933a68 Anand Chitipothu committed Mar 29, 2012
Showing with 5 additions and 2 deletions.
  1. +5 −2 warc/arc.py
View
@@ -342,8 +342,11 @@ def _read_arc_record(self):
if header == "":
return None
-
- self.fileobj.readline() # Drop the separator newline
+
+ # The liveweb-proxy doesn't add these new lines in the ARC
+ # record. Commented this link to make this library work with
+ # that data.
+ #self.fileobj.readline() # Drop the separator newline
if self.version == 1:
url, ip_address, date, content_type, length = header.split()

0 comments on commit a46cf05

Please sign in to comment.