Permalink
Browse files

- More descriptive title for the Quantcast list

- Change the DNS server used for DNS lookups to OpenDNS, this fixes a problem I was having with getting blank results for some domains.
- Update TODO
- Add :self, :other, and :none to the name-lookups file. Modify the Name class to handle lookups without a "dba" entry. Add Nettica to the lookups
- Add footer to the HTML "view"
- Update the Information class to not show additional or authority sections of DNS requests
- Rename run.rb to profile
- Rename profile.rb to profile-list
  • Loading branch information...
1 parent cd917af commit 884a29d0ccffee26592f96a5213af948bb46c6c8 @jpf committed Aug 1, 2009
View
4 TODO
@@ -1,6 +1,6 @@
-We should be able to tell the difference between EC2 hosts and normal amazon hosts
+FIX ME: Why are some of the IP addresses for hp.com returning blank?
-Why does DNS detection return :none sometimes? WTF
+We should be able to tell the difference between EC2 hosts and normal amazon hosts
Determine if there is a whois error, or if it's a parsing error
View
@@ -1,4 +1,10 @@
---
+:self:
+ :name: Self Hosted
+:other:
+ :name: Other / Self Hosted
+:none:
+ :name: None
:softlayer:
:name: SoftLayer
:dba:
@@ -253,3 +259,7 @@
:name: Domain Bank
:dba:
- dstr acquisition pa i, llc dba domainbank.com
+:nettica:
+ :name: Nettica
+ :dba:
+ - nettica.com
@@ -11,15 +11,18 @@ def status(message)
def fetch(host)
data = {}
#TODO: Automatically generate a 'version' - checksum this file or class?
- version = 'v2'
+ version = 'v4'
+ dns_server = '208.67.222.222' # OpenDNS
+# dns_server = '4.2.2.2' # Level 3
filename = "cache/#{host}.#{version}.cache"
if File.exists?(filename)
data = open(filename) { |f| Marshal.load(f) }
else
data[:version] = version
status "Fetching data for #{host}: DNS "
- data[:dns] = `server=4.2.2.2; host=#{host}; dig @$server ns $host; dig @$server a $host; dig @$server mx $host; dig @$server txt $host`
+ dnsopt = '+noadditional +noauthority'
+ data[:dns] = `server=#{dns_server}; host=#{host}; dig @$server ns $host #{dnsopt}; dig @$server a $host #{dnsopt}; dig @$server mx $host #{dnsopt}; dig @$server txt $host #{dnsopt}`
status 'Whois '
data[:whois] = `sleep 2; whois 'domain #{host}'`
@@ -4,6 +4,7 @@ def initialize
@aliases = YAML::load(File.open(lookup_file))
@lookup = {}
@aliases.keys.each {|shortname|
+ next unless @aliases[shortname][:dba].is_a? Array
@aliases[shortname][:dba].each {|dba|
@lookup[dba] = shortname
}
View
@@ -1,4 +1,4 @@
-#List: Quantcast
+#List: Quantcast Top 100
google.com
yahoo.com
msn.com
View
@@ -1,3 +1,4 @@
+#!/usr/bin/env ruby
# encoding: UTF-8
$LOAD_PATH.unshift File.expand_path(File.dirname(__FILE__) + '/lib')
View
1 profile.rb → profile-list 100644 → 100755
@@ -1,3 +1,4 @@
+#!/usr/bin/env ruby
# encoding: UTF-8
$LOAD_PATH.unshift File.expand_path(File.dirname(__FILE__) + '/lib')
View
@@ -39,5 +39,8 @@
</table>
</div>
</div><!-- container -->
+<div id="footer">
+ Generated on <%= Time.now.strftime('%Y-%m-%d') %> by <a href="http://github.com/jpf/domain-profiler/tree/master">domain-profiler</a>
+</div>
</body>
</html>

0 comments on commit 884a29d

Please sign in to comment.