Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Whois, Alexa, API, Data-Scrapping, UI Customization and Cache Integration #90

Closed
wants to merge 34 commits into from

Conversation

rohitcoder
Copy link

@rohitcoder rohitcoder commented Mar 4, 2018

Hi,
I noticed that This extension is launching popups for each feature. If you want to see whois detail you will get popup, if you want to see Alexa details again popup.
This is frustrating for users and of course affecting your quality.

Thats why i removed popups and created one API for getting all whois data and the interesting thing is you can host this API yourself. I was looking for whois data API and every API was Paid and wayback machine will never agree to use those third parties because of dependency and pricing. That's why i created API for your extension how it works?

  1. You pass site name into API (https://rohitcoder.cf/research/whois_api/index.php?site=edvoid.com)
  2. It fetches data from Whois.com (Data-scrapping)

3 It returns data in JSON format to Chrome extension
4. We represent those data

Same thing i will do for Twitter search, Alexa and I will also add Google+Bing Top 3 results from search (without any popups)

Applying for #GsoC2018

rohitcoder and others added 7 commits March 1, 2018 23:44
Modified and upgraded "Whois search. Now you can see all whois data in same tab without any popups and annyoing tabs. Enjoy Wayback machine! Fast+Secure
Enjoy New Updates!
---------------
Updated Files
----------------
index.html
scripts/popup.js
Follow the instructions from readme.md file
@rohitcoder
Copy link
Author

I also added my whois data API code which is located in host folder.

@rohitcoder
Copy link
Author

image
@markjgraham @vbanos New Updates Coming Soon 😎
I hope you all will like this new update like the previous one

unknown and others added 10 commits March 6, 2018 16:15
Alexa and Whois API Code for scraping data from alexa.com and whois.com
Host it yourself on your server
Host it on your server
Now you can see metrics and Alexa results in same tab
Now you can see metrics and Alexa results in same tab
Now you can see metrics and Alexa results in same tab
@rohitcoder
Copy link
Author

Hi, My new update is here...

  1. Integrated Alexa API with Chrome Extension
  2. You can Check Alexa and Whois API Codes from host folder
    imageimageimageimage

For more Snapshots Please check snap_shots directory

Next update coming soon...

@markjgraham @vbanos Please verify these new PRs

Added patch for 500 internal server error when" .countryRank" data is not available.
@abhidas17695
Copy link
Collaborator

Thank you for this pull request @rohitcoder . If you feel any more stuff needs improvement please make the required pull requests.

unknown and others added 4 commits March 18, 2018 15:22
Updated Complete UI, Loading Screen and Fixed some critical bugs which were not working on my previous updates (Related to search and about page)
@rohitcoder
Copy link
Author

rohitcoder commented Mar 18, 2018

Related PR - #100
@abhidas17695 @vbanos new update here
Updated Index UI, Loading UI, Alexa Data UI, Whois Data UI
Fixed minor bugs related to Search 🔍 feature and About page. (JS wasn't working)
Working on next update - 🖊️ Customizable theme, 👤 user can edit themes directly from extension and data will be saved in local storage using chrome API

I noticed everyone is contributing code indention changes / UI changes these are'nt major changes 😝 but i not contributed any UI changes yet. That's why this new updated was completely related To UI 🤓

imageimageimageimage

 Now Supporting Localized Cache feature for Alexa Scrapper (10x Faster that previous loading time)
Now Supporting Localized Cache for Alexa (10x fast loading compared to usual load time)
This extension will load 10x faster result compared to previous load time (In case you check Alexa result for same site second time)
For storing data in the cache we were using chrome.storage.sync.set (102,400 QUOTA_BYES LIMIT) i upgraded it to  chrome.storage.local.set (5,242,880 QUOTA_BYES LIMIT).

Suggestion: In future, if anyone wants to use this repo please use chrome.storage.sync.set because we are storing only cache in chrome.storage.local.set
@rohitcoder
Copy link
Author

rohitcoder commented Mar 23, 2018

@abhidas17695 @markjgraham Again a new update
This Update was really tough and it took lots of time for me. I added auto cache feature for my data-scrapping methods (because usually, it takes a lot of time) i also did some great changes like

 chrome.storage.local.set //  Now we are using this because it has 5,242,880 QUOTA_BYES Limit available
chrome.storage.sync.set // we removed this API because it had few limits like only 102,400 QUOTA_BYTES were available

Have a look at the attached video (Demo) how its working

Wayback Machine Chrome Extension

In next update, i will implement this same cache system with whois data API and i will come with customizable theme settings (Because now i am ready to work with chrome.storage.sync.set)

Thanks,
Have a Good Day!

@rohitcoder rohitcoder changed the title Updated Whois Data Presentation Using API Whois, Alexa, API, Data-Scrapping, UI and Cache Integration Mar 24, 2018
Now this extension will also support User Design Customizations
Settings option Introduced!
Now this extension is ready for Customization - User can now customize look and feel of this extension themselves
This extension now also supports some new features like
 - Reset Customizations and features to defaults
- Now user can Clear all Cached data in a single click (If you are thinking data isn't updated)
@rohitcoder
Copy link
Author

rohitcoder commented Mar 29, 2018

Introducing Customizations With Reset options and Cache Management

ezgif-4-e45b1849cd
@abhidas17695 @markjgraham
As I promised, This is my another one update now user can customize look and feel of this extension themselves! In this update, i also included Some reset features like Reset Customizations or Reset Everything (Which will clear all cache data so that extension can load fresh data)

In this above image, you can see two features working

  1. Customization
  2. Reset Everything / Reset Customziation option

Thanks,
Rohit Kumar (@rohitcoder)

@rohitcoder rohitcoder changed the title Whois, Alexa, API, Data-Scrapping, UI and Cache Integration Whois, Alexa, API, Data-Scrapping, UI Customization and Cache Integration Mar 29, 2018
This extension is now ready with Whois automatic cache Which will enhance the speed of this extension.
Updated CSS Design for Search LIST (Auto-Suggestion)
ALL CSS Internal Scripts Shifted to external file css/custom.css
This file contains new CSS also shifted from index.html
@rohitcoder
Copy link
Author

rohitcoder commented Apr 6, 2018

@abhidas17695 @markjgraham I added new commits again.
In this update I Included

  1. Whois feature now also supports automatic cache
  2. Updated Search UI List-View
  3. Few code optimizations like Removing unusual .bak files from project and replaced internal stylesheet with an external stylesheet
  4. Am also trying to decrease size and code length of files so that it can render fast for best performance below is short example code am using it for same purpose Alexa and as well as for Whois. Note here am not creating a lot of unusual functions for each feature.
    image

In next update i will try to include Safety and Security Rating (By Norton)

This will help any user to identify that any particular website is safe or not.

Thanks,
Rohit Kumar

@rohitcoder
Copy link
Author

I started working on Remote Configuration feature Which i mentioned in My GSOC Proposal.

image

I am sure, this will help your team alot to manage extension updates & Features remotely.

@vbanos vbanos closed this Dec 19, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants