Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Fetching latest commit…
Cannot retrieve the latest commit at this time.
|Failed to load latest commit information.|
Thoughts django is 4mb. It took 2hours to get something going + another 2hours to get chunked output, clickable urls and code reuse I think I prefer sinatra style web frameworks. I am wondering how safe clean data really is, any problems means shell command injection. getting django working with google app engine is painful. TODO bar graph crawl time db Problem Description Language: Python App Category: Networking/Web Application DB: None (Use any DB in Complex part) Problem statement: Simple Part: Develop a web application using Python. You can use any Web framework if you want to. The website should use the web crawler application you created in Week 1, as a backend tool. The site will have a home page that will ask the user for a URL seed, depth of crawling and a search string. On click of Search button, it should show the results in a tabular form. The results should show the URL's whose page content contains search string and also the depth at which the URL is found. Preferably host this site in google app engine. It's free and supports Python. If you have difficulties hosting it, you can submit only the code. Complex Part: (Optional. if you complete simple part and want to take up something more challenging) - Show results using a bar graph on the web site. The graph should show the number of occurances of the search string on a particular URL. - Since crawling may take time to fully execute, keep showing results as and when they are found by crawler (asynchonously). - User should be able to click on Url link from search results to go to that page. - Show time spent to get results. - Store input and results in DB and show Search History in a different page.