8933c9536f33f6d7c72c92a2742b4019ba766869 Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/e624b05a69b01171e6da76533452db5bb81ce287 e624b05a69b01171e6da76533452db5bb81ce287 2009-12-11T18:43:35-08:00 2009-12-11T18:43:35-08:00 Special case Sqlite in the keep DB test runner. On the other DB's cursor() raises an exception if the DB doesn't exist, but not on SQLite. 7e02a24d484ffcbb75a2eb620c0d7a85075ea516 Eric Holscher eric@ericholscher.com 41faeb8ee659d59ffb1e6f4af351d421a4a83969 Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/8933c9536f33f6d7c72c92a2742b4019ba766869 8933c9536f33f6d7c72c92a2742b4019ba766869 2009-12-05T00:03:38-08:00 2009-12-05T00:03:38-08:00 Lots of new tests for Crawler. Mostly for plugins. e929eedb4c721b8d283800c6089b9d29c5662c80 Eric Holscher eric@ericholscher.com dad0bac0e9defdebec7e6616024027b0ce33313a Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/41faeb8ee659d59ffb1e6f4af351d421a4a83969 41faeb8ee659d59ffb1e6f4af351d421a4a83969 2009-12-05T00:03:08-08:00 2009-12-05T00:02:52-08:00 Make it so that by default the plugins for guppy and memory don't write to csv. You should be able to pipe the logging to a file easily enough and parse things from there. 812bfe85a8a5448b72da65a765fc98e02960b3ee Eric Holscher eric@ericholscher.com f988bffe1258871223e5db57119444303581cffd Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/dad0bac0e9defdebec7e6616024027b0ce33313a dad0bac0e9defdebec7e6616024027b0ce33313a 2009-12-04T23:22:21-08:00 2009-12-04T23:22:21-08:00 Move crawler tests into their own directory. 687687293f11c3e0426be7fa002fc4cd7b1c3419 Eric Holscher eric@ericholscher.com aae04a713b292b40f274d303105f5fea4201f983 Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/f988bffe1258871223e5db57119444303581cffd f988bffe1258871223e5db57119444303581cffd 2009-12-04T23:18:51-08:00 2009-12-04T23:16:49-08:00 Classify the replayer, hopefully making this easier to upgrade in the future. b053822c89a6a6f7bbe1897c7203cdd195fe258a Eric Holscher eric@ericholscher.com 330c63907f2f8d97d5c9de59f5566eb6c6f68849 Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/aae04a713b292b40f274d303105f5fea4201f983 aae04a713b292b40f274d303105f5fea4201f983 2009-12-04T23:03:34-08:00 2009-12-04T23:03:34-08:00 Small cleanup 6c4b131306cdc8530790cf19507ab6f4613ac337 Eric Holscher eric@ericholscher.com 1310ce520a7adb5b9670ebde9b0f246561513b80 Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/330c63907f2f8d97d5c9de59f5566eb6c6f68849 330c63907f2f8d97d5c9de59f5566eb6c6f68849 2009-12-04T23:03:03-08:00 2009-12-04T23:03:03-08:00 Fix replay functionality. This should be more robust. Probably need to make it a class. 82d2413d925cffc782c0d2de6dab4dcea6b112d3 Eric Holscher eric@ericholscher.com c8d7aa8afb9c2868b0f806d5b7bf6cd08ebeaf49 Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/1310ce520a7adb5b9670ebde9b0f246561513b80 1310ce520a7adb5b9670ebde9b0f246561513b80 2009-12-04T22:26:39-08:00 2009-12-04T22:26:39-08:00 Add regression test for inserting middleware twice. 2c36c18cf543f6ee45f63c51ba57cd06509e4acc Eric Holscher eric@ericholscher.com c461f909edab321175027b7b479df2ea067070b6 Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/c8d7aa8afb9c2868b0f806d5b7bf6cd08ebeaf49 c8d7aa8afb9c2868b0f806d5b7bf6cd08ebeaf49 2009-12-04T22:17:57-08:00 2009-12-04T22:17:57-08:00 Only allow the middleware to be inserted once. 45e7fe9351ccef8bbb11803e76499cd2e286775f Eric Holscher eric@ericholscher.com 48d66ebb2b24a4880bf1b40d6b24914c70814851 Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/c461f909edab321175027b7b479df2ea067070b6 c461f909edab321175027b7b479df2ea067070b6 2009-12-03T09:22:17-08:00 2009-12-03T09:22:17-08:00 Write a test for the twill processor. This appears to be outputting requests twice, need to look more into it. Will write a regression test once I figure it out. b6d08cf5d73a07a0e8245ccf966bd9322a7f5084 Eric Holscher eric@ericholscher.com 6962e9a2a1c31cf99a064a135e9f9ed65d83e97e Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/48d66ebb2b24a4880bf1b40d6b24914c70814851 48d66ebb2b24a4880bf1b40d6b24914c70814851 2009-12-03T09:21:46-08:00 2009-12-03T09:21:46-08:00 Move preference checks out of the top-level. This allows you to change the type of logging done after the file has been evaluated. 638919943941039a9a92d45a69616cc9bac36d9a Eric Holscher eric@ericholscher.com c1c4b9299af1714d15e395f59881f9ea7d15925e Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/6962e9a2a1c31cf99a064a135e9f9ed65d83e97e 6962e9a2a1c31cf99a064a135e9f9ed65d83e97e 2009-12-02T18:12:22-08:00 2009-12-02T18:12:22-08:00 Added a test for relative crawling. 14265ac95aa76704ae67d694f975ba25383b69d3 Eric Holscher eric@ericholscher.com 787462c52319f866b185a553b7382b32447d81d4 Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/c1c4b9299af1714d15e395f59881f9ea7d15925e c1c4b9299af1714d15e395f59881f9ea7d15925e 2009-12-02T17:33:07-08:00 2009-12-02T17:33:07-08:00 Update the AUTHORS file to add all the wonderful people who have helped as of late. 5d27f90d7a16da94ca570699eb9f76249b05b609 Eric Holscher eric@ericholscher.com e05fbd88d63dd34a262edf048acc28500b3b9474 Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/787462c52319f866b185a553b7382b32447d81d4 787462c52319f866b185a553b7382b32447d81d4 2009-12-02T17:22:13-08:00 2009-12-01T11:20:51-08:00 Crawler: non-zero return status if we encounter errors 4f0133d38d49690056adc05332052102563ac559 Eric Holscher eric@ericholscher.com 1884c52706beab9672a58fcb6cadc7ed6a85b177 Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/e05fbd88d63dd34a262edf048acc28500b3b9474 e05fbd88d63dd34a262edf048acc28500b3b9474 2009-12-02T17:22:13-08:00 2009-12-01T11:08:27-08:00 Crawler: consistent logging for uncrawled patterns 75c07de399be253da0c0ba27541cb20b42d673bd Eric Holscher eric@ericholscher.com e29bc9d4f00f68f496bf8355f14c52c75f6f708c Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/1884c52706beab9672a58fcb6cadc7ed6a85b177 1884c52706beab9672a58fcb6cadc7ed6a85b177 2009-12-02T17:22:12-08:00 2009-12-01T10:57:38-08:00 crawler: better reporting of unmatched URL patterns 22619637a8a4fb83f0f8ac5ace9f45cb12763221 Eric Holscher eric@ericholscher.com 622c37dab467fba19bca50c36fa327b28f3ca075 Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/e29bc9d4f00f68f496bf8355f14c52c75f6f708c e29bc9d4f00f68f496bf8355f14c52c75f6f708c 2009-12-02T17:22:12-08:00 2009-12-01T10:34:50-08:00 Crawler: fixed URL parsing of non-HTML responses c7fc63513ce82d8d0c696d7cdfd2b55be0516756 Eric Holscher eric@ericholscher.com 8c59de21931fbe20d1b73fb692716089530655ec Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/622c37dab467fba19bca50c36fa327b28f3ca075 622c37dab467fba19bca50c36fa327b28f3ca075 2009-12-02T17:22:12-08:00 2009-12-01T09:37:33-08:00 Crawler: better redirect handling The test client followed URLs; now it passes the final redirect_chain to _parse_urls so relative URLs are joined correctly (i.e. if "/foo" redirects to "/foo/" we want <a href="bar"> to become "/foo/bar", not "/foobar"). 0e9212722e5b0a78874cbe6c985b1063f548e19f Eric Holscher eric@ericholscher.com d269af70ea760f7b707864c3c8daf5a5c9965188 Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/8c59de21931fbe20d1b73fb692716089530655ec 8c59de21931fbe20d1b73fb692716089530655ec 2009-12-02T17:22:12-08:00 2009-12-01T09:24:55-08:00 crawler: better validation & error handling base.py now warns about non-200 HTTP status codes sanitize.py now avoids validating non-HTML responses 6f74ec463fc39ac2483c2b0458dd201bf94c23d2 Eric Holscher eric@ericholscher.com 1fcd24a7ed4f5b97b9fa9bc79fb35f86a17406c6 Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/d269af70ea760f7b707864c3c8daf5a5c9965188 d269af70ea760f7b707864c3c8daf5a5c9965188 2009-12-02T17:22:12-08:00 2009-12-01T09:09:04-08:00 crawler: better link handling & logging 496f804fe1dc003ead8e54d89ae8c48763687e3e Eric Holscher eric@ericholscher.com ed9e8a5b8e5d8a78079112ff8238ce4951aa4caf Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/1fcd24a7ed4f5b97b9fa9bc79fb35f86a17406c6 1fcd24a7ed4f5b97b9fa9bc79fb35f86a17406c6 2009-12-02T17:22:11-08:00 2009-12-01T09:08:51-08:00 Crawler: performance improvement for sanitize plugin 3d49d8d8fb6f8826574c62c0abec608834f32c4a Eric Holscher eric@ericholscher.com 68fbed69743430efd428cba65a019886e657c0c3 Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/ed9e8a5b8e5d8a78079112ff8238ce4951aa4caf ed9e8a5b8e5d8a78079112ff8238ce4951aa4caf 2009-12-02T17:22:11-08:00 2009-12-01T08:35:34-08:00 crawler: better logging support Now a logger named "crawler" is enabled and configured by the management command for use by everything in the crawler. Fixed a minor bug: CommandError was referenced but not imported Cleaned some imports & dead code 544f81b557f69be21b0ab4cd2095a94e5c4d5fa7 Eric Holscher eric@ericholscher.com 8000e104029906331fa3e78fff1cff89c8981794 Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/68fbed69743430efd428cba65a019886e657c0c3 68fbed69743430efd428cba65a019886e657c0c3 2009-12-02T17:22:11-08:00 2009-12-01T08:04:13-08:00 crawler: performance boost BeautifulSoup will spend a huge amount of CPU time doing charset detection if you give it a non-unicode string a1db6b1e819763c1b43aa17600089d35074d5719 Eric Holscher eric@ericholscher.com c1c66ad32981763b5391bf755ae6d801f830db4b Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/8000e104029906331fa3e78fff1cff89c8981794 8000e104029906331fa3e78fff1cff89c8981794 2009-12-02T17:22:11-08:00 2009-12-01T07:36:59-08:00 crawler: better test environment Disable settings.DEBUG before crawling for performance Use test client's setup/teardown to avoid things like email being sent. c4341d5f3fdb2827e5cb20d887bdb812ab389ea7 Eric Holscher eric@ericholscher.com 81216a08d4fad0ee45d705a46c12f2ff4f885a73 Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/c1c66ad32981763b5391bf755ae6d801f830db4b c1c66ad32981763b5391bf755ae6d801f830db4b 2009-12-02T17:22:11-08:00 2009-12-01T07:31:12-08:00 Switch to logging Slowly starting the process of converting print statements to logging calls. Still todo: initializing logging for people whose projects don't already do that. f42edfa164a422d229b738de38a8318b3143587a Eric Holscher eric@ericholscher.com 293ea9cebbb824a07daf65a668828581f9e71df0 Chris Adams chris.adams@nasa.gov http://github.com/ericholscher/django-test-utils/commit/81216a08d4fad0ee45d705a46c12f2ff4f885a73 81216a08d4fad0ee45d705a46c12f2ff4f885a73 2009-12-02T17:22:10-08:00 2009-12-01T07:30:28-08:00 crawler: now with error handling get_url is called within a try block; to avoid issues such as unhandled exceptions leaving Postgres in an error state, transaction.rollback() is called after every request 5c53ef6bed9923a7ae7ba35ed524bd6d2024080e Eric Holscher eric@ericholscher.com 8c656cc938acad1a6d3632e991a817af04873a7a Eric Holscher eric@ericholscher.com http://github.com/ericholscher/django-test-utils/commit/293ea9cebbb824a07daf65a668828581f9e71df0 293ea9cebbb824a07daf65a668828581f9e71df0 2009-11-30T18:38:12-08:00 2009-11-30T18:38:12-08:00 Set the middleware to enabled so it doesn't override paths. This should allow the tests to run and pass! :) d1666c74009b0e85da1b8083502e77ff50dd977d Eric Holscher eric@ericholscher.com d055c888194e4b50ef58812d98ec7dab55f8566c Andrii Kurinnyi andrew@marpasoft.com http://github.com/ericholscher/django-test-utils/commit/8c656cc938acad1a6d3632e991a817af04873a7a 8c656cc938acad1a6d3632e991a817af04873a7a 2009-11-30T18:07:59-08:00 2009-11-30T02:15:47-08:00 Fixed model imports in polls views and admin 08c59fc3522336d6c7ee3c7a4a08d5e92e69e823 Eric Holscher eric@ericholscher.com 7871f426b4433827be8191cf531fc1895292486b Andrii Kurinnyi andrew@marpasoft.com http://github.com/ericholscher/django-test-utils/commit/d055c888194e4b50ef58812d98ec7dab55f8566c d055c888194e4b50ef58812d98ec7dab55f8566c 2009-11-29T16:51:14-08:00 2009-11-29T03:33:54-08:00 Fixed missing 'url' variable 2dac632917d3daddf56d8c4cd12365588afbd2fa Eric Holscher eric@ericholscher.com 11d6a35ef1197c7bdee0aeb17de0324e40fae017 Andrew Kurinnyi andrew@loki.(none) http://github.com/ericholscher/django-test-utils/commit/7871f426b4433827be8191cf531fc1895292486b 7871f426b4433827be8191cf531fc1895292486b 2009-11-28T01:33:31-08:00 2009-11-22T22:15:55-08:00 Fixed typo in app variable name in testmaker management command 6256c216a086ccf4d11928221bd44ec962d24e5e Eric Holscher eric@ericholscher.com