Test Wish List

[bengolder]

Integration tests
Tests that ensure that the code can perform tasks when the different pieces are used in concert. These may touch the file system and may use a test database.

• Test that a GET request to the root URL returns a demo index page
• Test that we can POST a sample pdf
  • make sure that it returns the right field types and field names
  • make sure the url is correct
  • make sure that it properly reports any errors or problems with invalid pdfs
    • make sure it warns about unsupported field types
    • make sure it gives a warning if it cannot find any fields
    • make sure it is not encrypted or locked
    • make sure it properly reports any pdftk errors
    • make sure it gives you actionable information to fix the errors or warnings
  • make sure the pdf's data is properly stored in the database
  • make sure it can handle all the supported field types
  • make sure any temporary files are deleted
  • make sure we get an fdf that we would expect
  • make sure we get an fdf mapping that we would expect
  • make sure we can post a pdf that is written in unicode, such as Chinese, Japanese, Korean characters
• Test that we can submit data to fill a pdf
  • make sure it returns a pdf that's filled as we would expect (compare against an existing filled test file)
  • make sure the fdf and filled fdf are what we would expect
  • make sure that all temp files are removed and no data is stored in the database
  • report errors for what pdftk cannot accept
  • make sure if you submit fields that aren't in the pdf, that it will error
  • make sure it supports unicode submissions

Unit tests
Tests that do not rely on file system or the db, and which only run isolated units of code. They should generally run very quickly. Mock and patch are extremely helpful for writing these.

• Test that each of the field types can be properly filled
• Test regex matching for each field type
• Test pdftk wrapping functions, without touching filesystem
• Test filling an fdf with unicode text
• Test reading in a pdf with unicode text in fields

Other Functional or Manual Tests

• install and use it in another Flask project
• install and use it in an existing Django project
• deploy it on Heroku
• deploy it on AWS
• deploy it on Azure
• deploy it on Cloud.gov