-
Notifications
You must be signed in to change notification settings - Fork 157
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DateTimeColumn: Handle Datetime day suffixes #458
Conversation
…on.dumps() functionality. Updated numerical_column_stats.py _perform_t_test to cast conservative and welch values to floats before assignment.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One potential issue is that if a date is formatted as such:
15thMarth13
then it will be picked up as 2013-03-15
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
one syntax comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, small fixes
@micdavis , run |
@@ -268,6 +268,8 @@ def test_profile(self): | |||
expected = defaultdict(float, {'datetime': 2.0}) | |||
self.assertEqual(expected, profiler.profile['times']) | |||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit pick but you can probably get rid of this extra space between the two self.assert
in the same test function
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
- one specific comment
- one general for
isort .
other than those, I'll apporove
* Fix: updated test_(int/float)_column_profile.py test_diff to cover json.dumps() functionality. Updated numerical_column_stats.py _perform_t_test to cast conservative and welch values to floats before assignment. * Fix: addressed PR change requests. * Fix: Reformatting * Fix: Added check to test to cover newly required functionality. * Bumped version * Fixed Datetime profiler day suffix issue
Fix: Updated datetime_column_profile.py to remove day suffixes from the date when we check its format. Updated the test_datetime_column_profile.py test to test for this change. Addresses this issue #441