Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

dbWriteTable doesn't seem to be fully repairing the table #81

Closed
DyfanJones opened this issue Mar 26, 2020 · 1 comment
Closed

dbWriteTable doesn't seem to be fully repairing the table #81

DyfanJones opened this issue Mar 26, 2020 · 1 comment

Comments

@DyfanJones
Copy link
Owner

A user on Rstudio community is experiencing issues were dbWriteTable isn't repairing the table once data has been updated to AWS Athena link.

This could be down to dbExecute not fully reporting errors from AWS Athena and not notifying user the repair has failed.

Might need to explore using ALTER TABLE instead of MSCK REPAIR for general speed if user has multiple partition.

Note: dbExecute has been fixed in latest PR #80 and will return AWS Athena errors. Will need to check what version user is using and then debug
@DyfanJones
Copy link
Owner Author

Closing Ticket as MSCK REPAIR was performed on AWS Athena, however user was using HIVE and Hive Metadata Store wasn't updated. As noctua doesn't connect to Hive, user has been given advice in how to tackle issue going forward.

Note: re-open if solution for user doesn't resolve issue

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@DyfanJones