-
Notifications
You must be signed in to change notification settings - Fork 115
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
No documents synced if source table does not have Primary Keys #467
Comments
A primary key is mandatory, but missing user feedback seems to be a bug. |
@danajuratoni We have that logger message where we inform user that we have skipped that table because it has no primary key.
You mean do you want us to add a random unique id to the elastic document when primary key is not attached, in this case all the document will be reindex in each sync. |
Cool, for connector clients, that log message you linked is exactly what we need. |
This probably calls for adding a 'warnings' or 'messages' field to the connector protocol to communicate these kinds of things, maybe with a severity (log/warn/error)? Would definitely be useful in the jobs index, I'm not sure whether that would be as useful in the connector document itself. Adding a possible 'warning' status to the connector and job would help, too. |
Agree, 'warning' status needs to be added at the framework level and the connector should be able to pass the messages via any method that appends the message to the 'warning' field. @tarekziade what are your thoughts on this ? |
Excellent idea - I would use the standard levels though for the severity field, so |
We'd probably get a structure like this:
|
Marking this issue as blocked by the work needed to support additional severity warnings. Postponed to 8.8. |
Moving this to 8.9, as work for additional severity warning levels is postponed. |
@danajuratoni Is there any update on this considering the 8.9 release? |
@danajuratoni Please let us know if there is any update on this? |
Is the intention to add support for additional indexes or simply improve the warning message? It would be helpful for us if we were able to specify alternative indexes as we are currently unable to index materialize views due to this constraint. |
I agree, it would be good for us to revisit these constraints, and find a way to allow the user to provide a column/function to be used as |
Bug Description
Using MySQL Connector, if the source table does not have primary keys, no documents are being synced. No messages explain what happened.
To Reproduce
Expected behavior
I understand that it's not working probably because Elasticsearch relies on the primary keys to track the synchronization state. But I think it would be interesting to have a message that explains how many documents have been omitted.
Environment
The text was updated successfully, but these errors were encountered: