Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Delta Migration goes in loop #307

Closed
croxarens opened this issue May 25, 2017 · 9 comments
Closed

Delta Migration goes in loop #307

croxarens opened this issue May 25, 2017 · 9 comments
Labels
question

Comments

@croxarens
Copy link

croxarens commented May 25, 2017 •
edited

I'm running the delta migration with the following command :

$ php bin/magento migrate:delta vendor/magento/data-migration-tool/etc/ce-to-ee/1.9.3.0/config.xml -vvv

and this is the output :

[2017-05-25 14:22:11][INFO][mode: delta][stage: delta delivering][step: Customer Attributes Step]: started
[2017-05-25 14:22:11][INFO][mode: delta][stage: volume check][step: Customer Attributes Step]: started
100% [============================] Remaining Time: 1 sec
[2017-05-25 14:22:11][WARNING]: Mismatch of entities in the document: customer_entity
[2017-05-25 14:22:11][WARNING]: Mismatch of entities in the document: customer_entity_varchar
[2017-05-25 14:22:11][WARNING]: Mismatch of entities in the document: customer_address_entity
[2017-05-25 14:22:11][WARNING]: Volume Check failed
[2017-05-25 14:22:11][INFO][mode: delta][stage: delta delivering][step: Map Step]: started
[2017-05-25 14:22:12][INFO][mode: delta][stage: volume check][step: Map Step]: started

100% [============================] Remaining Time: 1 sec
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: adminnotification_inbox
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_category_entity
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_category_entity_datetime
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_category_entity_decimal
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_category_entity_int
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_category_entity_text
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_category_entity_varchar
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_category_product
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_compare_item
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_entity
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_entity_datetime
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_entity_decimal
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_entity_int
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_entity_media_gallery
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_entity_media_gallery_value
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_entity_text
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_entity_varchar
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_link
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_link_attribute_decimal
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_link_attribute_int
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_relation
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: catalog_product_website
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: cataloginventory_stock_item
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: search_query
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: cms_block
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: cms_block_store
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: cms_page
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: cms_page_store
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: session
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: salesrule_coupon_aggregated
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: salesrule_coupon_aggregated_updated
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: eav_attribute_option
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: eav_attribute_option_value
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: newsletter_subscriber
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: oauth_nonce
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: product_alert_stock
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: report_compared_product_index
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: report_event
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: report_viewed_product_index
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_bestsellers_aggregated_daily
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_bestsellers_aggregated_monthly
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_bestsellers_aggregated_yearly
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_invoice
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_invoice_item
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order_address
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order_item
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order_payment
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order_status_history
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: quote
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: quote_address
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: quote_item
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: quote_item_option
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: quote_payment
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: quote_shipping_rate
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_shipment
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_shipment_comment
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_shipment_item
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_shipment_track
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_invoiced_aggregated
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_invoiced_aggregated_order
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order_aggregated_created
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order_aggregated_updated
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order_tax
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order_tax_item
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_payment_transaction
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_shipping_aggregated
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_shipping_aggregated_order
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: salesrule_coupon
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: salesrule_coupon_usage
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: salesrule_customer
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: salesrule_customer_group
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: salesrule_label
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: salesrule_product_attribute
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: salesrule_website
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: tax_order_aggregated_created
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: tax_order_aggregated_updated
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: wishlist
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: wishlist_item
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: wishlist_item_option
[2017-05-25 14:22:41][WARNING]: Volume Check failed
[2017-05-25 14:22:41][INFO][mode: delta][stage: delta delivering][step: Log Step]: started
[2017-05-25 14:22:41][INFO][mode: delta][stage: volume check][step: Log Step]: started

100% [============================] Remaining Time: 1 sec
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: customer_visitor
[2017-05-25 14:22:41][WARNING]: Volume Check failed
[2017-05-25 14:22:41][INFO][mode: delta][stage: delta delivering][step: OrderGrids Step]: started
[2017-05-25 14:22:41][INFO][mode: delta][stage: volume check][step: OrderGrids Step]: started

100% [============================] Remaining Time: 1 sec
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_order_grid
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_invoice_grid
[2017-05-25 14:22:41][WARNING]: Mismatch of entities in the document: sales_shipment_grid
[2017-05-25 14:22:41][WARNING]: Volume Check failed
[2017-05-25 14:22:41][INFO][mode: delta][stage: delta delivering][step: SalesIncrement Step]: started
[2017-05-25 14:22:41][INFO][mode: delta][stage: volume check][step: SalesIncrement Step]: started

100% [============================] Remaining Time: 1 sec
[2017-05-25 14:22:41][WARNING]: Mismatch in last increment id of order entity
[2017-05-25 14:22:41][WARNING]: Mismatch in last increment id of invoice entity
[2017-05-25 14:22:41][WARNING]: Mismatch in last increment id of shipment entity
[2017-05-25 14:22:41][WARNING]: Volume Check failed
[2017-05-25 14:22:41][INFO][mode: delta][stage: volume check][step: SalesIncrement Step]: Migration completed successfully
[2017-05-25 14:22:41][INFO][mode: delta][stage: volume check][step: SalesIncrement Step]: Automatic restart in 5 sec. Use CTRL-C to abort
[2017-05-25 14:22:46][INFO][mode: delta][stage: delta delivering][step: Customer Attributes Step]: started
[2017-05-25 14:22:46][INFO][mode: delta][stage: volume check][step: Customer Attributes Step]: started

100% [============================] Remaining Time: 1 sec
[2017-05-25 14:22:47][WARNING]: Mismatch of entities in the document: customer_entity
[2017-05-25 14:22:47][WARNING]: Mismatch of entities in the document: customer_entity_varchar
[2017-05-25 14:22:47][WARNING]: Mismatch of entities in the document: customer_address_entity
[2017-05-25 14:22:47][WARNING]: Volume Check failed
[2017-05-25 14:22:47][INFO][mode: delta][stage: delta delivering][step: Map Step]: started
[2017-05-25 14:22:47][INFO][mode: delta][stage: volume check][step: Map Step]: started

(sorry for the long output)

I didn't find any info on what 'Volume Check failed' exactly means, and what I notice is that the output seems a loop as it's outputting all the time the same warnings.
@croxarens croxarens mentioned this issue May 25, 2017
Closed
@victor-v-rad
Copy link
Collaborator

Hi @croxarens

'delta' mode continues in a loop until CTRL-C is pressed. The doc. Warnings you see e.g.

[2017-05-25 14:22:47][WARNING]: Mismatch of entities in the document: customer_entity

means number of records in M1 and M2 of customer_entity are not equal. Check this table in both DB for the differences. Maybe you added some customer to your M2 in order to test the store

@croxarens
Copy link
Author

Hi @victor-v-rad ,

I checked the M2 DB and the last record in each of the following tables

  • customer_entity
  • customer_entity_varchar
  • customer_address_entity

is in the M1 DB, just it's not the last one.

Table structures between M1 and M2 is different for those tables, but I don't think is a problem from the moment the settings and data migration was fine.

@croxarens
Copy link
Author

Is it correct that all the m2_cl_ tables are empty?

@victor-v-rad
Copy link
Collaborator

the tool empty these tables as soon as delta records are delivered to M2 store

@croxarens
Copy link
Author

Hey @victor-v-rad ,

I tried with a vanilla installation and still getting the same error when I run the delta migration.

[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_invoiced_aggregated

[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_invoiced_aggregated_order
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_order_aggregated_created
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_order_aggregated_updated
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_order_tax
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_order_tax_item
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_payment_transaction
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_shipping_aggregated
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_shipping_aggregated_order
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: salesrule_coupon
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: salesrule_coupon_usage
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: salesrule_customer
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: salesrule_customer_group
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: salesrule_label
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: salesrule_product_attribute
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: salesrule_website
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: tax_order_aggregated_created
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: tax_order_aggregated_updated
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: wishlist
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: wishlist_item
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: wishlist_item_option
[2017-05-30 11:12:57][WARNING]: Volume Check failed
[2017-05-30 11:12:57][INFO][mode: delta][stage: delta delivering][step: Log Step]: started
[2017-05-30 11:12:57][INFO][mode: delta][stage: volume check][step: Log Step]: started
100% [============================] Remaining Time: 1 sec
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: customer_visitor
[2017-05-30 11:12:57][WARNING]: Volume Check failed
[2017-05-30 11:12:57][INFO][mode: delta][stage: delta delivering][step: OrderGrids Step]: started
[2017-05-30 11:12:57][INFO][mode: delta][stage: volume check][step: OrderGrids Step]: started
100% [============================] Remaining Time: 1 sec
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_order_grid
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_invoice_grid
[2017-05-30 11:12:57][WARNING]: Mismatch of entities in the document: sales_shipment_grid
[2017-05-30 11:12:57][WARNING]: Volume Check failed
[2017-05-30 11:12:57][INFO][mode: delta][stage: delta delivering][step: SalesIncrement Step]: started
[2017-05-30 11:12:57][INFO][mode: delta][stage: volume check][step: SalesIncrement Step]: started
100% [============================] Remaining Time: 1 sec
[2017-05-30 11:12:57][WARNING]: Mismatch in last increment id of order entity
[2017-05-30 11:12:57][WARNING]: Mismatch in last increment id of invoice entity
[2017-05-30 11:12:57][WARNING]: Mismatch in last increment id of shipment entity
[2017-05-30 11:12:57][WARNING]: Volume Check failed
[2017-05-30 11:12:57][INFO][mode: delta][stage: volume check][step: SalesIncrement Step]: Migration completed successfully
[2017-05-30 11:12:57][INFO][mode: delta][stage: volume check][step: SalesIncrement Step]: Automatic restart in 5 sec. Use CTRL-C to abort

Am I doing something wrong?
M2 installation, setting migration, data migration, reindex database, clear cache and delta migration.

@rg-srini
Copy link

rg-srini commented Jun 8, 2017 •
edited

@croxarens - Did you get this issue sorted out? We also facing the same issue (#316).

@croxarens
Copy link
Author

croxarens commented Jun 8, 2017 •
edited

Hi @rg-srini ,

No, unfortunately we still working on it with no success..

I'll keep this issue updated in case we found a way..

@victor-v-rad
Copy link
Collaborator

victor-v-rad commented Jun 9, 2017 •
edited

@croxarens see the last comments in #316. Might help

@croxarens
Copy link
Author

@victor-v-rad thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@victor-v-rad @croxarens @rg-srini