'Remaining Time: 5 days' then 'MySQL server has gone away' during migration from Magento 1.7.0.2 via Docker

[andyt]

I can successfully migrate settings from my Magento 1.7.0.2 database, having gone through the process of tweaking the appropriate mappings file.

When running the data migration, all the integrity checks pass. However, when the tool reaches [stage: data migration][step: Customer Attributes step], the output announces "Remaining Time: 5 days" and does not progress past 0%.

The source database is on the same DB server as the target. However, I'm using a docker setup as per http://mageinferno.com/blog/magento-2-development-docker-os-x which may be causing issues.

I'm running the data migration tool in a bash terminal started using docker exec.

It seems as if the docker setup might have something to do with this problem, although I haven't come across any issues during normal Magento 2 operation, or the settings step of the migration, which completes very quickly.

EDIT: During this apparently static phase of the migration tool operation, there are no MySQL processes shown by SHOW PROCESSLIST.

[yaronish]

Please show migration process output in debug mode:
php bin/magento migrate:data -vvv your_config.xml

[andyt]

Thanks for the response. Here's the output with debugging on:

[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: EAV Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: Customer Attributes Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: Map Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: Url Rewrite Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: Log Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: Ratings Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: ConfigurablePrices step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: OrderGrids Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: Tier Price Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: integrity check][step: SalesIncrement Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: setup triggers][step: Stage]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: data migration][step: EAV Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: volume check][step: EAV Step]: started
[2015-12-09 09:24:10][INFO][mode: data][stage: data migration][step: Customer Attributes Step]: started
[2015-12-09 09:24:10][DEBUG][mode: data][stage: data migration][step: Customer Attributes Step][table: customer_entity]: migrating
100% [============================] Remaining Time: 1 sec

The migration hangs after that final line of output.

[yaronish]

hard to say, need additional data...
how many records customer_entity table has?

[Vincenkt]

@yaronish,

I have same problem. I checked customer_entity table and It has 45157 records.

[andyt]

I have 17105 rows in the customer_entity table.

[Vincenkt]

Hi
I noticed that the order of columns for table core_url_rewrite was different from the one described in the file vendors/magento/data-migration-tool/src/Migration/Step/UrlRewrite/Version191to2000.php at line 76 :
/**

• Expected table structure
• @var array
  */
  protected $structure = [
  MapInterface::TYPE_SOURCE => [
  'core_url_rewrite' => [
  'url_rewrite_id' ,
  'store_id',
  'id_path',
  'request_path',
  'target_path',
  'is_system',
  'options',
  'description',
  'category_id',
  'product_id',
  ],
  ],
  MapInterface::TYPE_DEST => [
  'url_rewrite' => [
  'url_rewrite_id',
  'entity_type',
  'entity_id',
  'request_path',
  'target_path',
  'redirect_type',
  'store_id',
  'description',
  'is_autogenerated',
  'metadata'
  ],
  ]
  ];
  Do your columns in core_url_rewrite are ordered exactly like the following ?

url_rewrite_id, store_id, id_path, request_path, target_path, is_system, options, description, category_id, product_id
If not try changing the order and it should work.

[JoJuhasz]

Hello, i also had this problem with customer step that was blocking at 0% (32K records).
The problem was solved by explicitly setting a bulk_size in config.xml (i set it to 500 and it works well)

[hws47a]

@JoJuhasz thank you, solved the same problem for me. About 90k customers

[andyt]

@JoJuhasz Thanks - this fixed things for me too. Much appreciated. 30k records.

[ilol]

@JoJuhasz thanks!
@andyt can you please close the issue?