Reindexing error after migrating sample data from M1 EE 1.14.0.1 to M2 EE 2.1.0

[alessandrozucca]

I have installed Magento 1 with the sample data to check how this migration tool works.

After the migration of the settings and data between the enterprise version of M1 1.14.0.1 and M2 2.10 I get an sql error when re-indexing 'Product/Target Rule' and 'Target Rule/Product'

Sql error: Unknown column 'at_sku.value' in 'where clause', query was: SELECT e.entity_id FROM catalog_product_entity AS e LEFT JOIN catalog_product_entity_decimal AS at_price ON (at_price.row_id = e.row_id) AND (at_price.attribute_id = '75') AND (at_price.store_id = 0) WHERE (((IFNULL(at_price.value, 0) >= 10) AND(IFNULL(at_sku.value, 0) <= '500') )) AND (e.created_in <= 1) AND (e.updated_in > 1)

What I've executed in order:

$ bin/magento migrate:settings /vagrant/vendor/magento/data-migration-tool/etc/ee-to-ee/1.14.0.1/config.xml
[2016-09-09 13:23:13][INFO][mode: settings][stage: integrity check][step: Settings Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:23:13][INFO][mode: settings][stage: integrity check][step: Stores Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:23:13][INFO][mode: settings][stage: data migration][step: Settings Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:23:17][INFO][mode: settings][stage: data migration][step: Stores Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:23:17][INFO][mode: settings][stage: volume check][step: Stores Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:23:17][INFO][mode: settings][stage: volume check][step: Stores Step]: Migration completed

$ bin/magento migrate:data /vagrant/vendor/magento/data-migration-tool/etc/ee-to-ee/1.14.0.1/config.xml
[2016-09-09 13:27:56][INFO][mode: data][stage: integrity check][step: EAV Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:27:57][INFO][mode: data][stage: integrity check][step: Custom Customer Attributes Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:27:57][INFO][mode: data][stage: integrity check][step: Customer Attributes Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:27:57][INFO][mode: data][stage: integrity check][step: Map Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:17][INFO][mode: data][stage: integrity check][step: Url Rewrite Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:18][INFO][mode: data][stage: integrity check][step: Log Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:18][INFO][mode: data][stage: integrity check][step: Ratings Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:18][INFO][mode: data][stage: integrity check][step: SalesOrder Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:19][INFO][mode: data][stage: integrity check][step: ConfigurablePrices step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:19][INFO][mode: data][stage: integrity check][step: OrderGrids Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:19][INFO][mode: data][stage: integrity check][step: Tier Price Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:19][INFO][mode: data][stage: integrity check][step: SalesIncrement Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:19][INFO][mode: data][stage: integrity check][step: PostProcessing Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:19][INFO][mode: data][stage: setup triggers][step: Stage]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:25][INFO][mode: data][stage: data migration][step: EAV Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:27][INFO][mode: data][stage: volume check][step: EAV Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:27][INFO][mode: data][stage: data migration][step: Custom Customer Attributes Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:28][INFO][mode: data][stage: volume check][step: Custom Customer Attributes Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:28][INFO][mode: data][stage: data migration][step: Customer Attributes Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:29][INFO][mode: data][stage: volume check][step: Customer Attributes Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:28:29][INFO][mode: data][stage: data migration][step: Map Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:07][INFO][mode: data][stage: volume check][step: Map Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:11][INFO][mode: data][stage: data migration][step: Url Rewrite Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:17][INFO][mode: data][stage: volume check][step: Url Rewrite Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:17][INFO][mode: data][stage: data migration][step: Log Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:17][INFO][mode: data][stage: volume check][step: Log Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:17][INFO][mode: data][stage: data migration][step: Ratings Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:17][INFO][mode: data][stage: volume check][step: Ratings Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:17][INFO][mode: data][stage: data migration][step: SalesOrder Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:18][INFO][mode: data][stage: volume check][step: SalesOrder Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:18][INFO][mode: data][stage: data migration][step: ConfigurablePrices step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:18][INFO][mode: data][stage: volume check][step: ConfigurablePrices step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:18][INFO][mode: data][stage: data migration][step: OrderGrids Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:20][INFO][mode: data][stage: volume check][step: OrderGrids Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:20][INFO][mode: data][stage: data migration][step: Tier Price Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:20][INFO][mode: data][stage: volume check][step: Tier Price Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:20][INFO][mode: data][stage: data migration][step: SalesIncrement Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:21][INFO][mode: data][stage: volume check][step: SalesIncrement Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:21][INFO][mode: data][stage: data migration][step: PostProcessing Step]: started
100% [============================] Remaining Time: 1 sec
[2016-09-09 13:29:21][INFO][mode: data][stage: data migration][step: PostProcessing Step]: Migration completed

$ bin/magento c:c
$ bin/magento c:f
$ bin/magento indexer:reindex
Design Config Grid index has been rebuilt successfully in 00:00:05
Customer Grid index has been rebuilt successfully in 00:00:01
Category Products index has been rebuilt successfully in 00:00:01
Product Categories index has been rebuilt successfully in 00:00:00
Product Price index has been rebuilt successfully in 00:00:02
Product EAV index has been rebuilt successfully in 00:00:02
Stock index has been rebuilt successfully in 00:00:00
Catalog Rule Product index has been rebuilt successfully in 00:00:08
Catalog Product Rule index has been rebuilt successfully in 00:00:00
Catalog Search index has been rebuilt successfully in 00:00:26
SQLSTATE[42S22]: Column not found: 1054 Unknown column 'at_sku.value' in 'where clause', query was: SELECT e.entity_id FROM catalog_product_entity AS e
LEFT JOIN catalog_product_entity_decimal AS at_price ON (at_price.row_id = e.row_id) AND (at_price.attribute_id = '75') AND (at_price.store_id = 0) WHERE (((IFNULL(at_price.value, 0) >= 10) AND(IFNULL(at_sku.value, 0) <= '500') )) AND (e.created_in <= 1) AND (e.updated_in > 1)
SQLSTATE[42S22]: Column not found: 1054 Unknown column 'at_sku.value' in 'where clause', query was: SELECT e.entity_id FROM catalog_product_entity AS e
LEFT JOIN catalog_product_entity_decimal AS at_price ON (at_price.row_id = e.row_id) AND (at_price.attribute_id = '75') AND (at_price.store_id = 0) WHERE (((IFNULL(at_price.value, 0) >= 10) AND(IFNULL(at_sku.value, 0) <= '500') )) AND (e.created_in <= 1) AND (e.updated_in > 1)
Sales Rule index has been rebuilt successfully in 00:00:00
Catalog Category Permissions index has been rebuilt successfully in 00:00:00
Catalog Product Permissions index has been rebuilt successfully in 00:00:00

[alessandrozucca]

The exception occurs when

magento/module-target-rule/Model/Indexer/TargetRule/AbstractAction.php:111 _reindexAll()

processes the magento_targetrule entry 13 All Categories (Cross-selling)

and when \Magento\Rule\Model\Condition\Sql\Builder::getMappedSqlCondition calls \Magento\Rule\Model\Condition\Product\AbstractProduct::getMappedSqlField it ends up with calling getEavAttributeTableAlias() which returns at_sku which is not set in the select as table alias

[alessandrozucca]

at_sku doesn't get added to the JOIN in the SELECT statement as there is a condition in the magento/module-eav/Model/Entity/Collection/AbstractCollection.php that prevents _addAttributeJoin to be called

public function addAttributeToSelect($attribute, $joinType = false)
{
[...]
if ($joinType !== false && !$this->getEntity()->getAttribute($attribute)->isStatic()) {
$this->_addAttributeJoin($attribute, $joinType);
} elseif ('*' === $attribute) {
[...]
return $this;
}

so at_sku table alias is not added to the select as a join but then is expected in the where condition..

[victor-v-rad]

@alessandrozucca
I assume that format of data serialization in Magento1 enterprise_targetrule.conditions_serialized differ from Magento 2 magento_targetrule.conditions_serialized
I will investigate this case

[victor-v-rad]

Thank you for reporting this issue.
I have manage to reproduce it with SKU setup in Target Rule. Internal ticket MAGETWO-58854 to fix it

[victor-v-rad]

It is Magento 2 issue and not of the tool. As far I am aware it is fixed in MAGETWO-56676 and already in public (develop branch of EE)