mapper [hits] cannot be changed from type [long] to [integer] #9888

Hronom · 2017-01-16T22:02:11Z

Please solve this issue, the full description is here https://discuss.elastic.co/t/discover-tab-wont-load-anymore/38549/25

This happens when you put dashboards and visualizations to .kibana index directly by using ES, not from Kibana UI.

Please let Kibana creates .kibana index from the scratch with correct mapping for fields hits and version, so it will looks like this:

{
  ".kibana": {
    "aliases": {},
    "mappings": {
      "server": {
        "properties": {
          "uuid": {
            "type": "keyword"
          }
        }
      },
      "dashboard": {
        "properties": {
          "description": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "hits": {
            "type": "integer"
          },
          "kibanaSavedObjectMeta": {
            "properties": {
              "searchSourceJSON": {
                "type": "text",
                "fields": {
                  "keyword": {
                    "type": "keyword",
                    "ignore_above": 256
                  }
                }
              }
            }
          },
          "optionsJSON": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "panelsJSON": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "timeFrom": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "timeRestore": {
            "type": "boolean"
          },
          "timeTo": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "title": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "uiStateJSON": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "version": {
            "type": "integer"
          }
        }
      },
      "search": {
        "properties": {
          "columns": {
            "type": "text"
          },
          "description": {
            "type": "text"
          },
          "hits": {
            "type": "integer"
          },
          "kibanaSavedObjectMeta": {
            "properties": {
              "searchSourceJSON": {
                "type": "text"
              }
            }
          },
          "sort": {
            "type": "text"
          },
          "title": {
            "type": "text"
          },
          "version": {
            "type": "integer"
          }
        }
      },
      "timelion-sheet": {
        "properties": {
          "description": {
            "type": "text"
          },
          "hits": {
            "type": "integer"
          },
          "kibanaSavedObjectMeta": {
            "properties": {
              "searchSourceJSON": {
                "type": "text"
              }
            }
          },
          "timelion_chart_height": {
            "type": "integer"
          },
          "timelion_columns": {
            "type": "integer"
          },
          "timelion_interval": {
            "type": "text"
          },
          "timelion_other_interval": {
            "type": "text"
          },
          "timelion_rows": {
            "type": "integer"
          },
          "timelion_sheet": {
            "type": "text"
          },
          "title": {
            "type": "text"
          },
          "version": {
            "type": "integer"
          }
        }
      },
      "config": {
        "properties": {
          "buildNum": {
            "type": "keyword"
          },
          "defaultIndex": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          }
        }
      },
      "index-pattern": {
        "properties": {
          "fieldFormatMap": {
            "type": "text"
          },
          "fields": {
            "type": "text"
          },
          "intervalName": {
            "type": "text"
          },
          "notExpandable": {
            "type": "boolean"
          },
          "sourceFilters": {
            "type": "text"
          },
          "timeFieldName": {
            "type": "text"
          },
          "title": {
            "type": "text"
          }
        }
      },
      "visualization": {
        "properties": {
          "description": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "kibanaSavedObjectMeta": {
            "properties": {
              "searchSourceJSON": {
                "type": "text",
                "fields": {
                  "keyword": {
                    "type": "keyword",
                    "ignore_above": 256
                  }
                }
              }
            }
          },
          "savedSearchId": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "title": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "uiStateJSON": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          },
          "version": {
            "type": "integer"
          },
          "visState": {
            "type": "text",
            "fields": {
              "keyword": {
                "type": "keyword",
                "ignore_above": 256
              }
            }
          }
        }
      }
    },
    "settings": {
      "index": {
        "creation_date": "1484597580045",
        "number_of_shards": "1",
        "number_of_replicas": "1",
        "uuid": "R5XXkVnsQsWZwQewrxsJvg",
        "version": {
          "created": "5010199"
        },
        "provided_name": ".kibana"
      }
    }
  }
}

This is very annoying bug, with this bug the Discover tab cannot be loaded.

Summary:
When Kibana starts and creates .kibana index in ES it didn't put mapping for this index, this is bad for all, who want to put dashboards and visualizations directly in ES, not from Kibana UI.
Because when ES sees new type of document without previously setted mapping it try to recognize type of field in this document and here the problem begins. ES recognize type of fields hits and version like long but Kibana needs integer type.

The text was updated successfully, but these errors were encountered:

mdunnio · 2017-02-27T20:57:24Z

+1

Are there any temporary solutions to this other than just deleting the .kibana index?

mdunnio · 2017-02-27T22:49:47Z

I ended up just doing this:

curl -XDELETE http://ip:port/.kibana

curl -XPUT http://ip:port/.kibana/_mapping/dashboard -d '{"dashboard":{"properties":{"title":{"type":"string"},"hits":{"type":"integer"},"description":{"type":"string"},
"panelsJSON":{"type":"string","optionsJSON":{"type":"string"},"uiStateJSON":{"type":"string"},"version":{"type":"integer"}
"timeRestore":{"type":"boolean"},"timeTo":{"type":"string"},"timeFrom":{"type":"string"},"kibanaSavedObjectMeta":{"properties":{"searchSourceJSON":{"type":"string"}}}}}
}'

aboutte · 2017-03-02T15:37:44Z

For anyone else who runs into this issue I followed the suggestions on this page. Before importing the dashboard I am deleting the hits and version keys for each dashboard element. I have not had any issues since adding that step into my automation.

jbudz · 2017-04-28T20:19:22Z

We are working on a fix scheduled for this in 5.6. It's usually caused by incorrect mappings. Kibana in versions < 5.5 pushes mappings as needed from the browser. If you are restoring a kibana index before these mappings have been created, dynamic mappings will be used and won't match what kibana expects causing errors like this.

If you're on 5.x and running into this, as a workaround, I would recommend creating an index template with the correct mappings and then reindexing. Make sure to do backups before, and the steps below are a rough approximation:

Create an index template

curl -XPUT "http://localhost:9200/_template/kibana" -H 'Content-Type: application/json' -d'
{
  "template": ".kibana-5*",
  "settings": {
    "number_of_shards": 1
  },
  "mappings": {
    "config": {
      "properties": {
        "buildNum": {
          "type": "keyword"
        }
      }
    },
    "index-pattern": {
      "properties": {
        "fieldFormatMap": {
          "type": "text"
        },
        "fields": {
          "type": "text"
        },
        "intervalName": {
          "type": "keyword"
        },
        "notExpandable": {
          "type": "boolean"
        },
        "sourceFilters": {
          "type": "text"
        },
        "timeFieldName": {
          "type": "keyword"
        },
        "title": {
          "type": "text"
        }
      }
    },
    "visualization": {
      "properties": {
        "description": {
          "type": "text"
        },
        "kibanaSavedObjectMeta": {
          "properties": {
            "searchSourceJSON": {
              "type": "text"
            }
          }
        },
        "savedSearchId": {
          "type": "keyword"
        },
        "title": {
          "type": "text"
        },
        "uiStateJSON": {
          "type": "text"
        },
        "version": {
          "type": "integer"
        },
        "visState": {
          "type": "text"
        }
      }
    },
    "search": {
      "properties": {
        "columns": {
          "type": "keyword"
        },
        "description": {
          "type": "text"
        },
        "hits": {
          "type": "integer"
        },
        "kibanaSavedObjectMeta": {
          "properties": {
            "searchSourceJSON": {
              "type": "text"
            }
          }
        },
        "sort": {
          "type": "keyword"
        },
        "title": {
          "type": "text"
        },
        "version": {
          "type": "integer"
        }
      }
    },
    "dashboard": {
      "properties": {
        "description": {
          "type": "text"
        },
        "hits": {
          "type": "integer"
        },
        "kibanaSavedObjectMeta": {
          "properties": {
            "searchSourceJSON": {
              "type": "text"
            }
          }
        },
        "optionsJSON": {
          "type": "text"
        },
        "panelsJSON": {
          "type": "text"
        },
        "refreshInterval": {
          "properties": {
            "display": {
              "type": "keyword"
            },
            "pause": {
              "type": "boolean"
            },
            "section": {
              "type": "integer"
            },
            "value": {
              "type": "integer"
            }
          }
        },
        "timeFrom": {
          "type": "keyword"
        },
        "timeRestore": {
          "type": "boolean"
        },
        "timeTo": {
          "type": "keyword"
        },
        "title": {
          "type": "text"
        },
        "uiStateJSON": {
          "type": "text"
        },
        "version": {
          "type": "integer"
        }
      }
    },
    "url": {
      "properties": {
        "accessCount": {
          "type": "long"
        },
        "accessDate": {
          "type": "date"
        },
        "createDate": {
          "type": "date"
        },
        "url": {
          "type": "text",
            "fields": {
            "keyword": {
              "type": "keyword",
                "ignore_above": 2048
            }
          }
        }
      }
    },
    "server": {
      "properties": {
        "uuid": {
          "type": "keyword"
        }
      }
    },
    "timelion-sheet": {
      "properties": {
        "description": {
          "type": "text"
        },
        "hits": {
          "type": "integer"
        },
        "kibanaSavedObjectMeta": {
          "properties": {
            "searchSourceJSON": {
              "type": "text"
            }
          }
        },
        "timelion_chart_height": {
          "type": "integer"
        },
        "timelion_columns": {
          "type": "integer"
        },
        "timelion_interval": {
          "type": "keyword"
        },
        "timelion_other_interval": {
          "type": "keyword"
        },
        "timelion_rows": {
          "type": "integer"
        },
        "timelion_sheet": {
          "type": "text"
        },
        "title": {
          "type": "text"
        },
        "version": {
          "type": "integer"
        }
      }
    }    
  }
}'

Reindex

curl -XPOST "http://localhost:9200/_reindex" -H 'Content-Type: application/json' -d'
{
  "source": {
    "index": ".kibana"
  },
  "dest": {
    "index": ".kibana-5.x"
  }
}'

In kibana.yml change kibana.index: .kibana-5.x

Hronom · 2017-04-28T20:21:43Z

@jbudz Finally, awesome thanks! Waiting version with fix

thekofimensah · 2017-06-08T19:28:16Z

The work around works great! Thanks for posting it :)

tylersmalley · 2017-11-10T17:34:44Z

This should not be an issue starting in 6.0 as we only have a single type and this issue is related to the same field name across document types have a different field type.

ericrdgz · 2018-01-22T17:24:14Z

This worked for me, thanks!

NilsGriebner · 2018-02-07T10:18:19Z

Works for me, too. Thanks.

tylersmalley · 2018-07-17T03:27:52Z

Closing as this should be a non-issue as of 6.0

Bargs added the :Management label Jan 18, 2017

Bargs mentioned this issue Mar 22, 2017

Kibana 5 getting console exception "cannot be changed from type [long] to [integer]" when clicking on Timelion Tab #10117

Closed

jbudz mentioned this issue Apr 3, 2017

Timelion Page Blank after update #10893

Closed

jbudz added Team:Operations Team label for Operations Team bug Fixes for quality problems that affect the customer experience and removed :Management labels Apr 3, 2017

mpellegrin mentioned this issue Oct 10, 2017

mapper [version] cannot be changed from type [long] to [int] #5648

Closed

cbonsig mentioned this issue Mar 2, 2018

Installing 4.0.2 on Debian Jessie francelabs/datafari#43

Closed

tylersmalley closed this as completed Jul 17, 2018

Phrozyn mentioned this issue Apr 5, 2019

hits and version cause issues in new docker deploys mozilla/MozDef#1208

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

mapper [hits] cannot be changed from type [long] to [integer] #9888

mapper [hits] cannot be changed from type [long] to [integer] #9888

Hronom commented Jan 16, 2017 •

edited

Loading

mdunnio commented Feb 27, 2017 •

edited

Loading

mdunnio commented Feb 27, 2017 •

edited

Loading

aboutte commented Mar 2, 2017

jbudz commented Apr 28, 2017 •

edited

Loading

Hronom commented Apr 28, 2017 •

edited

Loading

thekofimensah commented Jun 8, 2017

tylersmalley commented Nov 10, 2017

ericrdgz commented Jan 22, 2018

NilsGriebner commented Feb 7, 2018

tylersmalley commented Jul 17, 2018

mapper [hits] cannot be changed from type [long] to [integer] #9888

mapper [hits] cannot be changed from type [long] to [integer] #9888

Comments

Hronom commented Jan 16, 2017 • edited Loading

mdunnio commented Feb 27, 2017 • edited Loading

mdunnio commented Feb 27, 2017 • edited Loading

aboutte commented Mar 2, 2017

jbudz commented Apr 28, 2017 • edited Loading

Hronom commented Apr 28, 2017 • edited Loading

thekofimensah commented Jun 8, 2017

tylersmalley commented Nov 10, 2017

ericrdgz commented Jan 22, 2018

NilsGriebner commented Feb 7, 2018

tylersmalley commented Jul 17, 2018

Hronom commented Jan 16, 2017 •

edited

Loading

mdunnio commented Feb 27, 2017 •

edited

Loading

mdunnio commented Feb 27, 2017 •

edited

Loading

jbudz commented Apr 28, 2017 •

edited

Loading

Hronom commented Apr 28, 2017 •

edited

Loading