Indexing the whole db #177
Comments
|
You need to create a river for each collection. On Thursday, November 21, 2013, Saul Laniado wrote:
|
|
thank's |
|
Let me know if you think your use case can justify to implement a new feature. |
|
in my case i have a large number of collections, every time i add new type of document i create a new collection. To resolve this i will need to have a list of the rivers that i already have in ES and every time that i make a new insert in mongo i will need to check if there is the need to create a new river for this collection. |
|
I have just release I am planning to update the wiki by end of this week. |
|
Great, thank’s a lot! Saul El 05/12/2013, a las 08:56, Richard Louapre notifications@github.com escribió:
|
|
Hi, I would like to use include_all_collection but I've got this log : [2013-12-17 18:33:21,880][INFO ][org.elasticsearch.river.mongodb.Slurper] Skip initial import from collection mongodb177 My config is : curl -XPUT "http://localhost:9200/_river/mongodb177/_meta" -d @all_collection.json MongoDB : 2.4.8 curl -XGET localhost:9200/idx/articles/_count Or there are 3 documents in the database. Can you help me ? Thanks Herve |
|
@hepr [1] - https://github.com/richardwilly98/elasticsearch-river-mongodb/wiki#troubleshooting |
|
Hi, I've done all. [2013-12-17 19:30:45,673][INFO ][node ] [Richards, Susan] version[0.90.7], pid[12378], build[36897d0/2013-11-13T12:06:54Z] |
|
@hepr If oplog.rs is not too big can you please dump it here? |
|
My oplog.rs is too big. /* 0 */ /* 1 */ |
|
@hepr |
|
I insert data : /* 0 */ /* 1 */ Log ES [2013-12-17 19:30:45,673][INFO ][node ] [Richards, Susan] version[0.90.7], pid[12378], build[36897d0/2013-11-13T12:06:54Z] |
|
What do you get from these commands: |
|
GET /mean-dev/_count : 2 |
|
That's because Can you do a bulk update of the existing documents? I will see if I can change the logic for the next release. |
|
Ok I understand. If I do a backup of my db, I delete it and restore it. Is it import all change in oplog.rs ? |
|
Yes that should work. |
- Initial import with import_all_collection will list of the collection of available in the database and import data directly from the collection.
|
I drop a database and restore it. oplog.rs add some documents. I start elasticsearch index and this is the log with START_FAILED [2013-12-19 14:36:05,028][INFO ][node ] [American Ace] initialized |
|
@hepr This exception is a known issue (will be fixed in the next release): It looks like database or collection name contains [1] - http://docs.mongodb.org/manual/reference/limits/#naming-restrictions |
|
I search in all database and there is no "." in database name and no "." in collection name. |
|
Ok could you please provide a simple example to reproduce the issue? Sent via BlackBerry by AT&T -----Original Message----- I search in all database and there is no "." in database name and no "." in collection name. Reply to this email directly or view it on GitHub: |
|
I'm using moogose This is a simple example of map / reduce that will be stocked in a new collection (collection name view_listMenu) My model : var moduleSchema = new mongoose.Schema({ var ModuleModel = mongoose.model('module', moduleSchema, 'DolibarrModules'); var map_reduce = {}; |
|
i want to index all collection in one db and I make river config like that then I found that the log the results: but actually there is no documents index into es，could you please tell me that Is there something wrong ? by the way mongo version: 2.6.3 elasticsearch version :1.2.2 river version: 2.0.1 |
i want to index all the db, is there a way to do that or i need to create a river for each collection
The text was updated successfully, but these errors were encountered: