Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
4a87a77
commit 8432221
Showing
13 changed files
with
208 additions
and
76 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,4 @@ | ||
| This file contains the full license text of the included third party | ||
| libraries. For an overview of the licenses see the NOTICE.txt file. | ||
|
|
||
|
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,26 @@ | ||
| Neo4j | ||
| Copyright © 2002-2016 Network Engine for Objects in Lund AB (referred to | ||
| in this notice as "Neo Technology") | ||
| [http://neotechnology.com] | ||
|
|
||
| This product includes software ("Software") developed by Neo Technology. | ||
|
|
||
| The software ("Software") is developed and owned by Network Engine | ||
| for Objects in Lund AB (referred to in this notice as "Neo Technology"). | ||
| If you have executed an End User Software License and Services Agreement, | ||
| an OEM Software License and Support Services Agreement, or another | ||
| commercial license agreement (including an Evaluation Agreement) with | ||
| Neo Technology or one of its affiliates (each, a "Commercial Agreement"), | ||
| you may use the Software solely pursuant to the terms of the relevant | ||
| Commercial Agreement. | ||
|
|
||
| If you have not executed a Commercial Agreement with Neo Technology, the | ||
| Software is subject to the terms of the GNU AFFERO GENERAL PUBLIC LICENSE | ||
| Version 3 (http://www.fsf.org/licensing/licenses/agpl-3.0.html), included | ||
| in the LICENSE.txt file. | ||
|
|
||
| Full license texts are found in LICENSES.txt. | ||
|
|
||
| Third-party licenses | ||
| -------------------- | ||
|
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,68 @@ | ||
| <?xml version="1.0" encoding="UTF-8"?> | ||
| <project xmlns="http://maven.apache.org/POM/4.0.0" | ||
| xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" | ||
| xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd"> | ||
| <parent> | ||
| <artifactId>parent</artifactId> | ||
| <groupId>org.neo4j</groupId> | ||
| <version>3.0.7-SNAPSHOT</version> | ||
| <relativePath>../..</relativePath> | ||
| </parent> | ||
| <modelVersion>4.0.0</modelVersion> | ||
|
|
||
| <groupId>org.neo4j.doc</groupId> | ||
| <artifactId>neo4j-lucene-index-docs</artifactId> | ||
| <version>3.0.7-SNAPSHOT</version> | ||
|
|
||
| <name>Neo4j - Lucene Index Docs</name> | ||
| <description>Documentation build for Neo4j Lucene index integration.</description> | ||
|
|
||
|
|
||
| <dependencies> | ||
| <dependency> | ||
| <groupId>junit</groupId> | ||
| <artifactId>junit</artifactId> | ||
| <scope>test</scope> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.neo4j</groupId> | ||
| <artifactId>neo4j-lucene-index</artifactId> | ||
| <version>${project.version}</version> | ||
| <scope>test</scope> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.neo4j</groupId> | ||
| <artifactId>neo4j-lucene-index</artifactId> | ||
| <version>${project.version}</version> | ||
| <scope>test</scope> | ||
| <type>test-jar</type> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.neo4j</groupId> | ||
| <artifactId>neo4j-kernel</artifactId> | ||
| <version>${project.version}</version> | ||
| <scope>test</scope> | ||
| <type>test-jar</type> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.neo4j</groupId> | ||
| <artifactId>neo4j-io</artifactId> | ||
| <version>${project.version}</version> | ||
| <scope>test</scope> | ||
| <type>test-jar</type> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.neo4j</groupId> | ||
| <artifactId>neo4j-graphviz</artifactId> | ||
| <version>${project.version}</version> | ||
| <scope>test</scope> | ||
| </dependency> | ||
| <dependency> | ||
| <groupId>org.neo4j.doc</groupId> | ||
| <artifactId>neo4j-doc-tools</artifactId> | ||
| <version>${project.version}</version> | ||
| <scope>test</scope> | ||
| <type>test-jar</type> | ||
| </dependency> | ||
| </dependencies> | ||
| </project> |
21 changes: 11 additions & 10 deletions
21
...ex/src/docs/dev/batchinsertindex.asciidoc → ...ne/src/docs/dev/batchinsertindex.asciidoc
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,32 +1,33 @@ | ||
| [[indexing-batchinsert]] | ||
| Index Batch Insertion | ||
| ===================== | ||
| = Index Batch Insertion | ||
|
|
||
| For general notes on batch insertion, see <<batchinsert>>. | ||
|
|
||
| Indexing during batch insertion is done using link:javadocs/org/neo4j/unsafe/batchinsert/BatchInserterIndex.html[BatchInserterIndex] which are provided via link:javadocs/org/neo4j/unsafe/batchinsert/BatchInserterIndexProvider.html[BatchInserterIndexProvider]. | ||
| An example: | ||
|
|
||
| [snippet,java] | ||
| [snippet, java] | ||
| ---- | ||
| component=neo4j-lucene-index | ||
| component=neo4j-lucene-index-docs | ||
| source=examples/ImdbDocTest.java | ||
| tag=batchInsert | ||
| ---- | ||
|
|
||
| The configuration parameters are the same as mentioned in <<indexing-create-advanced>>. | ||
|
|
||
| [[indexing-batchinsert-best-practices]] | ||
| == Best practices == | ||
| == Best practices | ||
|
|
||
| Here are some pointers to get the most performance out of +BatchInserterIndex+: | ||
| Here are some pointers to get the most performance out of `BatchInserterIndex`: | ||
|
|
||
| * Try to avoid link:javadocs/org/neo4j/unsafe/batchinsert/BatchInserterIndex.html#flush%28%29[flushing] too often because each flush will result in all additions (since last flush) to be visible to the querying methods, and publishing those changes can be a performance penalty. | ||
| * Have (as big as possible) phases where one phase is either only writes or only reads, and don't forget to flush after a write phase so that those changes becomes visible to the querying methods. | ||
| * Enable link:javadocs/org/neo4j/unsafe/batchinsert/BatchInserterIndex.html#setCacheCapacity%28java.lang.String,%20int%29[caching] for keys you know you're going to do lookups for later on to increase performance significantly (though insertion performance may degrade slightly). | ||
| * Enable link:javadocs/org/neo4j/unsafe/batchinsert/BatchInserterIndex.html#setCacheCapacity%28java.lang.String,%20int%29[caching] for keys that you will later do lookups. | ||
| This can significantly increase performance (though insertion performance may degrade slightly). | ||
|
|
||
| [NOTE] | ||
| Changes to the index are available for reading first after they are flushed to disk. | ||
| Thus, for optimal performance, read and lookup operations should be kept to a minimum during batchinsertion since they | ||
| involve IO and impact speed negatively. | ||
| -- | ||
| Changes to the index are available for reading first after they are flushed to disk. | ||
| Thus, for optimal performance, read and lookup operations should be kept to a minimum during batch insertion since they involve IO and impact speed negatively. | ||
| -- | ||
|
|
File renamed without changes
Oops, something went wrong.