Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Memory Store / FS Memory: Create a node level memory store cache and allocator #235

Closed
kimchy opened this issue Jun 26, 2010 · 1 comment

Comments

@kimchy
Copy link
Member

kimchy commented Jun 26, 2010

Currently, memory store is configured per shard, meaning that caching, for example, is done on a per shard level and configured on a per shard level. It means that configuring a cache of 20mb is done on a per shard level, and is not scalable since the number of shards allocated to a node can vary.

There should be a global memory allocator and cache, that serves all different shards, and the configuration should be set on it. Here are the settings to set on it (note, these are node level settings):

  • cache.memory.buffer_size: The buffer size, defaults to 100k.
  • cache.memory.cache_size: The size of cached buffers, defaults to 20mb.
  • cache.memory.direct: Should direct buffers be used (native memory) or not (heap). Defaults to true.
  • cache.memory.warm_cache: Should the cache be warmed or not.

Note, all differnet memory level settings that were done on store level are no longer applicable and replaced by the mentioned node level settings above.

@kimchy
Copy link
Member Author

kimchy commented Jun 26, 2010

Memory Store / FS Memory: Create a node level memory store cache and allocator, closed by 33d357d.

mindw pushed a commit to mindw/elasticsearch that referenced this issue Sep 5, 2022
Merged in dev/can/fix-ami-retrieval-2021-09-15 (pull request elastic#234)

Fix ami retrieval for merger and recorder

Also update use1a stack to 1.10.23

Approved-by: Gideon Avida
mindw pushed a commit to mindw/elasticsearch that referenced this issue Sep 5, 2022
whiteboard nginx

* Merged in nginx security headers for web apps (pull request elastic#229)

* Fix MPC-2824: disallowed loading student and admin portal in iframe
* Add headers to nginx webapp and fabfile
  * X-Frame-Options: deny clickjack prevention telling browser not to load our site in iframe
  * X-Content-Type-Options: nosniff prevent browser from interpreting content type
  * X-Permitted-Cross-Domain-Policies: none prevent cross-domain loading in adobe products
  * Referrer-Policy: no-referrer prevent browser from including referrer header
  * Permissions-Policy: -list- permission list for the site (previously Feature-Policy)
  * Strict-Transport-Security: -list- prevent browser from protocol downgrade and cookie hijacking
* Remove nginx version from server header

Approved-by: Matan Yemini
Approved-by: Can Yildiz
Approved-by: Gideon Avida
Approved-by: Andre Sodermans
* 1.11.0-915-dev

* Merged in dev/ttang2/dequeue_MPC-2823_21.09.08 (pull request elastic#228)

set max_group_prepared_capacity  to min_size

* set max_group_prepared_capacity  to min_size

* add comments

* set warm pool max size and not set desired number

* Merged master into dev/ttang2/dequeue_MPC-2823_21.09.08
* Merged master into dev/ttang2/dequeue_MPC-2823_21.09.08
* Merged master into dev/ttang2/dequeue_MPC-2823_21.09.08
* remove extra for wram pool max size

* Merge branch 'dev/ttang2/dequeue_MPC-2823_21.09.08' of bitbucket.org:engageli/devops into dev/ttang2/dequeue_MPC-2823_21.09.08

* Merged master into dev/ttang2/dequeue_MPC-2823_21.09.08
* Merge branch 'dev/ttang2/dequeue_MPC-2823_21.09.08' of bitbucket.org:engageli/devops into dev/ttang2/dequeue_MPC-2823_21.09.08


Approved-by: Gideon Avida
* Merged in dev/can/fix-ami-retrieval-master (pull request elastic#235)

Merged in dev/can/fix-ami-retrieval-2021-09-15 (pull request elastic#234)

Fix ami retrieval for merger and recorder

Also update use1a stack to 1.10.23

Approved-by: Gideon Avida
* Merged in dev/can/MPC-2843-include-u-rooms-2021-09-09 (pull request elastic#236)

MPC-2843: Include u rooms in attendance report

With the caveat of missing tenant names for now
* Merged in dev/can/attendance-improvements-2021-09-16 (pull request elastic#237)

Add date to report name
* Merged in dev/can/coventry-stacks-ansible-2021-09-14 (pull request elastic#238)

Add coventry stacks to ansible hosts
* 1.11.1-917-dev

* Small change to optionally print user aliases from google directory

* whiteboard nginx


Approved-by: Gideon Avida
cbuescher pushed a commit to cbuescher/elasticsearch that referenced this issue Oct 2, 2023
emilykmarx pushed a commit to emilykmarx/elasticsearch that referenced this issue Dec 26, 2023
emilykmarx pushed a commit to emilykmarx/elasticsearch that referenced this issue Dec 26, 2023
…script : inline, indexed and file - script_lang : script language like groovy, javascript, ...

Add test for inlined script

Fixes elastic#235
emilykmarx pushed a commit to emilykmarx/elasticsearch that referenced this issue Dec 26, 2023
emilykmarx pushed a commit to emilykmarx/elasticsearch that referenced this issue Dec 26, 2023
emilykmarx pushed a commit to emilykmarx/elasticsearch that referenced this issue Dec 26, 2023
emilykmarx pushed a commit to emilykmarx/elasticsearch that referenced this issue Dec 26, 2023
…thin bulk and let elasticsearch return status (400 => no retry) - add check for configuration file error (document_id absent or empty) and raise error. Adapt test case for it.

Fixes elastic#235
emilykmarx pushed a commit to emilykmarx/elasticsearch that referenced this issue Dec 26, 2023
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant