Skip to content

Instantly share code, notes, and snippets.

View dreamer-89's full-sized avatar
🏠
Working from home

Suraj Singh dreamer-89

🏠
Working from home
  • AWS Amazon
  • Bothell, Washington
View GitHub Profile
@dreamer-89
dreamer-89 / gist:7cc83bac1ace8bbadb1277358495ef9b
Created January 19, 2023 02:15
Primary shard relocation with concurrent heavy writes
Step 0. Create 3 data node, 1 master, 1 seed cluster
```
[root@ip-10-0-5-107 ~]# curl localhost:9200/_cat/nodes?v
ip heap.percent ram.percent cpu load_1m load_5m load_15m node.role node.roles cluster_manager name
10.0.3.37 11 67 0 0.00 0.03 0.00 mmr cluster_manager,master,remote_cluster_client - ip-10-0-3-37.us-west-2.compute.internal
10.0.4.222 6 66 0 0.00 0.00 0.00 mmr cluster_manager,master,remote_cluster_client - ip-10-0-4-222.us-west-2.compute.internal
10.0.5.107 37 68 13 0.00 0.25 0.47 mmr cluster_manager,master,remote_cluster_client * seed
10.0.4.132 44 26 1 0.00 0.00 0.18 dir data,ingest,remote_cluster_client - ip-10-0-4-132.us-west-2.compute.internal
10.0.5.205 11 30 1 0.00 0.00 0.08 dir data,ingest,remote_clus
@dreamer-89
dreamer-89 / gist:eb033ddd218cb4c961aec6332c96a70c
Last active January 19, 2023 02:11
Primary relocation on single large shard with segrep enabled.
Step 0. Create 3 data node, 1 master, 1 seed cluster
```
[root@ip-10-0-5-107 ~]# curl localhost:9200/_cat/nodes?v
ip heap.percent ram.percent cpu load_1m load_5m load_15m node.role node.roles cluster_manager name
10.0.3.37 11 67 0 0.00 0.03 0.00 mmr cluster_manager,master,remote_cluster_client - ip-10-0-3-37.us-west-2.compute.internal
10.0.4.222 6 66 0 0.00 0.00 0.00 mmr cluster_manager,master,remote_cluster_client - ip-10-0-4-222.us-west-2.compute.internal
10.0.5.107 37 68 13 0.00 0.25 0.47 mmr cluster_manager,master,remote_cluster_client * seed
10.0.4.132 44 26 1 0.00 0.00 0.18 dir data,ingest,remote_cluster_client - ip-10-0-4-132.us-west-2.compute.internal
10.0.5.205 11 30 1 0.00 0.00 0.08 dir data,ingest,remote_clus
@dreamer-89
dreamer-89 / gist:d76eaf639171e8ab32fa7f8b9d6c93d3
Last active April 5, 2022 00:12
Changes related with type mappings removal in opensearch
Remove type from URL paths
Remove include_type_name from rest layer
Remove type from query DSL
Remove _type from responses of GET/mGET APIs
Remove _type from responses of _search
Remove _type param support on _search queries e.g. terms lookup and percolator queries
Remove types in response to search/query requests (SearchHit).
Remove type references from request objects such as explain request, shard query context etc
Removal and deprecation of type related methods in server classes referenced directly in differently plugin repos. e.g. IndicesClient
Default mapping removal