Pods restarting without any change to OpenSearchCluster CR

[saketmht]

When I am applying the OpenSearch CLuster CR for the first time, the sts and the corresponding pods are created. But after the pods are all up, the pods then tend to restart even when I have made no changes to OpenSearchCluster CR.

It seems the sts revision is updated which is weird because there was no change to the CR. After comparing the newer and older revision, the difference seems to be this annotation in the sts/pods banzaicloud.com/last-applied.

I couldn't find the code where this annotation was being added to the sts. In any case, this unnecessary restart should be fixed as it causes the shard to re-allocate twice, the cluster health fluctuates etc.

[swoehrl-mw]

Hi @saketmht. Can you please provide more details on your setup? Because I have not made that observation so it probably is down to some kubernetes distribution or version difference.
Also please provide the CR you are using.

[devops-taehoon-kim]

@swoehrl-mw Hi. I`m also suffering this issue

https://forum.opensearch.org/t/opensearch-operator-two-scaling-issue-please-help-kubernetes-environment/26949

How can i do for this ?

[fuljo]

There is #1127 which removes that annotation and may fix the problem.
The proposal is being implemented in #1129 if you want to track progress.