Home/ Questions/Steps to fix the error “the node was low on resource ephemeral storage”.
Next
Answered
Maya Brown
  • 18
Asked: 2022-05-18T20:11:22+00:00 In:

Steps to fix the error “the node was low on resource ephemeral storage”.

  • 18

. Advertisement .

..3..

. Advertisement .

..4..

Here is the program I run:

portal-59978bff4d-2qkgf 0/1 Evicted 0 14m
 release-mgmt-74995bc7dd-nzlgq 0/1 Evicted 0 8m20s
 service-orchestration-79f8dc7dc-kx6g4 0/1 Evicted 0 7m31s
 test-mgmt-7f977567d6-zl7cc 0/1 Evicted 0 8m17s

After I run, it returns an error:

The node was low on resource: ephemeral-storage

Does anyone have any suggestions for the problem below: the node was low on resource ephemeral storage in the programs – How to correct it?

the node was low on resource
Share

2 Answers

  1. Best Answer
    Expert

    The cause:

    You are having troubles with this error because Pods are using the emptyDir volumes with no storage quotas, so they are excluded. Another reason is that there are a lot of log messages which consume the storage.

    Solution:

    You can limit the number of logs stored by configuring the Docker logging driver as the following:

    {
"log-driver": "json-file",
"log-opts": {
"max-size": "100m",
"max-file": "5"
}
}

    To prevent containers from writing any amount of storage to their node filesystem, you also can install a quote like limits.ephemeral-storage, requests.ephemeral-storage.

    • 0

  2. If you use emptyDir volumes, without storage quotas, your storage will be full. 

    eviction manager: attempting to reclaim ephemeral-storage

    To limit storage, set a quota limits.ephemeral-storage, requests.ephemeral-storage. Otherwise any container can write any amount to its node folder.

    A sample resource quota definition 

    apiVersion: v1
kind: ResourceQuota
metadata:
 name: compute-resources
spec:
 hard:
 pods: "4" 
 requests.cpu: "1" 
 requests.memory: 1Gi 
 requests.ephemeral-storage: 2Gi 
 limits.cpu: "2" 
 limits.memory: 2Gi 
 limits.ephemeral-storage: 4Gi

    Log files can also be a reason for this problem. This question is worth a look.

    • 9

Leave an answer

You must login to add an answer.

Need An Account,