Docker Container memory shortage
Error Message:
RuntimeError: DataLoader worker (pid 4301) is killed by signal: Bus error. It is possible that dataloader's workers are out of shared memory. Please try to raise your shared memory limit.
ν΄κ²°μ± μΌλ‘λ
βipc νΉμ βshm-sizeλ₯Ό μ¬μ©ν΄μ docker run νλ©΄λλ€.
ipcμ λν΄μ μ κΉ κ²μν΄λ΄€λλ° μ κΉμΌλ‘λ λΆμ‘±ν κ² κ°μμ
μΌλ¨
- docker run βipc=host
- docker run βshm-size=64G
μ λμ ν΄κ²° μ± μ΄ μ μλμ΄ μμλ€.
docker run -d -v `pwd`:/proj -it --name dev_dpfash3 --gpus all -p 8891:8891 --restart=always mydocker --shm-size=8G
Reference
docker 컨ν μ΄λμμ pytorch μ€νμ λ©λͺ¨λ¦¬ μλ¬ ν΄κ²°: https://curioso365.tistory.com/136
[Trouble Shooting] λ컀 μ¬μ©μ λ¬Έμ λ°μ λ° ν΄κ²°: https://soyoung-new-challenge.tistory.com/70
kubernetes shared memory μ¬μ΄μ¦ μ‘°μ : https://ykarma1996.tistory.com/106
Leave a comment