Multiprocessing and Fork
multiprocessing in Windows
not working sinc
system fork νλ‘μΈμ€μ μ¬λ³Έμ λ§λλκ² fork λΌκ³ νλ€. μμμ λ§λ€κΈ° μν΄ fork νλ κ²μ΄λ€.
linuxλ κ°λ₯νλ€. νμ§λ§ μλμ°μμλ λΆκ°λ₯νλ€.
μ΄μ κ°μ μ΄μ λ‘ μλμ°μμλ dataloader argument num_workers = 0
λ§ μ¬μ©κ°λ₯νλ€.
fork is insecure νλ€.
https://www.microsoft.com/en-us/research/uploads/prod/2019/04/fork-hotos19.pdf
multiprocessing not working in Windows: https://purplechip.tistory.com/36 https://medium.com/@grvsinghal/speed-up-your-python-code-using-multiprocessing-on-windows-and-jupyter-or-ipython-2714b49d6fac
https://www.pythonforthelab.com/blog/differences-between-multiprocessing-windows-and-linux/
Leave a comment