DevCourse2_NN_Basics

NN basics - RNN

5 minute read

Sequential Data ํ‘œํ˜„ ๋ฒกํ„ฐ์˜ ๋ฒกํ„ฐ \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). ์‚ฌ์ „ ...

NN basics - DL Optimization

9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) โ€œThe function we want to minimize or maximize is called the objective function, ...

NN basics - DL Basics

2 minute read

Computer Visionโ€™s Difficulties ๊ด€์ ์˜ ๋ณ€ํ™”๋กœ ์ธํ•ด ๊ฐ™์€ ๋Œ€์ƒ์ด๋ผ๋„ ํ”ฝ์…€๊ฐ’์ด ๋‹ค๋ฆ„. ๋ฐฐ๊ฒฝ๊ณผ ํ”ผ์‚ฌ์ฒด์˜ ๊ตฌ๋ถ„์ด ์–ด๋ ค์›€. ์กฐ๋ช…์— ๋”ฐ๋ฅธ ๋ณ€ํ™” ๋Œ€์ƒ์˜ ๊ธฐํ˜•์  ํ˜•ํƒœ ๊ฐ€๋ ค์ง„ ํ˜•ํƒœ ๊ฐ™์€ ํด๋ž˜์Šค์•ˆ์—์„œ์˜ ๋ณ€ํ™”๊ฐ€ ํผ

NN basics - MLP

5 minute read

ํผ์…‰ํŠธ๋ก  ํผ์…‰ํŠธ๋ก ์˜ ๋™์ž‘ ๋‚ด์ ์— ์˜ํ•œ ์„ ํ˜•๊ณผ ํ™œ์„ฑํ•จ์ˆ˜์— ์˜ํ•œ ๋น„์„ ํ˜•์— ์˜ํ•ด ์˜๋ฏธ๋ฅผ ๊ตฌ๋ถ„. ๊ฒฐ๊ตญ์—” ๊ณต๊ฐ„์˜ ๋ถ„ํ• ์„ ๋งŒ๋“ ๋‹ค. ์„ ํ˜•๋Œ€์ˆ˜์—์„œ w๋ผ๋Š” ๊ฐ€์ค‘์น˜์— input์„ ๋‚ด์ ํ•˜๊ณ  w์— projectionํ–ˆ์„๋•Œ, ๊ทธ ๊ฐ’์ด 0์ด๋ฉด ์ง๊ตํ•˜๋Š” ๊ฒƒ์ด๊ณ , 0์„ ๊ธฐ์ค€์œผ๋กœ ๋น„์„ ํ˜•์  ์š”์†Œ๋กœ +1, -1๋กœ ...