Posts by Category

DevCourse2

Git Stash

less than 1 minute read

git stash

Git Credential

less than 1 minute read

git credential๋กœ ์•”ํ˜ธํ‚ค ๋งค๋ฒˆ ์ž…๋ ฅ์•ˆํ•ด๋„ ์ˆจ๊ธด์ƒํƒœ์—์„œ git clone ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•  ์ˆ˜ ์žˆ๋‹ค.

K-Fashion preprocessing

less than 1 minute read

K-Fashion Dataset Preprocessing To-do list json: coco format์œผ๋กœ json ๋งŒ๋“ค์–ด ์ค˜์•ผ ํ•จ mv: data root ์žฌ์„ค์ • rename: ํŒŒ์ผ์ด๋ฆ„์— ๊ณต๋ฐฑ๊ณผ ๊ด„ํ˜ธ ๋“ฑ์ด ์กด์žฌ

Faster RCNN

less than 1 minute read

Appendix Reference https://medium.datadriveninvestor.com/review-on-fast-rcnn-202c9eadd23b 2021 Lecture 15 Detection and Segmentation http://cs231n.stanfor...

NLP - Transformer and BERT

10 minute read

ML ๋ชจ๋ธ ์ดํ•ด๋ฅผ ์œ„ํ•œ ํŒ ๋ณต์žกํ•œ ML ๋ชจ๋ธ์„ ์ดํ•ดํ•˜๊ธฐ ์œ„ํ•ด์„œ ๋‹ค์Œ๊ณผ ๊ฐ™์€ ์ˆœ์„œ๋ฅผ ๋”ฐ๋ผ๊ฐˆ ๊ฒƒ ์ด ๋ชจ๋ธ์ด ํ’€๋ ค๊ณ  ํ•˜๋Š” ๋ฌธ์ œ๋Š” ๋ฌด์—‡์ธ๊ฐ€ ์ถ”๋ก  ๋‹จ๊ณ„๋ฅผ ๋จผ์ € ์ดํ•ด. โ€œํ•™์Šตโ€๋œ ๋ชจ๋ธ์ด ์–ด๋–ค โ€œ์ž…๋ ฅโ€์„ ๋ฐ›์•„์–ด ์–ด๋–ค โ€œ์ถœ๋ ฅโ€์„ ๊ณ„์‚ฐํ•˜๋Š”์ง€ ํŒŒ์•…ํ•  ๊ฒƒ ...

Apply K-fashion 3rd solution to deepfashion2 dataset

1 minute read

3๋“ฑ ์†”๋ฃจ์…˜์—์„œ DetectoRS ๋ฅผ ์“ด ์ด์œ ?(์ถ”์ธก) instance-segmentation์—์„œ ๊ทธ ๋‹น์‹œ SOTA ์˜€๊ธฐ ๋•Œ๋ฌธ์— https://paperswithcode.com/sota/instance-segmentation-on-coco

NLP - Word Embedding

8 minute read

Word Embedding ๋‹จ์–ด์˜ ์˜๋ฏธ๋ฅผ ์–ด๋–ป๊ฒŒ ๋‚˜ํƒ€๋‚ผ ๊ฒƒ์ธ๊ฐ€ ์ข‹์€ ํ‘œํ˜„ ๋ฐฉ์‹: ๋‹จ์–ด๊ฐ„์˜ ๊ด€๊ณ„๋ฅผ ์ž˜ ํ‘œํ˜„ํ•  ์ˆ˜ ์žˆ์–ด์•ผ ํ•จ

NLP - Document Classification

6 minute read

๋ฌธ์„œ ๋ถ„๋ฅ˜ (Text Classification) ๋ฌธ์„œ ๋ถ„๋ฅ˜๋ž€ ์ž…๋ ฅ์œผ๋กœ ๋ฐ›์•„, ํ…์ŠคํŠธ๊ฐ€ ์–ด๋–ค ์ข…๋ฅ˜์˜ ๋ฒ”์ฃผ์— ์†ํ•˜๋Š”์ง€๋ฅผ ๊ตฌ๋ถ„ํ•˜๋Š” ์ž‘์—… ๋‹ค์–‘ํ•œ ๋ฌธ์„œ ๋ถ„๋ฅ˜ ๋ฌธ์ œ ๋ฌธ์„œ์˜ ๋ฒ”์ฃผ, ์ฃผ์ œ ๋ถ„๋ฅ˜ ์ด๋ฉ”์ผ ์ŠคํŒธ ๋ถ„๋ฅ˜ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ ์–ธ์–ด ๋ถ„๋ฅ˜ ...

Docker Volume vs Bind Mount

less than 1 minute read

๐Ÿ‘‰ Reference: https://www.daleseo.com/docker-volumes-bind-mounts/

Docker Build

less than 1 minute read

Build Docker Image & run, start, stop and exit container by using shell command $ bash docker/build.sh

NLP - Language Model

5 minute read

์–ธ์–ด๋ชจ๋ธ ๋‹ค์Œ ๋ฌธ์žฅ ๋‹ค์Œ์— ์ด์–ด์งˆ ๋‹จ์–ด๋Š”? Please turn your homework in or the ? ๋‹ค์Œ ๋‘ ๋ฌธ์žฅ ์ค‘ ๋‚˜ํƒ€๋‚  ํ™•๋ฅ ์ด ๋” ๋†’์€ ๊ฒƒ์€? ...

NLP - text preprocessing

5 minute read

Intro ์ž์—ฐ์–ด์˜ ์˜๋ฏธ๋ฅผ ์ปดํ“จํ„ฐ๋กœ ๋ถ„์„ํ•ด์„œ ํŠน์ •์ž‘์—…์„ ์œ„ํ•ด ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•˜๋Š” ๊ฒƒ ์‘์šฉ๋ถ„์•ผ ๊ธฐ๊ณ„๋ฒˆ์—ญ ๊ฐ์„ฑ๋ถ„์„ ๋ฌธ์„œ๋ถ„๋ฅ˜ ์งˆ์˜์‘๋‹ต์‹œ์Šคํ…œ ์ฑ—๋ด‡ ์–ธ์–ด์ƒ์„ฑ ์Œ์„ฑ์ธ์‹ ์ถ”์ฒœ์‹œ์Šคํ…œ ...

Big data - ML Pipeline๊ณผ Tuning ์†Œ๊ฐœ์™€ ์‹ค์Šต

4 minute read

Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์†Œ๊ฐœ Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์ตœ์ ์˜ ํ•˜์ดํผ ํŒŒ๋ผ๋ฏธํ„ฐ ์„ ํƒ ์ตœ์ ์˜ ๋ชจ๋ธ ํ˜น์€ ๋ชจ๋ธ์˜ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ์ฐพ๋Š” ๊ฒƒ์ด ์•„์ฃผ ์ค‘์š” ํ•˜๋‚˜์”ฉ ํ…Œ์ŠคํŠธํ•ด๋ณด๋Š” ๊ฒƒ vs. ๋‹ค์ˆ˜๋ฅผ ๋™์‹œ ํ…Œ์ŠคํŠธ ํ•˜๋Š” ๊ฒƒ ๋ชจ๋ธ ์„ ํƒ์˜ ์ค‘์š”ํ•œ ...

07-22 Live Session

less than 1 minute read

Spark ์ด๋ž€ Pandas์˜ ์Šคํ…Œ๋กœ์ด๋“œ ๋ฒ„์ „ + SQL + Scikit-learn + Streaming

Big data - SparkSQL์„ ์ด์šฉํ•œ ๋ฐ์ดํ„ฐ ๋ถ„์„

10 minute read

์ปค๋ฆฌ์–ด ์ด์•ผ๊ธฐ ๋‚จ๊ณผ ๋น„๊ตํ•˜์ง€ ๋ง๊ณ  ์•ž์œผ๋กœ 20-30๋…„์„ ๋ณด๊ธฐ ํ•˜๋‚˜๋ฅผ ํ•˜๊ธฐ๋กœ ํ–ˆ์œผ๋ฉด ์ ์–ด๋„ 6๊ฐœ์›”์€ ํŒŒ๊ณ  ๋“ค๊ธฐ ๋„ˆ๋ฌด ๋นจ๋ฆฌ ํฌ๊ธฐํ•˜์ง€ ์•Š๊ธฐ ๋ญ”๊ฐ€ ์ž˜ ์•ˆ๋˜๋ฉด ์„œ๋‘๋ฅด๊ธฐ ๋ณด๋‹ค๋Š” ์˜คํžˆ๋ ค ์ฒœ์ฒœํžˆ ๊ฐ€๊ธฐ ๊ณต๋ถ€๋ฅผ ์œ„ํ•œ ๊ณต๋ถ€๋ฅผ ํ•˜๊ธฐ ๋ณด๋‹ค๋Š” ์ผ์„ ...

Big data - Spark

6 minute read

๋น…๋ฐ์ดํ„ฐ ๊ธฐ์ˆ ์ด๋ž€ Spark ์†Œ๊ฐœ ํŒ๋‹ค์Šค์™€ ๋น„๊ต Spark ์‹ค์Šต

Big data

6 minute read

๋ฐ์ดํ„ฐ ํŒ€์˜ ์—ญํ•  ๋ฐ์ดํ„ฐ ํŒ€์˜ ๋ฏธ์…˜ ์‹ ๋ขฐํ•  ์ˆ˜ ์žˆ๋Š” ๋ฐ์ดํ„ฐ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๋ถ€๊ฐ€๊ฐ€์น˜ ์ƒ์„ฑ

Project Fashion mmfashion

1 minute read

Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...

07-01 Live Session

3 minute read

Live Session ์ปค๋ฆฌ์–ด ์–ด๋–ค ๊ธฐ์ˆ ์„ ์•„๋Š๋ƒ๊ฐ€ ์•„๋‹Œ ๊ฒฐ๊ณผ๋ฅผ ๋‚ด๋Š”๋ฐ ์ดˆ์ 

SQL Analysis - ํŠธ๋žœ์žญ์…˜๊ณผ ๊ธฐํƒ€ ๊ณ ๊ธ‰ SQL ๋ฌธ๋ฒ•

10 minute read

์ˆ™์ œ1 ๋ฆฌ๋ทฐ ์‚ฌ์šฉ์ž๋ณ„๋กœ ์ฒ˜์Œ ์ฑ„๋„๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„ ์•Œ์•„๋‚ด๊ธฐ ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE ์‚ฌ์šฉ์ž 251๋ฒˆ์˜ ์‹œ๊ฐ„์ˆœ์œผ๋กœ ๋ดค์„ ๋•Œ ์ฒซ ๋ฒˆ์งธ ์ฑ„๋„๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„์€ ๋ฌด์—‡์ธ๊ฐ€? ์•„๋ž˜ ์ฟผ๋ฆฌ๋ฅผ ์‹คํ–‰ํ•ด์„œ ์ฒ˜์Œ๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„์„ ๋ณด๋ฉด ...

SQL Analysis - JOIN & ๋ฆฌ๋ทฐ

10 minute read

JOIN SQL ์กฐ์ธ์€ ๋‘ ๊ฐœ ํ˜น์€ ๊ทธ ์ด์ƒ์˜ ํ…Œ์ด๋ธ”๋“ค์„ ๊ณตํ†ต ํ•„๋“œ๋ฅผ ๊ฐ€์ง€๊ณ  MERGE ํ•˜๋Š”๋ฐ ์‚ฌ์šฉ๋จ. ์ด๋Š” ์Šคํƒ€ ์Šคํ‚ค๋งˆ๋กœ ๊ตฌ์„ฑ๋œ ํ…Œ์ด๋ธ”๋“ค๋กœ ๋ถ„์‚ฐ๋˜์–ด ์žˆ๋˜ ์ •๋ณด๋ฅผ ํ†ตํ•ฉํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ. JOIN์˜ ๊ฒฐ๊ณผ๋Š” ๋ฐฉ์‹์— ์ƒ๊ด€์—†์ด ์–‘์ชฝ์˜ ํ•„๋“œ๋ฅผ ๋ชจ๋‘ ๊ฐ€์ง„ ์ƒˆ๋กœ์šด ํ…Œ์ด๋ธ”์„ ๋งŒ๋“ค์–ด๋‚ด๊ฒŒ ๋จ. ์กฐ...

SQL Analysis - GROUP BY & CTAS

4 minute read

GROUP BY์™€ AGGREGATE ํ•จ์ˆ˜ ํ…Œ์ด๋ธ”์˜ ๋ ˆ์ฝ”๋“œ๋ฅผ ๊ทธ๋ฃนํ•‘ํ•˜์—ฌ ๊ทธ๋ฃน๋ณ„๋กœ ๋‹ค์–‘ํ•œ ์ •๋ณด๋ฅผ ๊ณ„์‚ฐ ์ด๋Š” ๋‘ ๋‹จ๊ณ„๋กœ ์ด๋ฃจ์–ด์ง ๊ทธ๋ฃนํ•‘์„ ํ•  ํ•„๋“œ๋ฅผ ๊ฒฐ์ • (ํ•˜๋‚˜ ์ด์ƒ์˜ ํ•„๋“œ๊ฐ€ ๋  ์ˆ˜ ์žˆ์Œ) GROUP BY๋กœ ์ง€์ • (ํ•„๋“œ ์ด๋ฆ„...

SQL Analysis - SELECT

5 minute read

Redshift ๋ก ์น˜ ๋ฐ๋ชจ ์˜ˆ์ œ ํ…Œ์ด๋ธ” ์†Œ๊ฐœ ์‚ฌ์šฉ์ž ID: ์›น์„œ๋น„์Šค์—์„œ ๋“ฑ๋ก๋œ ์‚ฌ์šฉ์ž๋งˆ๋‹ค ๋ถ€์—ฌํ•˜๋Š” ์œ ์ผํ•œ ID ์„ธ์…˜ ID: ์„ธ์…˜๋งˆ๋‹ค ๋ถ€์—ฌ๋˜๋Š” ID ์„ธ์…˜: ์‚ฌ์šฉ์ž์˜ ๋ฐฉ๋ฌธ์„ ๋…ผ๋ฆฌ์ ์ธ ๋‹จ์œ„๋กœ ๋‚˜๋ˆˆ ๊ฒƒ ์‚ฌ์šฉ์ž๊ฐ€ ๋ฐฉ๋ฌธ ํ›„ 30๋ถ„...

SQL Analysis - SQL & DB

4 minute read

SQL์˜ ์ค‘์š”์„ฑ ๋ฐ์ดํ„ฐ ๊ด€๋ จ 3๊ฐœ์˜ ์ง๊ตฐ ๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop ๋ฐ์ดํ„ฐ ๋ถ„์„๊ฐ€ ...

NN basics - RNN

5 minute read

Sequential Data ํ‘œํ˜„ ๋ฒกํ„ฐ์˜ ๋ฒกํ„ฐ \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). ์‚ฌ์ „ ...

NN basics - DL Optimization

9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) โ€œThe function we want to minimize or maximize is called the objective function, ...

cs231n Assignment

10 minute read

1. ์˜ˆ์ œ ๋”ฐ๋ผํ•˜๊ณ , ๊ฐœ์ธ Github ์ •๋ฆฌํ•˜๊ธฐ CNN

07-01 Live Session

1 minute read

GAP (Global Average Pooling) import torch.nn.functional as F x = F.adaptive_avg_pool2d(x, (1, 1))

NN basics - DL Basics

2 minute read

Computer Visionโ€™s Difficulties ๊ด€์ ์˜ ๋ณ€ํ™”๋กœ ์ธํ•ด ๊ฐ™์€ ๋Œ€์ƒ์ด๋ผ๋„ ํ”ฝ์…€๊ฐ’์ด ๋‹ค๋ฆ„. ๋ฐฐ๊ฒฝ๊ณผ ํ”ผ์‚ฌ์ฒด์˜ ๊ตฌ๋ถ„์ด ์–ด๋ ค์›€. ์กฐ๋ช…์— ๋”ฐ๋ฅธ ๋ณ€ํ™” ๋Œ€์ƒ์˜ ๊ธฐํ˜•์  ํ˜•ํƒœ ๊ฐ€๋ ค์ง„ ํ˜•ํƒœ ๊ฐ™์€ ํด๋ž˜์Šค์•ˆ์—์„œ์˜ ๋ณ€ํ™”๊ฐ€ ํผ

NN basics - MLP

5 minute read

ํผ์…‰ํŠธ๋ก  ํผ์…‰ํŠธ๋ก ์˜ ๋™์ž‘ ๋‚ด์ ์— ์˜ํ•œ ์„ ํ˜•๊ณผ ํ™œ์„ฑํ•จ์ˆ˜์— ์˜ํ•œ ๋น„์„ ํ˜•์— ์˜ํ•ด ์˜๋ฏธ๋ฅผ ๊ตฌ๋ถ„. ๊ฒฐ๊ตญ์—” ๊ณต๊ฐ„์˜ ๋ถ„ํ• ์„ ๋งŒ๋“ ๋‹ค. ์„ ํ˜•๋Œ€์ˆ˜์—์„œ w๋ผ๋Š” ๊ฐ€์ค‘์น˜์— input์„ ๋‚ด์ ํ•˜๊ณ  w์— projectionํ–ˆ์„๋•Œ, ๊ทธ ๊ฐ’์ด 0์ด๋ฉด ์ง๊ตํ•˜๋Š” ๊ฒƒ์ด๊ณ , 0์„ ๊ธฐ์ค€์œผ๋กœ ๋น„์„ ํ˜•์  ์š”์†Œ๋กœ +1, -1๋กœ ...

ML basics - Linear Models for Regression

15 minute read

์„ ํ˜• ๊ธฐ์ € ํ•จ์ˆ˜ ๋ชจ๋ธ ๊ฐ€์žฅ ๋‹จ์ˆœํ•œ ํ˜•ํƒœ์˜ ์„ ํ˜•๋ชจ๋ธ

Live Session 0622

less than 1 minute read

Underprediction \(t_{i}\): target label(i-th sample) \(y_{i}\): modelโ€™s prediction

Assignment - KNN

3 minute read

This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier

ML basics - Probability Distributions 1

6 minute read

๋ฐ€๋„์ถ”์ •(Density Estimation) \(N\)๊ฐœ์˜ ๊ด€์ฐฐ๋ฐ์ดํ„ฐ(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)๊ฐ€ ์ฃผ์–ด์กŒ์„ ๋•Œ ๋ถ„ํฌํ•จ์ˆ˜ \(p(\mathbf{x})\)๋ฅผ ์ฐพ๋Š” ๊ฒƒ

Live Session 06/15

less than 1 minute read

Live Session with ๊ฐ•์ฐฝ์„ฑ ๋ฐ•์‚ฌ๋‹˜

ML basics - Linear Algebra

24 minute read

์™œ ์„ ํ˜•๋Œ€์ˆ˜๋ฅผ ์•Œ์•„์•ผ ํ•˜๋Š”๊ฐ€?

ML basics - MSE & MAE

4 minute read

Dataset ย  Restaurant Location Cuisines AverageCost MinimumOrder Rating Votes Reviews De...

Django Chart Visualization

4 minute read

1. Add chart.js and jquery (layouts.html) This is currently located at head, but later Iโ€™ve to move those scripts down to the end of the body tag. <!-- ...

Django HTML Extension with Issue & Solution

less than 1 minute read

Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...

Django Static with Debug Mode

less than 1 minute read

Django Static & Debug Mode Keep in mind. If Debug = False, even though you correctly impletmented your static files, Django do not load any of your stati...

Flask API with Swagger

less than 1 minute read

Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run

Git Large File push Error and Solution

less than 1 minute read

Plotting ๊ณผ์ œ pushํ•˜๋‹ค๊ฐ€ 100MB ๋„˜๋Š” ํŒŒ์ผ์„ pushํ•˜๋ ค๊ณ  ํ•˜๋‹ˆ error๊ฐ€ ๋‚ฌ๋‹ค. 100MB ์ด์ƒ ํŒŒ์ผ ์˜ฌ๋ฆฌ๋ ค๋ฉด Git LFS(Large File Storage)๋ฅผ ์‚ฌ์šฉํ•ด์•ผ ํ•œ๋‹ค๋Š”๋ฐ ๊ตณ์ด ์˜ฌ๋ฆฌ์ง€ ์•Š์•„๋„ ๋œ๋‹ค๋ฉด, ์—๋Ÿฌ๋งŒ ํ•ด๊ฒฐํ•˜๊ณ  ๋‹ค์‹œ PUSH ํ•˜๊ณ  ์‹ถ๋‹ค๋ฉด ์•„๋ž˜ ๋งํฌ๋ฅผ...

Git Pull Request (PR) - Project Contribution

2 minute read

Git Pull Request ๋‹ค ์ ๊ณ ๋ณด๋‹ˆ ๋„ˆ๋ฌด ์ž์„ธํ•˜๊ฒŒ ์ ์€ ๊ฒƒ ๊ฐ™๊ธฐ๋„ ํ•˜๋‹ค.

N Queen

1 minute read

Backtracking ๋Œ€ํ‘œ ๋ฌธ์ œ Backtracking ๋Œ€ํ‘œ์  ๋ฌธ์ œ๋ผ๊ณ  ํ•œ๋‹ค.

SVD

less than 1 minute read

In Linear Algebra Course, SVD is one of matrix decomposition methods. (such as LU, QR)

Back to top ↑

MathJax

ML Basics - todo

less than 1 minute read

์ •๋ฆฌํ•  ๊ฒƒ

Project Fashion mmfashion

1 minute read

Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...

SQL Analysis - ํŠธ๋žœ์žญ์…˜๊ณผ ๊ธฐํƒ€ ๊ณ ๊ธ‰ SQL ๋ฌธ๋ฒ•

10 minute read

์ˆ™์ œ1 ๋ฆฌ๋ทฐ ์‚ฌ์šฉ์ž๋ณ„๋กœ ์ฒ˜์Œ ์ฑ„๋„๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„ ์•Œ์•„๋‚ด๊ธฐ ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE ์‚ฌ์šฉ์ž 251๋ฒˆ์˜ ์‹œ๊ฐ„์ˆœ์œผ๋กœ ๋ดค์„ ๋•Œ ์ฒซ ๋ฒˆ์งธ ์ฑ„๋„๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„์€ ๋ฌด์—‡์ธ๊ฐ€? ์•„๋ž˜ ์ฟผ๋ฆฌ๋ฅผ ์‹คํ–‰ํ•ด์„œ ์ฒ˜์Œ๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„์„ ๋ณด๋ฉด ...

SQL Analysis - JOIN & ๋ฆฌ๋ทฐ

10 minute read

JOIN SQL ์กฐ์ธ์€ ๋‘ ๊ฐœ ํ˜น์€ ๊ทธ ์ด์ƒ์˜ ํ…Œ์ด๋ธ”๋“ค์„ ๊ณตํ†ต ํ•„๋“œ๋ฅผ ๊ฐ€์ง€๊ณ  MERGE ํ•˜๋Š”๋ฐ ์‚ฌ์šฉ๋จ. ์ด๋Š” ์Šคํƒ€ ์Šคํ‚ค๋งˆ๋กœ ๊ตฌ์„ฑ๋œ ํ…Œ์ด๋ธ”๋“ค๋กœ ๋ถ„์‚ฐ๋˜์–ด ์žˆ๋˜ ์ •๋ณด๋ฅผ ํ†ตํ•ฉํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ. JOIN์˜ ๊ฒฐ๊ณผ๋Š” ๋ฐฉ์‹์— ์ƒ๊ด€์—†์ด ์–‘์ชฝ์˜ ํ•„๋“œ๋ฅผ ๋ชจ๋‘ ๊ฐ€์ง„ ์ƒˆ๋กœ์šด ํ…Œ์ด๋ธ”์„ ๋งŒ๋“ค์–ด๋‚ด๊ฒŒ ๋จ. ์กฐ...

SQL Analysis - GROUP BY & CTAS

4 minute read

GROUP BY์™€ AGGREGATE ํ•จ์ˆ˜ ํ…Œ์ด๋ธ”์˜ ๋ ˆ์ฝ”๋“œ๋ฅผ ๊ทธ๋ฃนํ•‘ํ•˜์—ฌ ๊ทธ๋ฃน๋ณ„๋กœ ๋‹ค์–‘ํ•œ ์ •๋ณด๋ฅผ ๊ณ„์‚ฐ ์ด๋Š” ๋‘ ๋‹จ๊ณ„๋กœ ์ด๋ฃจ์–ด์ง ๊ทธ๋ฃนํ•‘์„ ํ•  ํ•„๋“œ๋ฅผ ๊ฒฐ์ • (ํ•˜๋‚˜ ์ด์ƒ์˜ ํ•„๋“œ๊ฐ€ ๋  ์ˆ˜ ์žˆ์Œ) GROUP BY๋กœ ์ง€์ • (ํ•„๋“œ ์ด๋ฆ„...

SQL Analysis - SELECT

5 minute read

Redshift ๋ก ์น˜ ๋ฐ๋ชจ ์˜ˆ์ œ ํ…Œ์ด๋ธ” ์†Œ๊ฐœ ์‚ฌ์šฉ์ž ID: ์›น์„œ๋น„์Šค์—์„œ ๋“ฑ๋ก๋œ ์‚ฌ์šฉ์ž๋งˆ๋‹ค ๋ถ€์—ฌํ•˜๋Š” ์œ ์ผํ•œ ID ์„ธ์…˜ ID: ์„ธ์…˜๋งˆ๋‹ค ๋ถ€์—ฌ๋˜๋Š” ID ์„ธ์…˜: ์‚ฌ์šฉ์ž์˜ ๋ฐฉ๋ฌธ์„ ๋…ผ๋ฆฌ์ ์ธ ๋‹จ์œ„๋กœ ๋‚˜๋ˆˆ ๊ฒƒ ์‚ฌ์šฉ์ž๊ฐ€ ๋ฐฉ๋ฌธ ํ›„ 30๋ถ„...

SQL Analysis - SQL & DB

4 minute read

SQL์˜ ์ค‘์š”์„ฑ ๋ฐ์ดํ„ฐ ๊ด€๋ จ 3๊ฐœ์˜ ์ง๊ตฐ ๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop ๋ฐ์ดํ„ฐ ๋ถ„์„๊ฐ€ ...

NN basics - RNN

5 minute read

Sequential Data ํ‘œํ˜„ ๋ฒกํ„ฐ์˜ ๋ฒกํ„ฐ \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). ์‚ฌ์ „ ...

NN basics - DL Optimization

9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) โ€œThe function we want to minimize or maximize is called the objective function, ...

cs231n Assignment

10 minute read

1. ์˜ˆ์ œ ๋”ฐ๋ผํ•˜๊ณ , ๊ฐœ์ธ Github ์ •๋ฆฌํ•˜๊ธฐ CNN

NN basics - DL Basics

2 minute read

Computer Visionโ€™s Difficulties ๊ด€์ ์˜ ๋ณ€ํ™”๋กœ ์ธํ•ด ๊ฐ™์€ ๋Œ€์ƒ์ด๋ผ๋„ ํ”ฝ์…€๊ฐ’์ด ๋‹ค๋ฆ„. ๋ฐฐ๊ฒฝ๊ณผ ํ”ผ์‚ฌ์ฒด์˜ ๊ตฌ๋ถ„์ด ์–ด๋ ค์›€. ์กฐ๋ช…์— ๋”ฐ๋ฅธ ๋ณ€ํ™” ๋Œ€์ƒ์˜ ๊ธฐํ˜•์  ํ˜•ํƒœ ๊ฐ€๋ ค์ง„ ํ˜•ํƒœ ๊ฐ™์€ ํด๋ž˜์Šค์•ˆ์—์„œ์˜ ๋ณ€ํ™”๊ฐ€ ํผ

NN basics - MLP

5 minute read

ํผ์…‰ํŠธ๋ก  ํผ์…‰ํŠธ๋ก ์˜ ๋™์ž‘ ๋‚ด์ ์— ์˜ํ•œ ์„ ํ˜•๊ณผ ํ™œ์„ฑํ•จ์ˆ˜์— ์˜ํ•œ ๋น„์„ ํ˜•์— ์˜ํ•ด ์˜๋ฏธ๋ฅผ ๊ตฌ๋ถ„. ๊ฒฐ๊ตญ์—” ๊ณต๊ฐ„์˜ ๋ถ„ํ• ์„ ๋งŒ๋“ ๋‹ค. ์„ ํ˜•๋Œ€์ˆ˜์—์„œ w๋ผ๋Š” ๊ฐ€์ค‘์น˜์— input์„ ๋‚ด์ ํ•˜๊ณ  w์— projectionํ–ˆ์„๋•Œ, ๊ทธ ๊ฐ’์ด 0์ด๋ฉด ์ง๊ตํ•˜๋Š” ๊ฒƒ์ด๊ณ , 0์„ ๊ธฐ์ค€์œผ๋กœ ๋น„์„ ํ˜•์  ์š”์†Œ๋กœ +1, -1๋กœ ...

ML basics - Linear Models for Regression

15 minute read

์„ ํ˜• ๊ธฐ์ € ํ•จ์ˆ˜ ๋ชจ๋ธ ๊ฐ€์žฅ ๋‹จ์ˆœํ•œ ํ˜•ํƒœ์˜ ์„ ํ˜•๋ชจ๋ธ

Assignment - KNN

3 minute read

This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier

ML basics - Probability Distributions 1

6 minute read

๋ฐ€๋„์ถ”์ •(Density Estimation) \(N\)๊ฐœ์˜ ๊ด€์ฐฐ๋ฐ์ดํ„ฐ(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)๊ฐ€ ์ฃผ์–ด์กŒ์„ ๋•Œ ๋ถ„ํฌํ•จ์ˆ˜ \(p(\mathbf{x})\)๋ฅผ ์ฐพ๋Š” ๊ฒƒ

ML basics - Linear Algebra

24 minute read

์™œ ์„ ํ˜•๋Œ€์ˆ˜๋ฅผ ์•Œ์•„์•ผ ํ•˜๋Š”๊ฐ€?

ML basics - MSE & MAE

4 minute read

Dataset ย  Restaurant Location Cuisines AverageCost MinimumOrder Rating Votes Reviews De...

Aligning Equations in mathjax

less than 1 minute read

Align Equations in mathjax format \(\begin{align} \sqrt{37} & = \sqrt{\frac{73^2-1}{12^2}} \\ & = \sqrt{\frac{73^2}{12^2}\cdot\frac{73^2-1}{73^2}} \...

Back to top ↑

Docker

Docker Registry

less than 1 minute read

https://www.44bits.io/ko/post/running-docker-registry-and-using-s3-storage

Docker Redis

less than 1 minute read

Redis with Docker get redis image from docker hub Docker image pull redis redis-cli์™€ ๊ฐ™์ด ๊ตฌ๋™ํ•ด์•ผ ๋จ. ๋‘ ์ปจํ…Œ์ด๋„ˆ๋ฅผ ์—ฐ๊ฒฐ...

Bitbucket Pipeline runners

less than 1 minute read

create pipeline write bitbucket-pipelines.yml commit pipelines.yml file run docker at local (test runners in local env) ...

Docker Container push

less than 1 minute read

Dockerhub์— Push ๊นŒ์ง€ ํ•˜๋Š” ๊ฒฝ์šฐ private repository๋Š” ํ•œ๊ฐœ๊นŒ์ง€๋งŒ ๊ฐ€๋Šฅํ•˜๊ณ  ๋” ์“ฐ๋ ค๋ฉด ์œ ๋ฃŒ ํ”Œ๋žœ์— ๊ฐ€์ž…ํ•ด์•ผ ํ•œ๋‹ค.

Docker Jupyter lab access denied

less than 1 minute read

ํ™˜๊ฒฝ local์—์„œ server์— ์žˆ๋Š” docker container์—์„œ jupyter lab์œผ๋กœ ์ ‘์†

Docker Container memory shortage

less than 1 minute read

Error Message: RuntimeError: DataLoader worker (pid 4301) is killed by signal: Bus error. It is possible that dataloader's workers are out of shared memory. ...

Apply K-fashion 3rd solution to deepfashion2 dataset

1 minute read

3๋“ฑ ์†”๋ฃจ์…˜์—์„œ DetectoRS ๋ฅผ ์“ด ์ด์œ ?(์ถ”์ธก) instance-segmentation์—์„œ ๊ทธ ๋‹น์‹œ SOTA ์˜€๊ธฐ ๋•Œ๋ฌธ์— https://paperswithcode.com/sota/instance-segmentation-on-coco

Docker gpu and jupyter lab

less than 1 minute read

๋„์ปค์—์„œ Container ํฌํŠธ์™€ Host ํฌํŠธ์˜ ๊ฐœ๋…

Docker Volume vs Bind Mount

less than 1 minute read

๐Ÿ‘‰ Reference: https://www.daleseo.com/docker-volumes-bind-mounts/

Docker Build

less than 1 minute read

Build Docker Image & run, start, stop and exit container by using shell command $ bash docker/build.sh

Docker install on ubuntu

5 minute read

Setup the docker via Repository 1. Update the apt package index and install packages to allow apt to use a repository over HTTPS: $ sudo apt-get update $ sud...

Back to top ↑

DevCourse2_ML_Basics

ML Basics - todo

less than 1 minute read

์ •๋ฆฌํ•  ๊ฒƒ

ML basics - Linear Models for Regression

15 minute read

์„ ํ˜• ๊ธฐ์ € ํ•จ์ˆ˜ ๋ชจ๋ธ ๊ฐ€์žฅ ๋‹จ์ˆœํ•œ ํ˜•ํƒœ์˜ ์„ ํ˜•๋ชจ๋ธ

ML basics - Probability Distributions 1

6 minute read

๋ฐ€๋„์ถ”์ •(Density Estimation) \(N\)๊ฐœ์˜ ๊ด€์ฐฐ๋ฐ์ดํ„ฐ(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)๊ฐ€ ์ฃผ์–ด์กŒ์„ ๋•Œ ๋ถ„ํฌํ•จ์ˆ˜ \(p(\mathbf{x})\)๋ฅผ ์ฐพ๋Š” ๊ฒƒ

ML basics - Linear Algebra

24 minute read

์™œ ์„ ํ˜•๋Œ€์ˆ˜๋ฅผ ์•Œ์•„์•ผ ํ•˜๋Š”๊ฐ€?

ML basics - MSE & MAE

4 minute read

Dataset ย  Restaurant Location Cuisines AverageCost MinimumOrder Rating Votes Reviews De...

Back to top ↑

PythonAlgorithms

Back to top ↑

MinimalMistakes

Utterances install in github blog

less than 1 minute read

Utterances ์„ค์น˜ํ•ด์„œ ๋Œ“๊ธ€ ๊ธฐ๋Šฅ ์ถ”๊ฐ€ํ•˜๊ธฐ

Markdown Named Anchor

less than 1 minute read

```markdown go to header 1 go to header 2 go to header 3

Jekyll unmodifided code block

less than 1 minute read

While writing django code snippet, I found that it hides double curly brackets( {{}} ). Since Jekyll uses the Liquid templating language to process templates...

Aligning Equations in mathjax

less than 1 minute read

Align Equations in mathjax format \(\begin{align} \sqrt{37} & = \sqrt{\frac{73^2-1}{12^2}} \\ & = \sqrt{\frac{73^2}{12^2}\cdot\frac{73^2-1}{73^2}} \...

์˜ค๋Š˜์˜ ์‚ฝ์งˆ - insert image in minimal mistakes

less than 1 minute read

์•„๋ฌด ์ƒ๊ฐ ์—†์ด ์ด๋ฏธ์ง€๋ฅผ _site/assets/images ์— ์ด๋ฏธ์ง€๋ฅผ ์ƒˆ๋กœ ์‚ฝ์ž…ํ•˜๋ ค๊ณ  ํ•˜๋‹ˆ ์ž๊พธ ์ด๋ฏธ์ง€๊ฐ€ ์‚ญ์ œ๋˜๋Š” ๊ฒƒ์ด์˜€๋‹คโ€ฆ vscode remote connection์ด ๋ฌธ์ œ์ธ๊ฐ€ ์‹ถ์–ด server ๊ฐ€์„œ dir์—๋‹ค ๋„ฃ์–ด๋„ ๋ณด๊ณ  connection๋„ ๋‹ค์‹œ ํ•ด๋ดค์ง€๋งŒ ๊ณ„์† ์‚ญ์ œ ๋˜๊ธธ๋ž˜

Back to top ↑

Python

name == main

4 minute read

if name == โ€œmainโ€: To better understand why and how this matters, we need to take a step back to understand how Python initializes scripts and how this inter...

Python GMP

less than 1 minute read

Python GMP

Pytorch IterableDataset

less than 1 minute read

https://inmoonlight.github.io/2021/02/21/PyTorch-IterableDataset/

python concurrent futures

less than 1 minute read

```py import time data = [] start = time.time() from concurrent.futures import ThreadPoolExecutor import concurrent.futures

Python underbar underscore naminig

less than 1 minute read

4-1. ์–ธ๋”๋ฐ”๊ฐ€ ์•ž์— ํ•˜๋‚˜ ๋ถ™์€ ๊ฒฝ์šฐ (ex: _variable) ์ด ๊ฒฝ์šฐ๋Š” ๋ชจ๋“ˆ ๋‚ด์—์„œ๋งŒ ํ•ด๋‹น ๋ณ€์ˆ˜/ํ•จ์ˆ˜๋ฅผ ์‚ฌ์šฉํ•˜๊ฒ ๋‹ค๋Š” ์˜๋ฏธ์ž…๋‹ˆ๋‹ค.(private) ํŠนํžˆ ํ˜‘์—…์„ ํ•  ๋•Œ ๋‹ค๋ฅธ ํŒ€์›์—๊ฒŒ โ€˜์ด ๋ณ€์ˆ˜/ํ•จ์ˆ˜๋Š” ์ด ๋ชจ๋“ˆ ๋‚ด๋ถ€์—์„œ๋งŒ ์‚ฌ์šฉํ•  ๊ฑฐ๋‹คโ€™๋ผ๊ณ  ๋ช…์‹œ์ ์œผ๋กœ ํžŒํŠธ๋ฅผ ์ค„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

urllib parse unquote

less than 1 minute read

urllib.parse.unquote(string, encoding=โ€™utf-8โ€™, errors=โ€™replaceโ€™) Replace %xx escapes with their single-character equivalent. The optional encoding and err...

Python Regex

less than 1 minute read

Regex ์ž์ฃผ ์‚ฌ์šฉํ•˜๋Š” ๋ฌธ์ž ํด๋ž˜์Šค

Rename files with Python using os.rename

less than 1 minute read

```py import os def changeName(path, cName): i = 1 for filename in os.listdir(path): print(path+filename, โ€˜=>โ€™, path+str(cName)+str(i)+โ€™....

Back to top ↑

FashionGAN_Proj

K-Fashion preprocessing

less than 1 minute read

K-Fashion Dataset Preprocessing To-do list json: coco format์œผ๋กœ json ๋งŒ๋“ค์–ด ์ค˜์•ผ ํ•จ mv: data root ์žฌ์„ค์ • rename: ํŒŒ์ผ์ด๋ฆ„์— ๊ณต๋ฐฑ๊ณผ ๊ด„ํ˜ธ ๋“ฑ์ด ์กด์žฌ

Apply K-fashion 3rd solution to deepfashion2 dataset

1 minute read

3๋“ฑ ์†”๋ฃจ์…˜์—์„œ DetectoRS ๋ฅผ ์“ด ์ด์œ ?(์ถ”์ธก) instance-segmentation์—์„œ ๊ทธ ๋‹น์‹œ SOTA ์˜€๊ธฐ ๋•Œ๋ฌธ์— https://paperswithcode.com/sota/instance-segmentation-on-coco

Project Fashion mmfashion

1 minute read

Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...

Back to top ↑

Competition

Kaggle - Sartorius Cell Instance Segmentation

less than 1 minute read

Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task

Heart Datathon 2021

less than 1 minute read

Detection Metrics Dice Coefficient \[Dice = \frac{2 |AโˆฉB|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]

NoonBody SemanticSegmentation

1 minute read

Task: Semantic Segmentation of Body labels are come from DensePose. Using these body labels, inference body parts.

Conda Vs. Pip

less than 1 minute read

conda ๋กœ ํ™˜๊ฒฝ ๋งŒ๋“ค์–ด์„œ torch install์„ conda๋กœ ํ–ˆ๋”๋‹ˆ cuda False๊ฐ€ ๋˜๋ฒ„๋ ค์„œ ๋ฒ„์ „ ๋ฌธ์ œ์ธ์ค„ ์•Œ์•˜๋”๋‹ˆ pip install ๋กœ ํ•˜๋‹ˆ ๋ฌธ์ œ ์—†์ด cuda ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•˜๊ฒŒ ๋˜์—ˆ๋‹ค.

OpenSlide Usages

less than 1 minute read

OpenSlide lib ์‚ฌ์šฉ๋ฐฉ๋ฒ•

Setup Env with conda

less than 1 minute read

๋Œ€ํšŒ๋งˆ๋‹ค ํŒจํ‚ค์ง€ ๋ฒ„์ „ ์ด์Šˆ๊ฐ€ ์žˆ์„ ์ˆ˜ ์žˆ๊ธฐ ๋•Œ๋ฌธ์— ๋Œ€ํšŒ ์ฐธ์—ฌํ•  ๋•Œ๋งˆ๋‹ค ๋‹ค๋ฅธ conda ํ™˜๊ฒฝ์„ ๋งŒ๋“ค์–ด์ฃผ๊ณ  ์‹œ์ž‘ํ•˜๋Š”๊ฒŒ ์ข‹๋‹ค๊ณ  ์ƒ๊ฐํ•œ๋‹ค.

Setup DL Environment in Competition Container

less than 1 minute read

์˜๋ฃŒ ๋Œ€ํšŒ์—์„œ container๋กœ ์ง„ํ–‰ํ•˜๋‹ค๋ณด๋‹ˆ ํ•„์š”ํ•œ ํŒŒ์ผ๋“ค์„ ๊ฐ€์ƒํ™˜๊ฒฝ์ฒ˜๋Ÿผ ์„ค์น˜ํ•œ ํ›„ ์ปจํ…Œ์ด๋„ˆ ์žฌ์‹œ์ž‘์„ ํ•˜๋ฉด ๋‹ค ๋‚ ์•„๊ฐ€ ๋ฒ„๋ฆฐ๋‹ค. ์ด์— ๋”ฐ๋ผ ๋งˆ์šดํŠธ ๋œ backup directory์— ์„ค์น˜ ๋ฐ ์ €์žฅ ํ›„ ์‚ฌ์šฉํ•ด์•ผ ํ•˜๋Š”๋ฐ

Back to top ↑

Django

Django Chart Visualization

4 minute read

1. Add chart.js and jquery (layouts.html) This is currently located at head, but later Iโ€™ve to move those scripts down to the end of the body tag. <!-- ...

Django HTML Extension with Issue & Solution

less than 1 minute read

Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...

Django Static with Debug Mode

less than 1 minute read

Django Static & Debug Mode Keep in mind. If Debug = False, even though you correctly impletmented your static files, Django do not load any of your stati...

Back to top ↑

DevCourse2_Django

Django Chart Visualization

4 minute read

1. Add chart.js and jquery (layouts.html) This is currently located at head, but later Iโ€™ve to move those scripts down to the end of the body tag. <!-- ...

Django HTML Extension with Issue & Solution

less than 1 minute read

Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...

Django Static with Debug Mode

less than 1 minute read

Django Static & Debug Mode Keep in mind. If Debug = False, even though you correctly impletmented your static files, Django do not load any of your stati...

Back to top ↑

DL

ML Basics - todo

less than 1 minute read

์ •๋ฆฌํ•  ๊ฒƒ

Project Fashion mmfashion

1 minute read

Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...

NN basics - RNN

5 minute read

Sequential Data ํ‘œํ˜„ ๋ฒกํ„ฐ์˜ ๋ฒกํ„ฐ \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). ์‚ฌ์ „ ...

NN basics - DL Optimization

9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) โ€œThe function we want to minimize or maximize is called the objective function, ...

NN basics - DL Basics

2 minute read

Computer Visionโ€™s Difficulties ๊ด€์ ์˜ ๋ณ€ํ™”๋กœ ์ธํ•ด ๊ฐ™์€ ๋Œ€์ƒ์ด๋ผ๋„ ํ”ฝ์…€๊ฐ’์ด ๋‹ค๋ฆ„. ๋ฐฐ๊ฒฝ๊ณผ ํ”ผ์‚ฌ์ฒด์˜ ๊ตฌ๋ถ„์ด ์–ด๋ ค์›€. ์กฐ๋ช…์— ๋”ฐ๋ฅธ ๋ณ€ํ™” ๋Œ€์ƒ์˜ ๊ธฐํ˜•์  ํ˜•ํƒœ ๊ฐ€๋ ค์ง„ ํ˜•ํƒœ ๊ฐ™์€ ํด๋ž˜์Šค์•ˆ์—์„œ์˜ ๋ณ€ํ™”๊ฐ€ ํผ

Back to top ↑

NN

NN basics - RNN

5 minute read

Sequential Data ํ‘œํ˜„ ๋ฒกํ„ฐ์˜ ๋ฒกํ„ฐ \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). ์‚ฌ์ „ ...

NN basics - DL Optimization

9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) โ€œThe function we want to minimize or maximize is called the objective function, ...

cs231n Assignment

10 minute read

1. ์˜ˆ์ œ ๋”ฐ๋ผํ•˜๊ณ , ๊ฐœ์ธ Github ์ •๋ฆฌํ•˜๊ธฐ CNN

NN basics - DL Basics

2 minute read

Computer Visionโ€™s Difficulties ๊ด€์ ์˜ ๋ณ€ํ™”๋กœ ์ธํ•ด ๊ฐ™์€ ๋Œ€์ƒ์ด๋ผ๋„ ํ”ฝ์…€๊ฐ’์ด ๋‹ค๋ฆ„. ๋ฐฐ๊ฒฝ๊ณผ ํ”ผ์‚ฌ์ฒด์˜ ๊ตฌ๋ถ„์ด ์–ด๋ ค์›€. ์กฐ๋ช…์— ๋”ฐ๋ฅธ ๋ณ€ํ™” ๋Œ€์ƒ์˜ ๊ธฐํ˜•์  ํ˜•ํƒœ ๊ฐ€๋ ค์ง„ ํ˜•ํƒœ ๊ฐ™์€ ํด๋ž˜์Šค์•ˆ์—์„œ์˜ ๋ณ€ํ™”๊ฐ€ ํผ

NN basics - MLP

5 minute read

ํผ์…‰ํŠธ๋ก  ํผ์…‰ํŠธ๋ก ์˜ ๋™์ž‘ ๋‚ด์ ์— ์˜ํ•œ ์„ ํ˜•๊ณผ ํ™œ์„ฑํ•จ์ˆ˜์— ์˜ํ•œ ๋น„์„ ํ˜•์— ์˜ํ•ด ์˜๋ฏธ๋ฅผ ๊ตฌ๋ถ„. ๊ฒฐ๊ตญ์—” ๊ณต๊ฐ„์˜ ๋ถ„ํ• ์„ ๋งŒ๋“ ๋‹ค. ์„ ํ˜•๋Œ€์ˆ˜์—์„œ w๋ผ๋Š” ๊ฐ€์ค‘์น˜์— input์„ ๋‚ด์ ํ•˜๊ณ  w์— projectionํ–ˆ์„๋•Œ, ๊ทธ ๊ฐ’์ด 0์ด๋ฉด ์ง๊ตํ•˜๋Š” ๊ฒƒ์ด๊ณ , 0์„ ๊ธฐ์ค€์œผ๋กœ ๋น„์„ ํ˜•์  ์š”์†Œ๋กœ +1, -1๋กœ ...

Back to top ↑

DevCourse2_NLP

Faster RCNN

less than 1 minute read

Appendix Reference https://medium.datadriveninvestor.com/review-on-fast-rcnn-202c9eadd23b 2021 Lecture 15 Detection and Segmentation http://cs231n.stanfor...

NLP - Transformer and BERT

10 minute read

ML ๋ชจ๋ธ ์ดํ•ด๋ฅผ ์œ„ํ•œ ํŒ ๋ณต์žกํ•œ ML ๋ชจ๋ธ์„ ์ดํ•ดํ•˜๊ธฐ ์œ„ํ•ด์„œ ๋‹ค์Œ๊ณผ ๊ฐ™์€ ์ˆœ์„œ๋ฅผ ๋”ฐ๋ผ๊ฐˆ ๊ฒƒ ์ด ๋ชจ๋ธ์ด ํ’€๋ ค๊ณ  ํ•˜๋Š” ๋ฌธ์ œ๋Š” ๋ฌด์—‡์ธ๊ฐ€ ์ถ”๋ก  ๋‹จ๊ณ„๋ฅผ ๋จผ์ € ์ดํ•ด. โ€œํ•™์Šตโ€๋œ ๋ชจ๋ธ์ด ์–ด๋–ค โ€œ์ž…๋ ฅโ€์„ ๋ฐ›์•„์–ด ์–ด๋–ค โ€œ์ถœ๋ ฅโ€์„ ๊ณ„์‚ฐํ•˜๋Š”์ง€ ํŒŒ์•…ํ•  ๊ฒƒ ...

NLP - Word Embedding

8 minute read

Word Embedding ๋‹จ์–ด์˜ ์˜๋ฏธ๋ฅผ ์–ด๋–ป๊ฒŒ ๋‚˜ํƒ€๋‚ผ ๊ฒƒ์ธ๊ฐ€ ์ข‹์€ ํ‘œํ˜„ ๋ฐฉ์‹: ๋‹จ์–ด๊ฐ„์˜ ๊ด€๊ณ„๋ฅผ ์ž˜ ํ‘œํ˜„ํ•  ์ˆ˜ ์žˆ์–ด์•ผ ํ•จ

NLP - Document Classification

6 minute read

๋ฌธ์„œ ๋ถ„๋ฅ˜ (Text Classification) ๋ฌธ์„œ ๋ถ„๋ฅ˜๋ž€ ์ž…๋ ฅ์œผ๋กœ ๋ฐ›์•„, ํ…์ŠคํŠธ๊ฐ€ ์–ด๋–ค ์ข…๋ฅ˜์˜ ๋ฒ”์ฃผ์— ์†ํ•˜๋Š”์ง€๋ฅผ ๊ตฌ๋ถ„ํ•˜๋Š” ์ž‘์—… ๋‹ค์–‘ํ•œ ๋ฌธ์„œ ๋ถ„๋ฅ˜ ๋ฌธ์ œ ๋ฌธ์„œ์˜ ๋ฒ”์ฃผ, ์ฃผ์ œ ๋ถ„๋ฅ˜ ์ด๋ฉ”์ผ ์ŠคํŒธ ๋ถ„๋ฅ˜ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ ์–ธ์–ด ๋ถ„๋ฅ˜ ...

NLP - Language Model

5 minute read

์–ธ์–ด๋ชจ๋ธ ๋‹ค์Œ ๋ฌธ์žฅ ๋‹ค์Œ์— ์ด์–ด์งˆ ๋‹จ์–ด๋Š”? Please turn your homework in or the ? ๋‹ค์Œ ๋‘ ๋ฌธ์žฅ ์ค‘ ๋‚˜ํƒ€๋‚  ํ™•๋ฅ ์ด ๋” ๋†’์€ ๊ฒƒ์€? ...

NLP - text preprocessing

5 minute read

Intro ์ž์—ฐ์–ด์˜ ์˜๋ฏธ๋ฅผ ์ปดํ“จํ„ฐ๋กœ ๋ถ„์„ํ•ด์„œ ํŠน์ •์ž‘์—…์„ ์œ„ํ•ด ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•˜๋Š” ๊ฒƒ ์‘์šฉ๋ถ„์•ผ ๊ธฐ๊ณ„๋ฒˆ์—ญ ๊ฐ์„ฑ๋ถ„์„ ๋ฌธ์„œ๋ถ„๋ฅ˜ ์งˆ์˜์‘๋‹ต์‹œ์Šคํ…œ ์ฑ—๋ด‡ ์–ธ์–ด์ƒ์„ฑ ์Œ์„ฑ์ธ์‹ ์ถ”์ฒœ์‹œ์Šคํ…œ ...

Back to top ↑

Misc

First-class citizen

less than 1 minute read

programming In programming language design, a first-class citizen (also type, object, entity, or value) in a given programming language is an entity which su...

vscode jupyter kernel

less than 1 minute read

python -m ipykernel install --user --name AI_hub_pre --display-name AI_hub_kernel

Linux tar

less than 1 minute read

extract tar

tmux installation and commands

less than 1 minute read

remote ssh์™€ remote container๋กœ ์ž‘์—…ํ•˜๋‹ค๋ณด๋‹ˆ

Download Gdrive file via wget or gdown

less than 1 minute read

Wget ๋งํฌ ์ƒ์„ฑ(๋งํฌ๊ฐ€ ์žˆ๋Š” ๋ชจ๋“  ์‚ฌ์šฉ์ž์—๊ฒŒ ๊ณต๊ฐœ) wget ์ฟ ํ‚ค ์„ค์ •์œผ๋กœ ๋‹ค์šด๋กœ๋“œ wget --load-cookies ~/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget -...

Back to top ↑

coursera

Back to top ↑

google

Back to top ↑

GoogleDataAnalytics

Back to top ↑

Segmentation

Kaggle - Sartorius Cell Instance Segmentation

less than 1 minute read

Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task

Heart Datathon 2021

less than 1 minute read

Detection Metrics Dice Coefficient \[Dice = \frac{2 |AโˆฉB|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]

NoonBody SemanticSegmentation

1 minute read

Task: Semantic Segmentation of Body labels are come from DensePose. Using these body labels, inference body parts.

Conda Vs. Pip

less than 1 minute read

conda ๋กœ ํ™˜๊ฒฝ ๋งŒ๋“ค์–ด์„œ torch install์„ conda๋กœ ํ–ˆ๋”๋‹ˆ cuda False๊ฐ€ ๋˜๋ฒ„๋ ค์„œ ๋ฒ„์ „ ๋ฌธ์ œ์ธ์ค„ ์•Œ์•˜๋”๋‹ˆ pip install ๋กœ ํ•˜๋‹ˆ ๋ฌธ์ œ ์—†์ด cuda ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•˜๊ฒŒ ๋˜์—ˆ๋‹ค.

OpenSlide Usages

less than 1 minute read

OpenSlide lib ์‚ฌ์šฉ๋ฐฉ๋ฒ•

Setup Env with conda

less than 1 minute read

๋Œ€ํšŒ๋งˆ๋‹ค ํŒจํ‚ค์ง€ ๋ฒ„์ „ ์ด์Šˆ๊ฐ€ ์žˆ์„ ์ˆ˜ ์žˆ๊ธฐ ๋•Œ๋ฌธ์— ๋Œ€ํšŒ ์ฐธ์—ฌํ•  ๋•Œ๋งˆ๋‹ค ๋‹ค๋ฅธ conda ํ™˜๊ฒฝ์„ ๋งŒ๋“ค์–ด์ฃผ๊ณ  ์‹œ์ž‘ํ•˜๋Š”๊ฒŒ ์ข‹๋‹ค๊ณ  ์ƒ๊ฐํ•œ๋‹ค.

Setup DL Environment in Competition Container

less than 1 minute read

์˜๋ฃŒ ๋Œ€ํšŒ์—์„œ container๋กœ ์ง„ํ–‰ํ•˜๋‹ค๋ณด๋‹ˆ ํ•„์š”ํ•œ ํŒŒ์ผ๋“ค์„ ๊ฐ€์ƒํ™˜๊ฒฝ์ฒ˜๋Ÿผ ์„ค์น˜ํ•œ ํ›„ ์ปจํ…Œ์ด๋„ˆ ์žฌ์‹œ์ž‘์„ ํ•˜๋ฉด ๋‹ค ๋‚ ์•„๊ฐ€ ๋ฒ„๋ฆฐ๋‹ค. ์ด์— ๋”ฐ๋ผ ๋งˆ์šดํŠธ ๋œ backup directory์— ์„ค์น˜ ๋ฐ ์ €์žฅ ํ›„ ์‚ฌ์šฉํ•ด์•ผ ํ•˜๋Š”๋ฐ

Back to top ↑

LiveSession

07-22 Live Session

less than 1 minute read

Spark ์ด๋ž€ Pandas์˜ ์Šคํ…Œ๋กœ์ด๋“œ ๋ฒ„์ „ + SQL + Scikit-learn + Streaming

07-01 Live Session

3 minute read

Live Session ์ปค๋ฆฌ์–ด ์–ด๋–ค ๊ธฐ์ˆ ์„ ์•„๋Š๋ƒ๊ฐ€ ์•„๋‹Œ ๊ฒฐ๊ณผ๋ฅผ ๋‚ด๋Š”๋ฐ ์ดˆ์ 

07-01 Live Session

1 minute read

GAP (Global Average Pooling) import torch.nn.functional as F x = F.adaptive_avg_pool2d(x, (1, 1))

Live Session 0622

less than 1 minute read

Underprediction \(t_{i}\): target label(i-th sample) \(y_{i}\): modelโ€™s prediction

Live Session 06/15

less than 1 minute read

Live Session with ๊ฐ•์ฐฝ์„ฑ ๋ฐ•์‚ฌ๋‹˜

Back to top ↑

DevCourse2_NN_Basics

NN basics - RNN

5 minute read

Sequential Data ํ‘œํ˜„ ๋ฒกํ„ฐ์˜ ๋ฒกํ„ฐ \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). ์‚ฌ์ „ ...

NN basics - DL Optimization

9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) โ€œThe function we want to minimize or maximize is called the objective function, ...

NN basics - DL Basics

2 minute read

Computer Visionโ€™s Difficulties ๊ด€์ ์˜ ๋ณ€ํ™”๋กœ ์ธํ•ด ๊ฐ™์€ ๋Œ€์ƒ์ด๋ผ๋„ ํ”ฝ์…€๊ฐ’์ด ๋‹ค๋ฆ„. ๋ฐฐ๊ฒฝ๊ณผ ํ”ผ์‚ฌ์ฒด์˜ ๊ตฌ๋ถ„์ด ์–ด๋ ค์›€. ์กฐ๋ช…์— ๋”ฐ๋ฅธ ๋ณ€ํ™” ๋Œ€์ƒ์˜ ๊ธฐํ˜•์  ํ˜•ํƒœ ๊ฐ€๋ ค์ง„ ํ˜•ํƒœ ๊ฐ™์€ ํด๋ž˜์Šค์•ˆ์—์„œ์˜ ๋ณ€ํ™”๊ฐ€ ํผ

NN basics - MLP

5 minute read

ํผ์…‰ํŠธ๋ก  ํผ์…‰ํŠธ๋ก ์˜ ๋™์ž‘ ๋‚ด์ ์— ์˜ํ•œ ์„ ํ˜•๊ณผ ํ™œ์„ฑํ•จ์ˆ˜์— ์˜ํ•œ ๋น„์„ ํ˜•์— ์˜ํ•ด ์˜๋ฏธ๋ฅผ ๊ตฌ๋ถ„. ๊ฒฐ๊ตญ์—” ๊ณต๊ฐ„์˜ ๋ถ„ํ• ์„ ๋งŒ๋“ ๋‹ค. ์„ ํ˜•๋Œ€์ˆ˜์—์„œ w๋ผ๋Š” ๊ฐ€์ค‘์น˜์— input์„ ๋‚ด์ ํ•˜๊ณ  w์— projectionํ–ˆ์„๋•Œ, ๊ทธ ๊ฐ’์ด 0์ด๋ฉด ์ง๊ตํ•˜๋Š” ๊ฒƒ์ด๊ณ , 0์„ ๊ธฐ์ค€์œผ๋กœ ๋น„์„ ํ˜•์  ์š”์†Œ๋กœ +1, -1๋กœ ...

Back to top ↑

ObjectDetection

Faster RCNN

less than 1 minute read

Appendix Reference https://medium.datadriveninvestor.com/review-on-fast-rcnn-202c9eadd23b 2021 Lecture 15 Detection and Segmentation http://cs231n.stanfor...

Back to top ↑

NLP

NLP - Transformer and BERT

10 minute read

ML ๋ชจ๋ธ ์ดํ•ด๋ฅผ ์œ„ํ•œ ํŒ ๋ณต์žกํ•œ ML ๋ชจ๋ธ์„ ์ดํ•ดํ•˜๊ธฐ ์œ„ํ•ด์„œ ๋‹ค์Œ๊ณผ ๊ฐ™์€ ์ˆœ์„œ๋ฅผ ๋”ฐ๋ผ๊ฐˆ ๊ฒƒ ์ด ๋ชจ๋ธ์ด ํ’€๋ ค๊ณ  ํ•˜๋Š” ๋ฌธ์ œ๋Š” ๋ฌด์—‡์ธ๊ฐ€ ์ถ”๋ก  ๋‹จ๊ณ„๋ฅผ ๋จผ์ € ์ดํ•ด. โ€œํ•™์Šตโ€๋œ ๋ชจ๋ธ์ด ์–ด๋–ค โ€œ์ž…๋ ฅโ€์„ ๋ฐ›์•„์–ด ์–ด๋–ค โ€œ์ถœ๋ ฅโ€์„ ๊ณ„์‚ฐํ•˜๋Š”์ง€ ํŒŒ์•…ํ•  ๊ฒƒ ...

NLP - Word Embedding

8 minute read

Word Embedding ๋‹จ์–ด์˜ ์˜๋ฏธ๋ฅผ ์–ด๋–ป๊ฒŒ ๋‚˜ํƒ€๋‚ผ ๊ฒƒ์ธ๊ฐ€ ์ข‹์€ ํ‘œํ˜„ ๋ฐฉ์‹: ๋‹จ์–ด๊ฐ„์˜ ๊ด€๊ณ„๋ฅผ ์ž˜ ํ‘œํ˜„ํ•  ์ˆ˜ ์žˆ์–ด์•ผ ํ•จ

NLP - Document Classification

6 minute read

๋ฌธ์„œ ๋ถ„๋ฅ˜ (Text Classification) ๋ฌธ์„œ ๋ถ„๋ฅ˜๋ž€ ์ž…๋ ฅ์œผ๋กœ ๋ฐ›์•„, ํ…์ŠคํŠธ๊ฐ€ ์–ด๋–ค ์ข…๋ฅ˜์˜ ๋ฒ”์ฃผ์— ์†ํ•˜๋Š”์ง€๋ฅผ ๊ตฌ๋ถ„ํ•˜๋Š” ์ž‘์—… ๋‹ค์–‘ํ•œ ๋ฌธ์„œ ๋ถ„๋ฅ˜ ๋ฌธ์ œ ๋ฌธ์„œ์˜ ๋ฒ”์ฃผ, ์ฃผ์ œ ๋ถ„๋ฅ˜ ์ด๋ฉ”์ผ ์ŠคํŒธ ๋ถ„๋ฅ˜ ๊ฐ์„ฑ ๋ถ„๋ฅ˜ ์–ธ์–ด ๋ถ„๋ฅ˜ ...

NLP - Language Model

5 minute read

์–ธ์–ด๋ชจ๋ธ ๋‹ค์Œ ๋ฌธ์žฅ ๋‹ค์Œ์— ์ด์–ด์งˆ ๋‹จ์–ด๋Š”? Please turn your homework in or the ? ๋‹ค์Œ ๋‘ ๋ฌธ์žฅ ์ค‘ ๋‚˜ํƒ€๋‚  ํ™•๋ฅ ์ด ๋” ๋†’์€ ๊ฒƒ์€? ...

NLP - text preprocessing

5 minute read

Intro ์ž์—ฐ์–ด์˜ ์˜๋ฏธ๋ฅผ ์ปดํ“จํ„ฐ๋กœ ๋ถ„์„ํ•ด์„œ ํŠน์ •์ž‘์—…์„ ์œ„ํ•ด ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋„๋ก ํ•˜๋Š” ๊ฒƒ ์‘์šฉ๋ถ„์•ผ ๊ธฐ๊ณ„๋ฒˆ์—ญ ๊ฐ์„ฑ๋ถ„์„ ๋ฌธ์„œ๋ถ„๋ฅ˜ ์งˆ์˜์‘๋‹ต์‹œ์Šคํ…œ ์ฑ—๋ด‡ ์–ธ์–ด์ƒ์„ฑ ์Œ์„ฑ์ธ์‹ ์ถ”์ฒœ์‹œ์Šคํ…œ ...

Back to top ↑

Algorithm

Heap Sort Implementation

2 minute read

์ฝ”๋“œ ๊ตฌํ˜„ ์›์น™ ์ˆ˜๋„์ฝ”๋“œ๋ณด๊ณ  ๊ตฌํ˜„ ์‹คํŒจ์‹œ, ์ฝ”๋“œ๋ณด๊ณ  ์ฝ”๋ฉ˜ํŠธ ๋‹ฌ๊ณ  ์ž‘์„ฑํ•ด๋ณด๊ธฐ ์žฌ๊ท€๋กœ ๊ตฌํ˜„ ์™„์„ฑ iterative version ๊ตฌํ˜„ํ•˜๊ธฐ

Quick Sort Implementation

1 minute read

Pseudo Code ๊ธฐ์ค€์ (pivot)์„ ์ •ํ•œ๋‹ค. (4๊ฐ€์ง€ ๋ฐฉ๋ฒ• ์กด์žฌ) Always pick first element as pivot. Always pick last element as pivot (implemented below) ...

Bubble Sort Implementation

less than 1 minute read

Pseudo Code adjacent elements ๋ผ๋ฆฌ ๋น„๊ตํ•œ๋‹ค. ์–ด๋–ป๊ฒŒ sorted๊ฐ€ ๋˜์—ˆ๋Š”์ง€ ํŒ๋‹จํ•˜๋Š”๊ฐ€(์ข…๋ฃŒ์กฐ๊ฑด) 2-1. ์ฒซ pass๋ฅผ ํ†ต๊ณผํ•˜๋ฉด ๋งˆ์ง€๋ง‰ ์›์†Œ๋Š” ๋ฌด์กฐ๊ฑด ๊ฐ€์žฅ ํฐ ์›์†Œ๊ฐ€ ๋จ 2-2. ๋”ฐ๋ผ์„œ pass ํ•  ๋•Œ๋งˆ๋‹ค ๋’ค์—์„œ๋ถ€ํ„ฐ ์ •๋ ฌ์ด ๋˜๋Š” ์•Œ๊ณ ๋ฆฌ์ฆ˜ 2-...

N Queen

1 minute read

Backtracking ๋Œ€ํ‘œ ๋ฌธ์ œ Backtracking ๋Œ€ํ‘œ์  ๋ฌธ์ œ๋ผ๊ณ  ํ•œ๋‹ค.

Back to top ↑

Git

Git Reset Modes: soft, mixed, hard

less than 1 minute read

commit์„ resetํ•ด์„œ ์ด์ „ commit ์ง€์ ์œผ๋กœ ๋Œ์•„๊ฐˆ ํ•„์š”๊ฐ€ ์žˆ๋Š” ๊ฒฝ์šฐ๊ฐ€ ์กด์žฌํ•œ๋‹ค.

Git checkout submodule

less than 1 minute read

๋‹ค๋ฅธ branch๋กœ checkout ํ• ๋•Œ submodule ์ด ์—†์„ ๊ฒฝ์šฐ submodule init์„ ํ•ด์ฃผ๊ณ  update โ€“recursive๋ฅผ ํ•ด์ค˜์•ผ ํ•จ.

Git checkout from commit

less than 1 minute read

ํŠน์ • commit์œผ๋กœ ๋ถ€ํ„ฐ ์ƒˆ๋กœ์šด ๋ธŒ๋žœ์น˜๋ฅผ checkout ํ•˜๋Š” cmd

Git Credential

less than 1 minute read

git credential๋กœ ์•”ํ˜ธํ‚ค ๋งค๋ฒˆ ์ž…๋ ฅ์•ˆํ•ด๋„ ์ˆจ๊ธด์ƒํƒœ์—์„œ git clone ๊ฐ€๋Šฅํ•˜๊ฒŒ ํ•  ์ˆ˜ ์žˆ๋‹ค.

Git Pull Request (PR) - Project Contribution

2 minute read

Git Pull Request ๋‹ค ์ ๊ณ ๋ณด๋‹ˆ ๋„ˆ๋ฌด ์ž์„ธํ•˜๊ฒŒ ์ ์€ ๊ฒƒ ๊ฐ™๊ธฐ๋„ ํ•˜๋‹ค.

Back to top ↑

SQL

SQL Analysis - ํŠธ๋žœ์žญ์…˜๊ณผ ๊ธฐํƒ€ ๊ณ ๊ธ‰ SQL ๋ฌธ๋ฒ•

10 minute read

์ˆ™์ œ1 ๋ฆฌ๋ทฐ ์‚ฌ์šฉ์ž๋ณ„๋กœ ์ฒ˜์Œ ์ฑ„๋„๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„ ์•Œ์•„๋‚ด๊ธฐ ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE ์‚ฌ์šฉ์ž 251๋ฒˆ์˜ ์‹œ๊ฐ„์ˆœ์œผ๋กœ ๋ดค์„ ๋•Œ ์ฒซ ๋ฒˆ์งธ ์ฑ„๋„๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„์€ ๋ฌด์—‡์ธ๊ฐ€? ์•„๋ž˜ ์ฟผ๋ฆฌ๋ฅผ ์‹คํ–‰ํ•ด์„œ ์ฒ˜์Œ๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„์„ ๋ณด๋ฉด ...

SQL Analysis - JOIN & ๋ฆฌ๋ทฐ

10 minute read

JOIN SQL ์กฐ์ธ์€ ๋‘ ๊ฐœ ํ˜น์€ ๊ทธ ์ด์ƒ์˜ ํ…Œ์ด๋ธ”๋“ค์„ ๊ณตํ†ต ํ•„๋“œ๋ฅผ ๊ฐ€์ง€๊ณ  MERGE ํ•˜๋Š”๋ฐ ์‚ฌ์šฉ๋จ. ์ด๋Š” ์Šคํƒ€ ์Šคํ‚ค๋งˆ๋กœ ๊ตฌ์„ฑ๋œ ํ…Œ์ด๋ธ”๋“ค๋กœ ๋ถ„์‚ฐ๋˜์–ด ์žˆ๋˜ ์ •๋ณด๋ฅผ ํ†ตํ•ฉํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ. JOIN์˜ ๊ฒฐ๊ณผ๋Š” ๋ฐฉ์‹์— ์ƒ๊ด€์—†์ด ์–‘์ชฝ์˜ ํ•„๋“œ๋ฅผ ๋ชจ๋‘ ๊ฐ€์ง„ ์ƒˆ๋กœ์šด ํ…Œ์ด๋ธ”์„ ๋งŒ๋“ค์–ด๋‚ด๊ฒŒ ๋จ. ์กฐ...

SQL Analysis - GROUP BY & CTAS

4 minute read

GROUP BY์™€ AGGREGATE ํ•จ์ˆ˜ ํ…Œ์ด๋ธ”์˜ ๋ ˆ์ฝ”๋“œ๋ฅผ ๊ทธ๋ฃนํ•‘ํ•˜์—ฌ ๊ทธ๋ฃน๋ณ„๋กœ ๋‹ค์–‘ํ•œ ์ •๋ณด๋ฅผ ๊ณ„์‚ฐ ์ด๋Š” ๋‘ ๋‹จ๊ณ„๋กœ ์ด๋ฃจ์–ด์ง ๊ทธ๋ฃนํ•‘์„ ํ•  ํ•„๋“œ๋ฅผ ๊ฒฐ์ • (ํ•˜๋‚˜ ์ด์ƒ์˜ ํ•„๋“œ๊ฐ€ ๋  ์ˆ˜ ์žˆ์Œ) GROUP BY๋กœ ์ง€์ • (ํ•„๋“œ ์ด๋ฆ„...

SQL Analysis - SELECT

5 minute read

Redshift ๋ก ์น˜ ๋ฐ๋ชจ ์˜ˆ์ œ ํ…Œ์ด๋ธ” ์†Œ๊ฐœ ์‚ฌ์šฉ์ž ID: ์›น์„œ๋น„์Šค์—์„œ ๋“ฑ๋ก๋œ ์‚ฌ์šฉ์ž๋งˆ๋‹ค ๋ถ€์—ฌํ•˜๋Š” ์œ ์ผํ•œ ID ์„ธ์…˜ ID: ์„ธ์…˜๋งˆ๋‹ค ๋ถ€์—ฌ๋˜๋Š” ID ์„ธ์…˜: ์‚ฌ์šฉ์ž์˜ ๋ฐฉ๋ฌธ์„ ๋…ผ๋ฆฌ์ ์ธ ๋‹จ์œ„๋กœ ๋‚˜๋ˆˆ ๊ฒƒ ์‚ฌ์šฉ์ž๊ฐ€ ๋ฐฉ๋ฌธ ํ›„ 30๋ถ„...

SQL Analysis - SQL & DB

4 minute read

SQL์˜ ์ค‘์š”์„ฑ ๋ฐ์ดํ„ฐ ๊ด€๋ จ 3๊ฐœ์˜ ์ง๊ตฐ ๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop ๋ฐ์ดํ„ฐ ๋ถ„์„๊ฐ€ ...

Back to top ↑

DevCourse2_SQL

SQL Analysis - ํŠธ๋žœ์žญ์…˜๊ณผ ๊ธฐํƒ€ ๊ณ ๊ธ‰ SQL ๋ฌธ๋ฒ•

10 minute read

์ˆ™์ œ1 ๋ฆฌ๋ทฐ ์‚ฌ์šฉ์ž๋ณ„๋กœ ์ฒ˜์Œ ์ฑ„๋„๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„ ์•Œ์•„๋‚ด๊ธฐ ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE ์‚ฌ์šฉ์ž 251๋ฒˆ์˜ ์‹œ๊ฐ„์ˆœ์œผ๋กœ ๋ดค์„ ๋•Œ ์ฒซ ๋ฒˆ์งธ ์ฑ„๋„๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„์€ ๋ฌด์—‡์ธ๊ฐ€? ์•„๋ž˜ ์ฟผ๋ฆฌ๋ฅผ ์‹คํ–‰ํ•ด์„œ ์ฒ˜์Œ๊ณผ ๋งˆ์ง€๋ง‰ ์ฑ„๋„์„ ๋ณด๋ฉด ...

SQL Analysis - JOIN & ๋ฆฌ๋ทฐ

10 minute read

JOIN SQL ์กฐ์ธ์€ ๋‘ ๊ฐœ ํ˜น์€ ๊ทธ ์ด์ƒ์˜ ํ…Œ์ด๋ธ”๋“ค์„ ๊ณตํ†ต ํ•„๋“œ๋ฅผ ๊ฐ€์ง€๊ณ  MERGE ํ•˜๋Š”๋ฐ ์‚ฌ์šฉ๋จ. ์ด๋Š” ์Šคํƒ€ ์Šคํ‚ค๋งˆ๋กœ ๊ตฌ์„ฑ๋œ ํ…Œ์ด๋ธ”๋“ค๋กœ ๋ถ„์‚ฐ๋˜์–ด ์žˆ๋˜ ์ •๋ณด๋ฅผ ํ†ตํ•ฉํ•˜๋Š” ๋ฐ ์‚ฌ์šฉ. JOIN์˜ ๊ฒฐ๊ณผ๋Š” ๋ฐฉ์‹์— ์ƒ๊ด€์—†์ด ์–‘์ชฝ์˜ ํ•„๋“œ๋ฅผ ๋ชจ๋‘ ๊ฐ€์ง„ ์ƒˆ๋กœ์šด ํ…Œ์ด๋ธ”์„ ๋งŒ๋“ค์–ด๋‚ด๊ฒŒ ๋จ. ์กฐ...

SQL Analysis - GROUP BY & CTAS

4 minute read

GROUP BY์™€ AGGREGATE ํ•จ์ˆ˜ ํ…Œ์ด๋ธ”์˜ ๋ ˆ์ฝ”๋“œ๋ฅผ ๊ทธ๋ฃนํ•‘ํ•˜์—ฌ ๊ทธ๋ฃน๋ณ„๋กœ ๋‹ค์–‘ํ•œ ์ •๋ณด๋ฅผ ๊ณ„์‚ฐ ์ด๋Š” ๋‘ ๋‹จ๊ณ„๋กœ ์ด๋ฃจ์–ด์ง ๊ทธ๋ฃนํ•‘์„ ํ•  ํ•„๋“œ๋ฅผ ๊ฒฐ์ • (ํ•˜๋‚˜ ์ด์ƒ์˜ ํ•„๋“œ๊ฐ€ ๋  ์ˆ˜ ์žˆ์Œ) GROUP BY๋กœ ์ง€์ • (ํ•„๋“œ ์ด๋ฆ„...

SQL Analysis - SELECT

5 minute read

Redshift ๋ก ์น˜ ๋ฐ๋ชจ ์˜ˆ์ œ ํ…Œ์ด๋ธ” ์†Œ๊ฐœ ์‚ฌ์šฉ์ž ID: ์›น์„œ๋น„์Šค์—์„œ ๋“ฑ๋ก๋œ ์‚ฌ์šฉ์ž๋งˆ๋‹ค ๋ถ€์—ฌํ•˜๋Š” ์œ ์ผํ•œ ID ์„ธ์…˜ ID: ์„ธ์…˜๋งˆ๋‹ค ๋ถ€์—ฌ๋˜๋Š” ID ์„ธ์…˜: ์‚ฌ์šฉ์ž์˜ ๋ฐฉ๋ฌธ์„ ๋…ผ๋ฆฌ์ ์ธ ๋‹จ์œ„๋กœ ๋‚˜๋ˆˆ ๊ฒƒ ์‚ฌ์šฉ์ž๊ฐ€ ๋ฐฉ๋ฌธ ํ›„ 30๋ถ„...

SQL Analysis - SQL & DB

4 minute read

SQL์˜ ์ค‘์š”์„ฑ ๋ฐ์ดํ„ฐ ๊ด€๋ จ 3๊ฐœ์˜ ์ง๊ตฐ ๋ฐ์ดํ„ฐ ์—”์ง€๋‹ˆ์–ด Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop ๋ฐ์ดํ„ฐ ๋ถ„์„๊ฐ€ ...

Back to top ↑

Spark

Big data - ML Pipeline๊ณผ Tuning ์†Œ๊ฐœ์™€ ์‹ค์Šต

4 minute read

Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์†Œ๊ฐœ Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์ตœ์ ์˜ ํ•˜์ดํผ ํŒŒ๋ผ๋ฏธํ„ฐ ์„ ํƒ ์ตœ์ ์˜ ๋ชจ๋ธ ํ˜น์€ ๋ชจ๋ธ์˜ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ์ฐพ๋Š” ๊ฒƒ์ด ์•„์ฃผ ์ค‘์š” ํ•˜๋‚˜์”ฉ ํ…Œ์ŠคํŠธํ•ด๋ณด๋Š” ๊ฒƒ vs. ๋‹ค์ˆ˜๋ฅผ ๋™์‹œ ํ…Œ์ŠคํŠธ ํ•˜๋Š” ๊ฒƒ ๋ชจ๋ธ ์„ ํƒ์˜ ์ค‘์š”ํ•œ ...

Big data - SparkSQL์„ ์ด์šฉํ•œ ๋ฐ์ดํ„ฐ ๋ถ„์„

10 minute read

์ปค๋ฆฌ์–ด ์ด์•ผ๊ธฐ ๋‚จ๊ณผ ๋น„๊ตํ•˜์ง€ ๋ง๊ณ  ์•ž์œผ๋กœ 20-30๋…„์„ ๋ณด๊ธฐ ํ•˜๋‚˜๋ฅผ ํ•˜๊ธฐ๋กœ ํ–ˆ์œผ๋ฉด ์ ์–ด๋„ 6๊ฐœ์›”์€ ํŒŒ๊ณ  ๋“ค๊ธฐ ๋„ˆ๋ฌด ๋นจ๋ฆฌ ํฌ๊ธฐํ•˜์ง€ ์•Š๊ธฐ ๋ญ”๊ฐ€ ์ž˜ ์•ˆ๋˜๋ฉด ์„œ๋‘๋ฅด๊ธฐ ๋ณด๋‹ค๋Š” ์˜คํžˆ๋ ค ์ฒœ์ฒœํžˆ ๊ฐ€๊ธฐ ๊ณต๋ถ€๋ฅผ ์œ„ํ•œ ๊ณต๋ถ€๋ฅผ ํ•˜๊ธฐ ๋ณด๋‹ค๋Š” ์ผ์„ ...

Big data - Spark

6 minute read

๋น…๋ฐ์ดํ„ฐ ๊ธฐ์ˆ ์ด๋ž€ Spark ์†Œ๊ฐœ ํŒ๋‹ค์Šค์™€ ๋น„๊ต Spark ์‹ค์Šต

Big data

6 minute read

๋ฐ์ดํ„ฐ ํŒ€์˜ ์—ญํ•  ๋ฐ์ดํ„ฐ ํŒ€์˜ ๋ฏธ์…˜ ์‹ ๋ขฐํ•  ์ˆ˜ ์žˆ๋Š” ๋ฐ์ดํ„ฐ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๋ถ€๊ฐ€๊ฐ€์น˜ ์ƒ์„ฑ

Back to top ↑

BigData

Big data - ML Pipeline๊ณผ Tuning ์†Œ๊ฐœ์™€ ์‹ค์Šต

4 minute read

Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์†Œ๊ฐœ Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์ตœ์ ์˜ ํ•˜์ดํผ ํŒŒ๋ผ๋ฏธํ„ฐ ์„ ํƒ ์ตœ์ ์˜ ๋ชจ๋ธ ํ˜น์€ ๋ชจ๋ธ์˜ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ์ฐพ๋Š” ๊ฒƒ์ด ์•„์ฃผ ์ค‘์š” ํ•˜๋‚˜์”ฉ ํ…Œ์ŠคํŠธํ•ด๋ณด๋Š” ๊ฒƒ vs. ๋‹ค์ˆ˜๋ฅผ ๋™์‹œ ํ…Œ์ŠคํŠธ ํ•˜๋Š” ๊ฒƒ ๋ชจ๋ธ ์„ ํƒ์˜ ์ค‘์š”ํ•œ ...

Big data - SparkSQL์„ ์ด์šฉํ•œ ๋ฐ์ดํ„ฐ ๋ถ„์„

10 minute read

์ปค๋ฆฌ์–ด ์ด์•ผ๊ธฐ ๋‚จ๊ณผ ๋น„๊ตํ•˜์ง€ ๋ง๊ณ  ์•ž์œผ๋กœ 20-30๋…„์„ ๋ณด๊ธฐ ํ•˜๋‚˜๋ฅผ ํ•˜๊ธฐ๋กœ ํ–ˆ์œผ๋ฉด ์ ์–ด๋„ 6๊ฐœ์›”์€ ํŒŒ๊ณ  ๋“ค๊ธฐ ๋„ˆ๋ฌด ๋นจ๋ฆฌ ํฌ๊ธฐํ•˜์ง€ ์•Š๊ธฐ ๋ญ”๊ฐ€ ์ž˜ ์•ˆ๋˜๋ฉด ์„œ๋‘๋ฅด๊ธฐ ๋ณด๋‹ค๋Š” ์˜คํžˆ๋ ค ์ฒœ์ฒœํžˆ ๊ฐ€๊ธฐ ๊ณต๋ถ€๋ฅผ ์œ„ํ•œ ๊ณต๋ถ€๋ฅผ ํ•˜๊ธฐ ๋ณด๋‹ค๋Š” ์ผ์„ ...

Big data - Spark

6 minute read

๋น…๋ฐ์ดํ„ฐ ๊ธฐ์ˆ ์ด๋ž€ Spark ์†Œ๊ฐœ ํŒ๋‹ค์Šค์™€ ๋น„๊ต Spark ์‹ค์Šต

Big data

6 minute read

๋ฐ์ดํ„ฐ ํŒ€์˜ ์—ญํ•  ๋ฐ์ดํ„ฐ ํŒ€์˜ ๋ฏธ์…˜ ์‹ ๋ขฐํ•  ์ˆ˜ ์žˆ๋Š” ๋ฐ์ดํ„ฐ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๋ถ€๊ฐ€๊ฐ€์น˜ ์ƒ์„ฑ

Back to top ↑

DevCourse2_Spark

Big data - ML Pipeline๊ณผ Tuning ์†Œ๊ฐœ์™€ ์‹ค์Šต

4 minute read

Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์†Œ๊ฐœ Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์ตœ์ ์˜ ํ•˜์ดํผ ํŒŒ๋ผ๋ฏธํ„ฐ ์„ ํƒ ์ตœ์ ์˜ ๋ชจ๋ธ ํ˜น์€ ๋ชจ๋ธ์˜ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ์ฐพ๋Š” ๊ฒƒ์ด ์•„์ฃผ ์ค‘์š” ํ•˜๋‚˜์”ฉ ํ…Œ์ŠคํŠธํ•ด๋ณด๋Š” ๊ฒƒ vs. ๋‹ค์ˆ˜๋ฅผ ๋™์‹œ ํ…Œ์ŠคํŠธ ํ•˜๋Š” ๊ฒƒ ๋ชจ๋ธ ์„ ํƒ์˜ ์ค‘์š”ํ•œ ...

Big data - SparkSQL์„ ์ด์šฉํ•œ ๋ฐ์ดํ„ฐ ๋ถ„์„

10 minute read

์ปค๋ฆฌ์–ด ์ด์•ผ๊ธฐ ๋‚จ๊ณผ ๋น„๊ตํ•˜์ง€ ๋ง๊ณ  ์•ž์œผ๋กœ 20-30๋…„์„ ๋ณด๊ธฐ ํ•˜๋‚˜๋ฅผ ํ•˜๊ธฐ๋กœ ํ–ˆ์œผ๋ฉด ์ ์–ด๋„ 6๊ฐœ์›”์€ ํŒŒ๊ณ  ๋“ค๊ธฐ ๋„ˆ๋ฌด ๋นจ๋ฆฌ ํฌ๊ธฐํ•˜์ง€ ์•Š๊ธฐ ๋ญ”๊ฐ€ ์ž˜ ์•ˆ๋˜๋ฉด ์„œ๋‘๋ฅด๊ธฐ ๋ณด๋‹ค๋Š” ์˜คํžˆ๋ ค ์ฒœ์ฒœํžˆ ๊ฐ€๊ธฐ ๊ณต๋ถ€๋ฅผ ์œ„ํ•œ ๊ณต๋ถ€๋ฅผ ํ•˜๊ธฐ ๋ณด๋‹ค๋Š” ์ผ์„ ...

Big data - Spark

6 minute read

๋น…๋ฐ์ดํ„ฐ ๊ธฐ์ˆ ์ด๋ž€ Spark ์†Œ๊ฐœ ํŒ๋‹ค์Šค์™€ ๋น„๊ต Spark ์‹ค์Šต

Big data

6 minute read

๋ฐ์ดํ„ฐ ํŒ€์˜ ์—ญํ•  ๋ฐ์ดํ„ฐ ํŒ€์˜ ๋ฏธ์…˜ ์‹ ๋ขฐํ•  ์ˆ˜ ์žˆ๋Š” ๋ฐ์ดํ„ฐ๋ฅผ ๋ฐ”ํƒ•์œผ๋กœ ๋ถ€๊ฐ€๊ฐ€์น˜ ์ƒ์„ฑ

Back to top ↑

Sort

Heap Sort Implementation

2 minute read

์ฝ”๋“œ ๊ตฌํ˜„ ์›์น™ ์ˆ˜๋„์ฝ”๋“œ๋ณด๊ณ  ๊ตฌํ˜„ ์‹คํŒจ์‹œ, ์ฝ”๋“œ๋ณด๊ณ  ์ฝ”๋ฉ˜ํŠธ ๋‹ฌ๊ณ  ์ž‘์„ฑํ•ด๋ณด๊ธฐ ์žฌ๊ท€๋กœ ๊ตฌํ˜„ ์™„์„ฑ iterative version ๊ตฌํ˜„ํ•˜๊ธฐ

Quick Sort Implementation

1 minute read

Pseudo Code ๊ธฐ์ค€์ (pivot)์„ ์ •ํ•œ๋‹ค. (4๊ฐ€์ง€ ๋ฐฉ๋ฒ• ์กด์žฌ) Always pick first element as pivot. Always pick last element as pivot (implemented below) ...

Bubble Sort Implementation

less than 1 minute read

Pseudo Code adjacent elements ๋ผ๋ฆฌ ๋น„๊ตํ•œ๋‹ค. ์–ด๋–ป๊ฒŒ sorted๊ฐ€ ๋˜์—ˆ๋Š”์ง€ ํŒ๋‹จํ•˜๋Š”๊ฐ€(์ข…๋ฃŒ์กฐ๊ฑด) 2-1. ์ฒซ pass๋ฅผ ํ†ต๊ณผํ•˜๋ฉด ๋งˆ์ง€๋ง‰ ์›์†Œ๋Š” ๋ฌด์กฐ๊ฑด ๊ฐ€์žฅ ํฐ ์›์†Œ๊ฐ€ ๋จ 2-2. ๋”ฐ๋ผ์„œ pass ํ•  ๋•Œ๋งˆ๋‹ค ๋’ค์—์„œ๋ถ€ํ„ฐ ์ •๋ ฌ์ด ๋˜๋Š” ์•Œ๊ณ ๋ฆฌ์ฆ˜ 2-...

Back to top ↑

DevCourse2_DL_Math

SVD

less than 1 minute read

In Linear Algebra Course, SVD is one of matrix decomposition methods. (such as LU, QR)

Back to top ↑

Linux

Linux tar

less than 1 minute read

extract tar

Back to top ↑

CICD

ML Flow Tutorial

less than 1 minute read

MLOps ๋ฐ˜๋ณต์ ์ธ ์ž‘์—…์„ ํ•ด์†Œํ•  ์ˆ˜ ์žˆ๋Š” ๋ฐฉ๋ฒ•์ด๋ฉด ๋‹ค MLOps ์˜ ์˜์—ญ์œผ๋กœ ๊ฐ„์ฃผํ•œ๋‹ค.

GitLab runner

less than 1 minute read

Git lab runner๋กœ ์ด์ฃผ ์‹œ์ž‘

Runners and ci-cd

less than 1 minute read

https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners

Back to top ↑

GitLab

GitLab cicd starclass test

1 minute read

make test_run.py to pass with python uniitest 1-1. make cicd variables in settings.

GitLab runner

less than 1 minute read

bitbucket ์šฉ์œผ๋กœ ssh๋ฅผ ํ•˜๋‚˜๋งŒ ์“ฐ๋‹ค๊ฐ€

GitLab runner

less than 1 minute read

Git lab runner๋กœ ์ด์ฃผ ์‹œ์ž‘

Back to top ↑

VSCode

VSCode Editor tabs to wrap

less than 1 minute read

Go to setting: ctrl + , search: workbench.editor.wrapTabs Turn to True(as checked)

Remote-ssh access in VSCode

1 minute read

Remote-ssh VScode install VSCODE press F1 Find Remote-SSH: Connect current window to Host (or Remote-SSH: Connect to Host) ๋งŒ์•ฝ ์ตœ์ดˆ config ๋งŒ๋“ค์–ด์•ผ ๋˜๋ฉด 4-1...

Back to top ↑

Jekyll

Jekyll unmodifided code block

less than 1 minute read

While writing django code snippet, I found that it hides double curly brackets( {{}} ). Since Jekyll uses the Liquid templating language to process templates...

Back to top ↑

HTML

Django Chart Visualization

4 minute read

1. Add chart.js and jquery (layouts.html) This is currently located at head, but later Iโ€™ve to move those scripts down to the end of the body tag. <!-- ...

Django HTML Extension with Issue & Solution

less than 1 minute read

Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...

Back to top ↑

Pathology

Conda Vs. Pip

less than 1 minute read

conda ๋กœ ํ™˜๊ฒฝ ๋งŒ๋“ค์–ด์„œ torch install์„ conda๋กœ ํ–ˆ๋”๋‹ˆ cuda False๊ฐ€ ๋˜๋ฒ„๋ ค์„œ ๋ฒ„์ „ ๋ฌธ์ œ์ธ์ค„ ์•Œ์•˜๋”๋‹ˆ pip install ๋กœ ํ•˜๋‹ˆ ๋ฌธ์ œ ์—†์ด cuda ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•˜๊ฒŒ ๋˜์—ˆ๋‹ค.

OpenSlide Usages

less than 1 minute read

OpenSlide lib ์‚ฌ์šฉ๋ฐฉ๋ฒ•

Setup DL Environment in Competition Container

less than 1 minute read

์˜๋ฃŒ ๋Œ€ํšŒ์—์„œ container๋กœ ์ง„ํ–‰ํ•˜๋‹ค๋ณด๋‹ˆ ํ•„์š”ํ•œ ํŒŒ์ผ๋“ค์„ ๊ฐ€์ƒํ™˜๊ฒฝ์ฒ˜๋Ÿผ ์„ค์น˜ํ•œ ํ›„ ์ปจํ…Œ์ด๋„ˆ ์žฌ์‹œ์ž‘์„ ํ•˜๋ฉด ๋‹ค ๋‚ ์•„๊ฐ€ ๋ฒ„๋ฆฐ๋‹ค. ์ด์— ๋”ฐ๋ผ ๋งˆ์šดํŠธ ๋œ backup directory์— ์„ค์น˜ ๋ฐ ์ €์žฅ ํ›„ ์‚ฌ์šฉํ•ด์•ผ ํ•˜๋Š”๋ฐ

Back to top ↑

Flask

Flask API with Swagger

less than 1 minute read

Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run

Back to top ↑

DevCourse2_Flask

Flask API with Swagger

less than 1 minute read

Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run

Back to top ↑

Probability

Back to top ↑

LinearAlgebra

ML basics - Linear Algebra

24 minute read

์™œ ์„ ํ˜•๋Œ€์ˆ˜๋ฅผ ์•Œ์•„์•ผ ํ•˜๋Š”๊ฐ€?

Back to top ↑

ProbabilityDistributions

ML basics - Probability Distributions 1

6 minute read

๋ฐ€๋„์ถ”์ •(Density Estimation) \(N\)๊ฐœ์˜ ๊ด€์ฐฐ๋ฐ์ดํ„ฐ(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)๊ฐ€ ์ฃผ์–ด์กŒ์„ ๋•Œ ๋ถ„ํฌํ•จ์ˆ˜ \(p(\mathbf{x})\)๋ฅผ ์ฐพ๋Š” ๊ฒƒ

Back to top ↑

DevCourse2_Assignment

Assignment - KNN

3 minute read

This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier

Back to top ↑

Classification

Back to top ↑

DL_basics

Optimizers

1 minute read

Optimizers https://youtu.be/mdKjMPmcWjY

Back to top ↑

SparkMLlib

Big data - ML Pipeline๊ณผ Tuning ์†Œ๊ฐœ์™€ ์‹ค์Šต

4 minute read

Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์†Œ๊ฐœ Spark MLlib ๋ชจ๋ธ ํŠœ๋‹ ์ตœ์ ์˜ ํ•˜์ดํผ ํŒŒ๋ผ๋ฏธํ„ฐ ์„ ํƒ ์ตœ์ ์˜ ๋ชจ๋ธ ํ˜น์€ ๋ชจ๋ธ์˜ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ์ฐพ๋Š” ๊ฒƒ์ด ์•„์ฃผ ์ค‘์š” ํ•˜๋‚˜์”ฉ ํ…Œ์ŠคํŠธํ•ด๋ณด๋Š” ๊ฒƒ vs. ๋‹ค์ˆ˜๋ฅผ ๋™์‹œ ํ…Œ์ŠคํŠธ ํ•˜๋Š” ๊ฒƒ ๋ชจ๋ธ ์„ ํƒ์˜ ์ค‘์š”ํ•œ ...

Back to top ↑

Bitbucket

Bitbucket Pipeline

less than 1 minute read

SSH key trouble shooting โ€“build-arg ssh_prv_key=โ€$(cat ~/.ssh/id_rsa)โ€ stargan

Bitbucket Pipeline runners

less than 1 minute read

create pipeline write bitbucket-pipelines.yml commit pipelines.yml file run docker at local (test runners in local env) ...

Back to top ↑

jupyter

vscode jupyter kernel

less than 1 minute read

python -m ipykernel install --user --name AI_hub_pre --display-name AI_hub_kernel

Back to top ↑

cicd

GitLab cicd starclass test

1 minute read

make test_run.py to pass with python uniitest 1-1. make cicd variables in settings.

Back to top ↑

Minimal-Mistakes

design scroll bar

less than 1 minute read

https://ansohxxn.github.io/blog/scrollbar/

create category UI

less than 1 minute read

https://ansohxxn.github.io/blog/category/

Back to top ↑

programming

Python GMP

less than 1 minute read

Python GMP

First-class citizen

less than 1 minute read

programming In programming language design, a first-class citizen (also type, object, entity, or value) in a given programming language is an entity which su...

Back to top ↑

NoonBody

NoonBody SemanticSegmentation

1 minute read

Task: Semantic Segmentation of Body labels are come from DensePose. Using these body labels, inference body parts.

Setup Env with conda

less than 1 minute read

๋Œ€ํšŒ๋งˆ๋‹ค ํŒจํ‚ค์ง€ ๋ฒ„์ „ ์ด์Šˆ๊ฐ€ ์žˆ์„ ์ˆ˜ ์žˆ๊ธฐ ๋•Œ๋ฌธ์— ๋Œ€ํšŒ ์ฐธ์—ฌํ•  ๋•Œ๋งˆ๋‹ค ๋‹ค๋ฅธ conda ํ™˜๊ฒฝ์„ ๋งŒ๋“ค์–ด์ฃผ๊ณ  ์‹œ์ž‘ํ•˜๋Š”๊ฒŒ ์ข‹๋‹ค๊ณ  ์ƒ๊ฐํ•œ๋‹ค.

Back to top ↑

Medical

Heart Datathon 2021

less than 1 minute read

Detection Metrics Dice Coefficient \[Dice = \frac{2 |AโˆฉB|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]

Back to top ↑

conda

Git bash & conda in Windows

less than 1 minute read

Go to conda.sh location such as C:\Users\{your_username}\anaconda3\etc\profile.d Open git bash here by right click as Git ...

Back to top ↑

CodingTest

N Queen

1 minute read

Backtracking ๋Œ€ํ‘œ ๋ฌธ์ œ Backtracking ๋Œ€ํ‘œ์  ๋ฌธ์ œ๋ผ๊ณ  ํ•œ๋‹ค.

Back to top ↑

remote-ssh

Remote-ssh access in VSCode

1 minute read

Remote-ssh VScode install VSCODE press F1 Find Remote-SSH: Connect current window to Host (or Remote-SSH: Connect to Host) ๋งŒ์•ฝ ์ตœ์ดˆ config ๋งŒ๋“ค์–ด์•ผ ๋˜๋ฉด 4-1...

Back to top ↑

markdown

Jekyll unmodifided code block

less than 1 minute read

While writing django code snippet, I found that it hides double curly brackets( {{}} ). Since Jekyll uses the Liquid templating language to process templates...

Back to top ↑

Deploy

Back to top ↑

SCSS

Back to top ↑

Interview

Back to top ↑

ML

Back to top ↑

Pandas

Back to top ↑

DecisionTheory

Back to top ↑

LinearRegression

Back to top ↑

Ankle

Ankle Supports

less than 1 minute read

ํ•˜์ด์—”๋“œ: ๋ฐ”์šฐ์–ดํŒŒ์ธํŠธ: ๋ง๋ ˆ์˜คํŠธ๋ ˆ์ธ(ํ‰์ƒ์‹œ), ๋ง๋ ˆ์˜ค์Šคํฌ์ธ (์šด๋™์‹œ) ๊ฒŒ๋‰ดํŠธ๋ ˆ์ธ

Back to top ↑

scss

Back to top ↑

KNN

Assignment - KNN

3 minute read

This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier

Back to top ↑

Regression

ML basics - Linear Models for Regression

15 minute read

์„ ํ˜• ๊ธฐ์ € ํ•จ์ˆ˜ ๋ชจ๋ธ ๊ฐ€์žฅ ๋‹จ์ˆœํ•œ ํ˜•ํƒœ์˜ ์„ ํ˜•๋ชจ๋ธ

Back to top ↑

Markdown

Markdown Named Anchor

less than 1 minute read

```markdown go to header 1 go to header 2 go to header 3

Back to top ↑

Jupyter

Back to top ↑

cs231n

cs231n Assignment

10 minute read

1. ์˜ˆ์ œ ๋”ฐ๋ผํ•˜๊ณ , ๊ฐœ์ธ Github ์ •๋ฆฌํ•˜๊ธฐ CNN

Back to top ↑

Assignment

cs231n Assignment

10 minute read

1. ์˜ˆ์ œ ๋”ฐ๋ผํ•˜๊ณ , ๊ฐœ์ธ Github ์ •๋ฆฌํ•˜๊ธฐ CNN

Back to top ↑

RNN

NN basics - RNN

5 minute read

Sequential Data ํ‘œํ˜„ ๋ฒกํ„ฐ์˜ ๋ฒกํ„ฐ \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). ์‚ฌ์ „ ...

Back to top ↑

Gdrive

Download Gdrive file via wget or gdown

less than 1 minute read

Wget ๋งํฌ ์ƒ์„ฑ(๋งํฌ๊ฐ€ ์žˆ๋Š” ๋ชจ๋“  ์‚ฌ์šฉ์ž์—๊ฒŒ ๊ณต๊ฐœ) wget ์ฟ ํ‚ค ์„ค์ •์œผ๋กœ ๋‹ค์šด๋กœ๋“œ wget --load-cookies ~/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget -...

Back to top ↑

tmux

tmux installation and commands

less than 1 minute read

remote ssh์™€ remote container๋กœ ์ž‘์—…ํ•˜๋‹ค๋ณด๋‹ˆ

Back to top ↑

OS

Rename files with Python using os.rename

less than 1 minute read

```py import os def changeName(path, cName): i = 1 for filename in os.listdir(path): print(path+filename, โ€˜=>โ€™, path+str(cName)+str(i)+โ€™....

Back to top ↑

Regex

Python Regex

less than 1 minute read

Regex ์ž์ฃผ ์‚ฌ์šฉํ•˜๋Š” ๋ฌธ์ž ํด๋ž˜์Šค

Back to top ↑

CocoAnnotator

Back to top ↑

Backend

Back to top ↑

RabbitMQ

Back to top ↑

Celery

Back to top ↑

Redis

Docker Redis

less than 1 minute read

Redis with Docker get redis image from docker hub Docker image pull redis redis-cli์™€ ๊ฐ™์ด ๊ตฌ๋™ํ•ด์•ผ ๋จ. ๋‘ ์ปจํ…Œ์ด๋„ˆ๋ฅผ ์—ฐ๊ฒฐ...

Back to top ↑

submodule

Git checkout from commit

less than 1 minute read

ํŠน์ • commit์œผ๋กœ ๋ถ€ํ„ฐ ์ƒˆ๋กœ์šด ๋ธŒ๋žœ์น˜๋ฅผ checkout ํ•˜๋Š” cmd

Back to top ↑

checkout

Git checkout from commit

less than 1 minute read

ํŠน์ • commit์œผ๋กœ ๋ถ€ํ„ฐ ์ƒˆ๋กœ์šด ๋ธŒ๋žœ์น˜๋ฅผ checkout ํ•˜๋Š” cmd

Back to top ↑

Coroutines

Back to top ↑

Tasks

Back to top ↑

urllib

urllib parse unquote

less than 1 minute read

urllib.parse.unquote(string, encoding=โ€™utf-8โ€™, errors=โ€™replaceโ€™) Replace %xx escapes with their single-character equivalent. The optional encoding and err...

Back to top ↑

decode

urllib parse unquote

less than 1 minute read

urllib.parse.unquote(string, encoding=โ€™utf-8โ€™, errors=โ€™replaceโ€™) Replace %xx escapes with their single-character equivalent. The optional encoding and err...

Back to top ↑

Pipeline

Bitbucket Pipeline

less than 1 minute read

SSH key trouble shooting โ€“build-arg ssh_prv_key=โ€$(cat ~/.ssh/id_rsa)โ€ stargan

Back to top ↑

Pytorch

Pytorch IterableDataset

less than 1 minute read

https://inmoonlight.github.io/2021/02/21/PyTorch-IterableDataset/

Back to top ↑

Gitlab

Back to top ↑

Network

Back to top ↑

GAN

Back to top ↑

Coursera

Back to top ↑

GAN_Specialization

Back to top ↑

Fork

Back to top ↑

system

Back to top ↑

Conda

Conda Vs. Pip

less than 1 minute read

conda ๋กœ ํ™˜๊ฒฝ ๋งŒ๋“ค์–ด์„œ torch install์„ conda๋กœ ํ–ˆ๋”๋‹ˆ cuda False๊ฐ€ ๋˜๋ฒ„๋ ค์„œ ๋ฒ„์ „ ๋ฌธ์ œ์ธ์ค„ ์•Œ์•˜๋”๋‹ˆ pip install ๋กœ ํ•˜๋‹ˆ ๋ฌธ์ œ ์—†์ด cuda ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•˜๊ฒŒ ๋˜์—ˆ๋‹ค.

Back to top ↑

yaml

Back to top ↑

Cell

Kaggle - Sartorius Cell Instance Segmentation

less than 1 minute read

Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task

Back to top ↑

git

Git bash & conda in Windows

less than 1 minute read

Go to conda.sh location such as C:\Users\{your_username}\anaconda3\etc\profile.d Open git bash here by right click as Git ...

Back to top ↑

bash

Git bash & conda in Windows

less than 1 minute read

Go to conda.sh location such as C:\Users\{your_username}\anaconda3\etc\profile.d Open git bash here by right click as Git ...

Back to top ↑

gitlab

Windows gitlab ssh

less than 1 minute read

Execute git bash by windows key command ssh-keygen Enter file in which to save the key (์ƒ์„ฑ์œ„์น˜ ์ •ํ•˜๋Š” ํŒŒํŠธ) ๊ธฐ๋ณธ๊ฒฝ๋กœ๋กœ ํ•  ์˜ˆ์ •์ด๋ฏ€๋กœ ENTER ...

Back to top ↑

ssh

Windows gitlab ssh

less than 1 minute read

Execute git bash by windows key command ssh-keygen Enter file in which to save the key (์ƒ์„ฑ์œ„์น˜ ์ •ํ•˜๋Š” ํŒŒํŠธ) ๊ธฐ๋ณธ๊ฒฝ๋กœ๋กœ ํ•  ์˜ˆ์ •์ด๋ฏ€๋กœ ENTER ...

Back to top ↑

windows

Windows gitlab ssh

less than 1 minute read

Execute git bash by windows key command ssh-keygen Enter file in which to save the key (์ƒ์„ฑ์œ„์น˜ ์ •ํ•˜๋Š” ํŒŒํŠธ) ๊ธฐ๋ณธ๊ฒฝ๋กœ๋กœ ํ•  ์˜ˆ์ •์ด๋ฏ€๋กœ ENTER ...

Back to top ↑

MLFlow

ML Flow Tutorial

less than 1 minute read

MLOps ๋ฐ˜๋ณต์ ์ธ ์ž‘์—…์„ ํ•ด์†Œํ•  ์ˆ˜ ์žˆ๋Š” ๋ฐฉ๋ฒ•์ด๋ฉด ๋‹ค MLOps ์˜ ์˜์—ญ์œผ๋กœ ๊ฐ„์ฃผํ•œ๋‹ค.

Back to top ↑

random_thoughts

์‹œ์ž‘

10 minute read

์‹œ์ž‘ํ•˜๊ฒŒ ๋œ ์ด์œ  ๋Œ€์ฒด ๋ญ˜ ์‹œ์ž‘ํ•˜๋Š๋ƒ์— ๋Œ€ํ•œ ๋‹ต์€. ์ƒ๊ฐ์˜ ์ •๋ฆฌ ๋ฐ ์‚ด๋ฉด์„œ ๋“œ๋Š” ์ƒ๊ฐ๋“ค ๋ฐ ์ผํ•˜๋ฉด์„œ ๋Š๊ผˆ๋˜ ๊ฒƒ์— ๋Œ€ํ•œ ํšŒ๊ณ ์ด๋‹ค. ์™œ ์‹œ์ž‘ํ•˜๊ฒŒ ๋˜์—ˆ๋Š”๊ฐ€. ์ผํ•œ์ง€ 1๋…„์ด ์ง€๋‚˜๊ณ  ๋‚ด ๋”ด์—๋Š” ์ผํ•˜๋Š” ํ™˜๊ฒฝ๋„ ํฌ๊ฒŒ ๋ฐ”๋€Œ์ง„ ์•Š์•˜์ง€๋งŒ, ์ข…์ „๊นŒ์ง€๋Š” ํ˜ผ์ž ์ผํ•˜๊ณ  ์ฑ…์ž„์ง€๋Š” ํ™˜๊ฒฝ์—์„œ ์•„๋งˆ๋„ ํŒ€์›๋“ค์„ ๊พธ...

Back to top ↑