Posts by Tag

FGAN Proj - Docker compose up with submodules as CICD

October 13, 2021 less than 1 minute read

clone proj from gitlab

Git Stash

September 11, 2021 less than 1 minute read

git stash

Git Credential

September 11, 2021 less than 1 minute read

git credential로 암호키 매번 입력안해도 숨긴상태에서 git clone 가능하게 할 수 있다.

Backend using RabbitMQ and Celery with docker

September 8, 2021 1 minute read

Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.

Coco Annotator install and usage

August 25, 2021 less than 1 minute read

Coco Annotator 설치

K-Fashion preprocessing

August 19, 2021 less than 1 minute read

K-Fashion Dataset Preprocessing To-do list json: coco format으로 json 만들어 줘야 함 mv: data root 재설정 rename: 파일이름에 공백과 괄호 등이 존재

StarGAN V2 - hpf(high-pass-filter)

August 19, 2021 less than 1 minute read

hpf

YOLOv5 🚀 Custom dataset training and inference

August 9, 2021 less than 1 minute read

YOLOv5 🚀

Detectron Review

August 9, 2021 less than 1 minute read

Detectron

Faster RCNN

August 7, 2021 less than 1 minute read

Appendix Reference https://medium.datadriveninvestor.com/review-on-fast-rcnn-202c9eadd23b 2021 Lecture 15 Detection and Segmentation http://cs231n.stanfor...

MMdetection Train & Inference

August 4, 2021 less than 1 minute read

Train

NLP - Transformer and BERT

August 2, 2021 10 minute read

ML 모델 이해를 위한 팁 복잡한 ML 모델을 이해하기 위해서 다음과 같은 순서를 따라갈 것 이 모델이 풀려고 하는 문제는 무엇인가 추론 단계를 먼저 이해. “학습”된 모델이 어떤 “입력”을 받아어 어떤 “출력”을 계산하는지 파악할 것 ...

NLP - Assignment 1: subword sentencepiece embedding

August 2, 2021 less than 1 minute read

1번문제: https://direction-f.tistory.com/29 2번문제: http://yonghee.io/word-embedding-pytorchword2vec/

Apply K-fashion 3rd solution to deepfashion2 dataset

August 1, 2021 1 minute read

3등 솔루션에서 DetectoRS 를 쓴 이유?(추측) instance-segmentation에서 그 당시 SOTA 였기 때문에 https://paperswithcode.com/sota/instance-segmentation-on-coco

NLP - Word Embedding

July 30, 2021 8 minute read

Word Embedding 단어의 의미를 어떻게 나타낼 것인가 좋은 표현 방식: 단어간의 관계를 잘 표현할 수 있어야 함

Docker run through bind mount and assign name on container

July 29, 2021 less than 1 minute read

docker run with bind_mount and assign name to the container docker run -d -v `pwd`:/whale_test -it --name docker123456 mydocker

NLP - Document Classification

July 28, 2021 6 minute read

문서 분류 (Text Classification) 문서 분류란 입력으로 받아, 텍스트가 어떤 종류의 범주에 속하는지를 구분하는 작업 다양한 문서 분류 문제 문서의 범주, 주제 분류 이메일 스팸 분류 감성 분류 언어 분류 ...

Docker Volume vs Bind Mount

July 28, 2021 less than 1 minute read

👉 Reference: https://www.daleseo.com/docker-volumes-bind-mounts/

Docker Build

July 27, 2021 less than 1 minute read

Build Docker Image & run, start, stop and exit container by using shell command $ bash docker/build.sh

NLP - Language Model

July 27, 2021 5 minute read

언어모델 다음 문장 다음에 이어질 단어는? Please turn your homework in or the ? 다음 두 문장 중 나타날 확률이 더 높은 것은? ...

NLP - text preprocessing

July 26, 2021 5 minute read

Intro 자연어의 의미를 컴퓨터로 분석해서 특정작업을 위해 사용할 수 있도록 하는 것 응용분야 기계번역 감성분석 문서분류 질의응답시스템 챗봇 언어생성 음성인식 추천시스템 ...

Big data - ML Pipeline과 Tuning 소개와 실습

July 23, 2021 4 minute read

Spark MLlib 모델 튜닝 소개 Spark MLlib 모델 튜닝 최적의 하이퍼 파라미터 선택 최적의 모델 혹은 모델의 파라미터를 찾는 것이 아주 중요 하나씩 테스트해보는 것 vs. 다수를 동시 테스트 하는 것 모델 선택의 중요한 ...

07-22 Live Session

July 22, 2021 less than 1 minute read

Spark 이란 Pandas의 스테로이드 버전 + SQL + Scikit-learn + Streaming

Object Detection Models

July 22, 2021 less than 1 minute read

Big data - Spark MLlib 소개와 머신러닝 모델 빌딩

July 21, 2021 6 minute read

Spark MLlib 소개 머신러닝 관련 다양한 알고리즘, 유틸리티로 구성된 라이브러리 Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, … ...

Big data - SparkSQL을 이용한 데이터 분석

July 21, 2021 10 minute read

커리어 이야기 남과 비교하지 말고 앞으로 20-30년을 보기 하나를 하기로 했으면 적어도 6개월은 파고 들기 너무 빨리 포기하지 않기 뭔가 잘 안되면 서두르기 보다는 오히려 천천히 가기 공부를 위한 공부를 하기 보다는 일을 ...

Big data - Spark

July 19, 2021 6 minute read

빅데이터 기술이란 Spark 소개 판다스와 비교 Spark 실습

Big data

July 19, 2021 6 minute read

데이터 팀의 역할 데이터 팀의 미션 신뢰할 수 있는 데이터를 바탕으로 부가가치 생성

Project Fashion mmfashion

July 11, 2021 1 minute read

Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...

07-01 Live Session

July 8, 2021 3 minute read

Live Session 커리어 어떤 기술을 아느냐가 아닌 결과를 내는데 초점

SQL Analysis - 트랜잭션과 기타 고급 SQL 문법

July 8, 2021 10 minute read

숙제1 리뷰 사용자별로 처음 채널과 마지막 채널 알아내기 ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE 사용자 251번의 시간순으로 봤을 때 첫 번째 채널과 마지막 채널은 무엇인가? 아래 쿼리를 실행해서 처음과 마지막 채널을 보면 ...

SQL Analysis - JOIN & 리뷰

July 7, 2021 10 minute read

JOIN SQL 조인은 두 개 혹은 그 이상의 테이블들을 공통 필드를 가지고 MERGE 하는데 사용됨. 이는 스타 스키마로 구성된 테이블들로 분산되어 있던 정보를 통합하는 데 사용. JOIN의 결과는 방식에 상관없이 양쪽의 필드를 모두 가진 새로운 테이블을 만들어내게 됨. 조...

SQL Analysis - GROUP BY & CTAS

July 7, 2021 4 minute read

GROUP BY와 AGGREGATE 함수 테이블의 레코드를 그룹핑하여 그룹별로 다양한 정보를 계산 이는 두 단계로 이루어짐 그룹핑을 할 필드를 결정 (하나 이상의 필드가 될 수 있음) GROUP BY로 지정 (필드 이름...

SQL Analysis - SELECT

July 6, 2021 5 minute read

Redshift 론치 데모 예제 테이블 소개 사용자 ID: 웹서비스에서 등록된 사용자마다 부여하는 유일한 ID 세션 ID: 세션마다 부여되는 ID 세션: 사용자의 방문을 논리적인 단위로 나눈 것 사용자가 방문 후 30분...

SQL Analysis - SQL & DB

July 6, 2021 4 minute read

SQL의 중요성 데이터 관련 3개의 직군 데이터 엔지니어 Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop 데이터 분석가 ...

NN basics - RNN

July 5, 2021 5 minute read

Sequential Data 표현 벡터의 벡터 \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). 사전 ...

NN basics - DL Optimization

July 2, 2021 9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) “The function we want to minimize or maximize is called the objective function, ...

cs231n Assignment

July 2, 2021 10 minute read

1. 예제 따라하고, 개인 Github 정리하기 CNN

07-01 Live Session

July 1, 2021 1 minute read

GAP (Global Average Pooling) import torch.nn.functional as F x = F.adaptive_avg_pool2d(x, (1, 1))

NN basics - DL Basics

July 1, 2021 2 minute read

Computer Vision’s Difficulties 관점의 변화로 인해 같은 대상이라도 픽셀값이 다름. 배경과 피사체의 구분이 어려움. 조명에 따른 변화 대상의 기형적 형태 가려진 형태 같은 클래스안에서의 변화가 큼

NN basics - MLP

June 30, 2021 5 minute read

퍼셉트론 퍼셉트론의 동작 내적에 의한 선형과 활성함수에 의한 비선형에 의해 의미를 구분. 결국엔 공간의 분할을 만든다. 선형대수에서 w라는 가중치에 input을 내적하고 w에 projection했을때, 그 값이 0이면 직교하는 것이고, 0을 기준으로 비선형적 요소로 +1, -1로 ...

NN basics - ML & Math

June 29, 2021 10 minute read

To do 편미분 (partial derivative)

NN basics - ML Intro

June 28, 2021 4 minute read

To do Gradient Boost XGBoost

ML basics - Technical Parts - Linear Models for Classification

June 27, 2021 less than 1 minute read

06-24 Live Session

June 24, 2021 2 minute read

CS & Calculus background

ML basics - Linear Models for Classification

June 23, 2021 28 minute read

선형분류의 목표와 방법들

ML basics - Linear Models for Regression

June 23, 2021 15 minute read

선형 기저 함수 모델 가장 단순한 형태의 선형모델

Live Session 0622

June 22, 2021 less than 1 minute read

Underprediction \(t_{i}\): target label(i-th sample) \(y_{i}\): model’s prediction

Assignment - KNN

June 21, 2021 3 minute read

This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier

ML basics - Probability Distributions 2

June 20, 2021 20 minute read

가우시안 분포 (Gaussian Distribution)

ML basics - Probability Distributions 1

June 16, 2021 6 minute read

밀도추정(Density Estimation) \(N\)개의 관찰데이터(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)가 주어졌을 때 분포함수 \(p(\mathbf{x})\)를 찾는 것

Live Session 06/15

June 15, 2021 less than 1 minute read

Live Session with 강창성 박사님

ML basics - L2 regularization & Decision Region of MultiClassClassifier (python)

June 14, 2021 less than 1 minute read

Appendix Reference https://vivek-singh.medium.com/an-introduction-to-gradient-descent-54775b55ba4f https://jermwatt.github.io/machine_learning_refined/not...

ML basics - Linear Algebra

June 10, 2021 24 minute read

왜 선형대수를 알아야 하는가?

ML basics - Decision Theory & Linear Regression

June 7, 2021 6 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

ML basics - MSE & MAE

June 6, 2021 4 minute read

Dataset   Restaurant Location Cuisines AverageCost MinimumOrder Rating Votes Reviews De...

ML basics - Probability Part 2

June 2, 2021 10 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

ML basics - Probability Part 1

June 1, 2021 3 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

Django Chart Visualization

May 27, 2021 4 minute read

1. Add chart.js and jquery (layouts.html) This is currently located at head, but later I’ve to move those scripts down to the end of the body tag. <!-- ...

Django Deploy - pythonanywhere

May 25, 2021 1 minute read

Deploy Django Wep app - Pyhonanywhere

Django HTML Extension with Issue & Solution

May 24, 2021 less than 1 minute read

Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...

Django Static with Debug Mode

May 23, 2021 less than 1 minute read

Django Static & Debug Mode Keep in mind. If Debug = False, even though you correctly impletmented your static files, Django do not load any of your stati...

Django Basic - Create an Introduction Page and Models

May 19, 2021 3 minute read

Basic Setting make project: $ django-admin startproject webproj

Django Basic - Part 2

May 17, 2021 2 minute read

Model Django can have ORM (Object Relational DB) and sql.

Django Basic - Part 1

May 17, 2021 2 minute read

MVT Pattern

Flask API with Swagger

May 14, 2021 less than 1 minute read

Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run

Flask Connection to DB with SQLAlchemy - RESTful APIs

May 8, 2021 2 minute read

Flask and SQLAlchemy - RESTful APIs - connect to DB Flask Shell - create db fist Run Flask Shell on conda env or venv: flask shell ```flask f...

Git Pull Request (PR) - Project Contribution

May 5, 2021 2 minute read

Git Pull Request 다 적고보니 너무 자세하게 적은 것 같기도 하다.

Numpy & LinearAlgebra

May 3, 2021 3 minute read

Numpy

Numpy Array Broadcasting

April 30, 2021 1 minute read

Numpy Array Broadcasting

N Queen

April 30, 2021 1 minute read

Backtracking 대표 문제 Backtracking 대표적 문제라고 한다.

SVD

April 29, 2021 less than 1 minute read

In Linear Algebra Course, SVD is one of matrix decomposition methods. (such as LU, QR)

Cross Entropy

April 29, 2021 1 minute read

Entropy

ML Basics - todo

July 15, 2021 less than 1 minute read

정리할 것

Autoencoder Naver d2

July 15, 2021 less than 1 minute read

Autoencoder

Project Fashion mmfashion

July 11, 2021 1 minute read

Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...

SQL Analysis - 트랜잭션과 기타 고급 SQL 문법

July 8, 2021 10 minute read

숙제1 리뷰 사용자별로 처음 채널과 마지막 채널 알아내기 ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE 사용자 251번의 시간순으로 봤을 때 첫 번째 채널과 마지막 채널은 무엇인가? 아래 쿼리를 실행해서 처음과 마지막 채널을 보면 ...

SQL Analysis - JOIN & 리뷰

July 7, 2021 10 minute read

JOIN SQL 조인은 두 개 혹은 그 이상의 테이블들을 공통 필드를 가지고 MERGE 하는데 사용됨. 이는 스타 스키마로 구성된 테이블들로 분산되어 있던 정보를 통합하는 데 사용. JOIN의 결과는 방식에 상관없이 양쪽의 필드를 모두 가진 새로운 테이블을 만들어내게 됨. 조...

SQL Analysis - GROUP BY & CTAS

July 7, 2021 4 minute read

GROUP BY와 AGGREGATE 함수 테이블의 레코드를 그룹핑하여 그룹별로 다양한 정보를 계산 이는 두 단계로 이루어짐 그룹핑을 할 필드를 결정 (하나 이상의 필드가 될 수 있음) GROUP BY로 지정 (필드 이름...

SQL Analysis - SELECT

July 6, 2021 5 minute read

Redshift 론치 데모 예제 테이블 소개 사용자 ID: 웹서비스에서 등록된 사용자마다 부여하는 유일한 ID 세션 ID: 세션마다 부여되는 ID 세션: 사용자의 방문을 논리적인 단위로 나눈 것 사용자가 방문 후 30분...

SQL Analysis - SQL & DB

July 6, 2021 4 minute read

SQL의 중요성 데이터 관련 3개의 직군 데이터 엔지니어 Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop 데이터 분석가 ...

NN basics - RNN

July 5, 2021 5 minute read

Sequential Data 표현 벡터의 벡터 \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). 사전 ...

NN basics - DL Optimization

July 2, 2021 9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) “The function we want to minimize or maximize is called the objective function, ...

cs231n Assignment

July 2, 2021 10 minute read

1. 예제 따라하고, 개인 Github 정리하기 CNN

NN basics - DL Basics

July 1, 2021 2 minute read

Computer Vision’s Difficulties 관점의 변화로 인해 같은 대상이라도 픽셀값이 다름. 배경과 피사체의 구분이 어려움. 조명에 따른 변화 대상의 기형적 형태 가려진 형태 같은 클래스안에서의 변화가 큼

NN basics - MLP

June 30, 2021 5 minute read

퍼셉트론 퍼셉트론의 동작 내적에 의한 선형과 활성함수에 의한 비선형에 의해 의미를 구분. 결국엔 공간의 분할을 만든다. 선형대수에서 w라는 가중치에 input을 내적하고 w에 projection했을때, 그 값이 0이면 직교하는 것이고, 0을 기준으로 비선형적 요소로 +1, -1로 ...

NN basics - ML & Math

June 29, 2021 10 minute read

To do 편미분 (partial derivative)

NN basics - ML Intro

June 28, 2021 4 minute read

To do Gradient Boost XGBoost

ML basics - Technical Parts - Linear Models for Classification

June 27, 2021 less than 1 minute read

ML basics - Linear Models for Classification

June 23, 2021 28 minute read

선형분류의 목표와 방법들

ML basics - Linear Models for Regression

June 23, 2021 15 minute read

선형 기저 함수 모델 가장 단순한 형태의 선형모델

Assignment - KNN

June 21, 2021 3 minute read

This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier

ML basics - Probability Distributions 2

June 20, 2021 20 minute read

가우시안 분포 (Gaussian Distribution)

ML basics - Probability Distributions 1

June 16, 2021 6 minute read

밀도추정(Density Estimation) \(N\)개의 관찰데이터(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)가 주어졌을 때 분포함수 \(p(\mathbf{x})\)를 찾는 것

ML basics - L2 regularization & Decision Region of MultiClassClassifier (python)

June 14, 2021 less than 1 minute read

Appendix Reference https://vivek-singh.medium.com/an-introduction-to-gradient-descent-54775b55ba4f https://jermwatt.github.io/machine_learning_refined/not...

ML basics - Linear Algebra

June 10, 2021 24 minute read

왜 선형대수를 알아야 하는가?

ML basics - Decision Theory & Linear Regression

June 7, 2021 6 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

ML basics - MSE & MAE

June 6, 2021 4 minute read

Dataset   Restaurant Location Cuisines AverageCost MinimumOrder Rating Votes Reviews De...

ML basics - Probability Part 2

June 2, 2021 10 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

ML basics - Probability Part 1

June 1, 2021 3 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

Aligning Equations in mathjax

May 11, 2021 less than 1 minute read

Align Equations in mathjax format \(\begin{align} \sqrt{37} & = \sqrt{\frac{73^2-1}{12^2}} \\ & = \sqrt{\frac{73^2}{12^2}\cdot\frac{73^2-1}{73^2}} \...

FGAN Proj - Docker compose up with submodules as CICD

October 13, 2021 less than 1 minute read

clone proj from gitlab

Docker Registry

September 26, 2021 less than 1 minute read

https://www.44bits.io/ko/post/running-docker-registry-and-using-s3-storage

Docker Redis

September 26, 2021 less than 1 minute read

Redis with Docker get redis image from docker hub Docker image pull redis redis-cli와 같이 구동해야 됨. 두 컨테이너를 연결...

Bitbucket Pipeline runners

September 26, 2021 less than 1 minute read

create pipeline write bitbucket-pipelines.yml commit pipelines.yml file run docker at local (test runners in local env) ...

Docker Orchestration Tool

September 12, 2021 less than 1 minute read

Docker Orchestration Tool: Portainer (Web UI)

Backend using RabbitMQ and Celery with docker

September 8, 2021 1 minute read

Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.

Coco Annotator install and usage

August 25, 2021 less than 1 minute read

Coco Annotator 설치

Docker Container push

August 18, 2021 less than 1 minute read

Dockerhub에 Push 까지 하는 경우 private repository는 한개까지만 가능하고 더 쓰려면 유료 플랜에 가입해야 한다.

Docker Jupyter lab access denied

August 18, 2021 less than 1 minute read

환경 local에서 server에 있는 docker container에서 jupyter lab으로 접속

Docker Container memory shortage

August 3, 2021 less than 1 minute read

Error Message: RuntimeError: DataLoader worker (pid 4301) is killed by signal: Bus error. It is possible that dataloader's workers are out of shared memory. ...

Docker Remote-Containers: Attach to running container

August 3, 2021 less than 1 minute read

서버에 있는 docker container에 vscode로 접속하는 방법이다.

Apply K-fashion 3rd solution to deepfashion2 dataset

August 1, 2021 1 minute read

3등 솔루션에서 DetectoRS 를 쓴 이유?(추측) instance-segmentation에서 그 당시 SOTA 였기 때문에 https://paperswithcode.com/sota/instance-segmentation-on-coco

Docker gpu and jupyter lab

July 31, 2021 less than 1 minute read

도커에서 Container 포트와 Host 포트의 개념

Docker run through bind mount and assign name on container

July 29, 2021 less than 1 minute read

docker run with bind_mount and assign name to the container docker run -d -v `pwd`:/whale_test -it --name docker123456 mydocker

Docker Volume vs Bind Mount

July 28, 2021 less than 1 minute read

👉 Reference: https://www.daleseo.com/docker-volumes-bind-mounts/

Docker Build

July 27, 2021 less than 1 minute read

Build Docker Image & run, start, stop and exit container by using shell command $ bash docker/build.sh

Examine Dacon K-fashion 3rd solution with Docker

July 26, 2021 5 minute read

git repo https://github.com/dacon-ai/K-Fashion-3rd

Docker install on ubuntu

July 25, 2021 5 minute read

Setup the docker via Repository 1. Update the apt package index and install packages to allow apt to use a repository over HTTPS: $ sudo apt-get update $ sud...

ML Basics - todo

July 15, 2021 less than 1 minute read

정리할 것

ML basics - Technical Parts - Linear Models for Classification

June 27, 2021 less than 1 minute read

ML basics - Linear Models for Classification

June 23, 2021 28 minute read

선형분류의 목표와 방법들

ML basics - Linear Models for Regression

June 23, 2021 15 minute read

선형 기저 함수 모델 가장 단순한 형태의 선형모델

ML basics - Probability Distributions 2

June 20, 2021 20 minute read

가우시안 분포 (Gaussian Distribution)

ML basics - Probability Distributions 1

June 16, 2021 6 minute read

밀도추정(Density Estimation) \(N\)개의 관찰데이터(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)가 주어졌을 때 분포함수 \(p(\mathbf{x})\)를 찾는 것

ML basics - L2 regularization & Decision Region of MultiClassClassifier (python)

June 14, 2021 less than 1 minute read

Appendix Reference https://vivek-singh.medium.com/an-introduction-to-gradient-descent-54775b55ba4f https://jermwatt.github.io/machine_learning_refined/not...

ML basics - Linear Algebra

June 10, 2021 24 minute read

왜 선형대수를 알아야 하는가?

ML basics - Decision Theory & Linear Regression

June 7, 2021 6 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

ML basics - MSE & MAE

June 6, 2021 4 minute read

Dataset   Restaurant Location Cuisines AverageCost MinimumOrder Rating Votes Reviews De...

ML basics - Probability Part 2

June 2, 2021 10 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

ML basics - Probability Part 1

June 1, 2021 3 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

name == main

October 22, 2021 4 minute read

if name == “main”: To better understand why and how this matters, we need to take a step back to understand how Python initializes scripts and how this inter...

Python GMP

October 21, 2021 less than 1 minute read

Python GMP

Pytorch IterableDataset

September 29, 2021 less than 1 minute read

https://inmoonlight.github.io/2021/02/21/PyTorch-IterableDataset/

python concurrent futures

September 29, 2021 less than 1 minute read

```py import time data = [] start = time.time() from concurrent.futures import ThreadPoolExecutor import concurrent.futures

Python underbar underscore naminig

September 27, 2021 less than 1 minute read

4-1. 언더바가 앞에 하나 붙은 경우 (ex: _variable) 이 경우는 모듈 내에서만 해당 변수/함수를 사용하겠다는 의미입니다.(private) 특히 협업을 할 때 다른 팀원에게 ‘이 변수/함수는 이 모듈 내부에서만 사용할 거다’라고 명시적으로 힌트를 줄 수 있습니다.

urllib parse unquote

September 26, 2021 less than 1 minute read

urllib.parse.unquote(string, encoding=’utf-8’, errors=’replace’) Replace %xx escapes with their single-character equivalent. The optional encoding and err...

Coroutines and Tasks

September 26, 2021 less than 1 minute read

Coroutines and Tasks

Python Regex

August 18, 2021 less than 1 minute read

Regex 자주 사용하는 문자 클래스

Rename files with Python using os.rename

August 4, 2021 less than 1 minute read

```py import os def changeName(path, cName): i = 1 for filename in os.listdir(path): print(path+filename, ‘=>’, path+str(cName)+str(i)+’....

Rename files with Python using os.rename

August 4, 2021 less than 1 minute read

```py import os def changeName(path, cName): i = 1 for filename in os.listdir(path): print(path+filename, ‘=>’, path+str(cName)+str(i)+’....

Chapter4 - Induction, Recursion, and Reduction - Part2

May 11, 2021 16 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter4 - Induction, Recursion, and Reduction - Part1

May 10, 2021 8 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Recursion and Recurrence(2)

May 10, 2021 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Recursion and Recurrence(1)

May 6, 2021 6 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Sums

May 4, 2021 7 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(1)

May 1, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Python complexity

May 1, 2021 less than 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Python List

May 1, 2021 less than 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Utterances install in github blog

October 21, 2021 less than 1 minute read

Utterances 설치해서 댓글 기능 추가하기

Jekyll serve error: address already in use - bind(2) for 127.0.0.1:4000

July 27, 2021 less than 1 minute read

Problem After unexpectedly reload vscode for updating vscode, as I served jekyll from local host by bundle exec jekyll serve, jekyll 3.9.1 | Error: Address ...

Jupyter Notebook to GithubBlog

June 27, 2021 less than 1 minute read

Failed so far.. with Jupyter Lab

Markdown Named Anchor

June 26, 2021 less than 1 minute read

```markdown go to header 1 go to header 2 go to header 3

Create back-to-top button in minimal-mistakes-theme

June 16, 2021 less than 1 minute read

Reference https://masunii.github.io/blog_custom/top_button/

Minimal Mistakes Utility - Image Size Modification

June 1, 2021 less than 1 minute read

Minimal-Mistakes Style Sheet Structure Got a hint from: https://github.com/mmistakes/minimal-mistakes/issues/1583 {: .align-right .wid...

Jekyll unmodifided code block

May 17, 2021 less than 1 minute read

While writing django code snippet, I found that it hides double curly brackets( {{}} ). Since Jekyll uses the Liquid templating language to process templates...

Aligning Equations in mathjax

May 11, 2021 less than 1 minute read

Align Equations in mathjax format \(\begin{align} \sqrt{37} & = \sqrt{\frac{73^2-1}{12^2}} \\ & = \sqrt{\frac{73^2}{12^2}\cdot\frac{73^2-1}{73^2}} \...

오늘의 삽질 - insert image in minimal mistakes

May 6, 2021 less than 1 minute read

아무 생각 없이 이미지를 _site/assets/images 에 이미지를 새로 삽입하려고 하니 자꾸 이미지가 삭제되는 것이였다… vscode remote connection이 문제인가 싶어 server 가서 dir에다 넣어도 보고 connection도 다시 해봤지만 계속 삭제 되길래

FGAN Proj - Docker compose up with submodules as CICD

October 13, 2021 less than 1 minute read

clone proj from gitlab

Coco Annotator install and usage

August 25, 2021 less than 1 minute read

Coco Annotator 설치

K-Fashion preprocessing

August 19, 2021 less than 1 minute read

K-Fashion Dataset Preprocessing To-do list json: coco format으로 json 만들어 줘야 함 mv: data root 재설정 rename: 파일이름에 공백과 괄호 등이 존재

StarGAN V2 - hpf(high-pass-filter)

August 19, 2021 less than 1 minute read

hpf

MMdetection Train & Inference

August 4, 2021 less than 1 minute read

Train

Apply K-fashion 3rd solution to deepfashion2 dataset

August 1, 2021 1 minute read

3등 솔루션에서 DetectoRS 를 쓴 이유?(추측) instance-segmentation에서 그 당시 SOTA 였기 때문에 https://paperswithcode.com/sota/instance-segmentation-on-coco

Examine Dacon K-fashion 3rd solution with Docker

July 26, 2021 5 minute read

git repo https://github.com/dacon-ai/K-Fashion-3rd

Project Fashion mmfashion

July 11, 2021 1 minute read

Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...

Kaggle - Sartorius Cell Instance Segmentation

December 31, 2021 less than 1 minute read

Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task

Heart Datathon 2021

December 8, 2021 less than 1 minute read

Detection Metrics Dice Coefficient \[Dice = \frac{2 |A∩B|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]

Small Intestine Lesion Detection

November 23, 2021 less than 1 minute read

Task: Object Detection of Small Intesine Lesion

NoonBody SemanticSegmentation

November 6, 2021 1 minute read

Task: Semantic Segmentation of Body labels are come from DensePose. Using these body labels, inference body parts.

Conda Vs. Pip

November 4, 2021 less than 1 minute read

conda 로 환경 만들어서 torch install을 conda로 했더니 cuda False가 되버려서 버전 문제인줄 알았더니 pip install 로 하니 문제 없이 cuda 사용 가능하게 되었다.

OpenSlide Usages

November 4, 2021 less than 1 minute read

OpenSlide lib 사용방법

Setup Env with conda

November 1, 2021 less than 1 minute read

대회마다 패키지 버전 이슈가 있을 수 있기 때문에 대회 참여할 때마다 다른 conda 환경을 만들어주고 시작하는게 좋다고 생각한다.

Setup DL Environment in Competition Container

October 21, 2021 less than 1 minute read

의료 대회에서 container로 진행하다보니 필요한 파일들을 가상환경처럼 설치한 후 컨테이너 재시작을 하면 다 날아가 버린다. 이에 따라 마운트 된 backup directory에 설치 및 저장 후 사용해야 하는데

Django Chart Visualization

May 27, 2021 4 minute read

1. Add chart.js and jquery (layouts.html) This is currently located at head, but later I’ve to move those scripts down to the end of the body tag. <!-- ...

Django Deploy - pythonanywhere

May 25, 2021 1 minute read

Deploy Django Wep app - Pyhonanywhere

Django HTML Extension with Issue & Solution

May 24, 2021 less than 1 minute read

Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...

Django Static with Debug Mode

May 23, 2021 less than 1 minute read

Django Static & Debug Mode Keep in mind. If Debug = False, even though you correctly impletmented your static files, Django do not load any of your stati...

Django Basic - Create an Introduction Page and Models

May 19, 2021 3 minute read

Basic Setting make project: $ django-admin startproject webproj

Django Basic - Part 2

May 17, 2021 2 minute read

Model Django can have ORM (Object Relational DB) and sql.

Django Basic - Part 1

May 17, 2021 2 minute read

MVT Pattern

Django Chart Visualization

May 27, 2021 4 minute read

1. Add chart.js and jquery (layouts.html) This is currently located at head, but later I’ve to move those scripts down to the end of the body tag. <!-- ...

Django Deploy - pythonanywhere

May 25, 2021 1 minute read

Deploy Django Wep app - Pyhonanywhere

Django HTML Extension with Issue & Solution

May 24, 2021 less than 1 minute read

Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...

Django Static with Debug Mode

May 23, 2021 less than 1 minute read

Django Static & Debug Mode Keep in mind. If Debug = False, even though you correctly impletmented your static files, Django do not load any of your stati...

Django Basic - Create an Introduction Page and Models

May 19, 2021 3 minute read

Basic Setting make project: $ django-admin startproject webproj

Django Basic - Part 2

May 17, 2021 2 minute read

Model Django can have ORM (Object Relational DB) and sql.

Django Basic - Part 1

May 17, 2021 2 minute read

MVT Pattern

ML Basics - todo

July 15, 2021 less than 1 minute read

정리할 것

Autoencoder Naver d2

July 15, 2021 less than 1 minute read

Autoencoder

Project Fashion mmfashion

July 11, 2021 1 minute read

Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...

NN basics - RNN

July 5, 2021 5 minute read

Sequential Data 표현 벡터의 벡터 \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). 사전 ...

NN basics - DL Optimization

July 2, 2021 9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) “The function we want to minimize or maximize is called the objective function, ...

NN basics - DL Basics

July 1, 2021 2 minute read

Computer Vision’s Difficulties 관점의 변화로 인해 같은 대상이라도 픽셀값이 다름. 배경과 피사체의 구분이 어려움. 조명에 따른 변화 대상의 기형적 형태 가려진 형태 같은 클래스안에서의 변화가 큼

Pandas DL Code Snippet

June 5, 2021 2 minute read

Code Snippet

NN basics - RNN

July 5, 2021 5 minute read

Sequential Data 표현 벡터의 벡터 \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). 사전 ...

NN basics - DL Optimization

July 2, 2021 9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) “The function we want to minimize or maximize is called the objective function, ...

cs231n Assignment

July 2, 2021 10 minute read

1. 예제 따라하고, 개인 Github 정리하기 CNN

NN basics - DL Basics

July 1, 2021 2 minute read

Computer Vision’s Difficulties 관점의 변화로 인해 같은 대상이라도 픽셀값이 다름. 배경과 피사체의 구분이 어려움. 조명에 따른 변화 대상의 기형적 형태 가려진 형태 같은 클래스안에서의 변화가 큼

NN basics - MLP

June 30, 2021 5 minute read

퍼셉트론 퍼셉트론의 동작 내적에 의한 선형과 활성함수에 의한 비선형에 의해 의미를 구분. 결국엔 공간의 분할을 만든다. 선형대수에서 w라는 가중치에 input을 내적하고 w에 projection했을때, 그 값이 0이면 직교하는 것이고, 0을 기준으로 비선형적 요소로 +1, -1로 ...

NN basics - ML & Math

June 29, 2021 10 minute read

To do 편미분 (partial derivative)

NN basics - ML Intro

June 28, 2021 4 minute read

To do Gradient Boost XGBoost

Faster RCNN

August 7, 2021 less than 1 minute read

Appendix Reference https://medium.datadriveninvestor.com/review-on-fast-rcnn-202c9eadd23b 2021 Lecture 15 Detection and Segmentation http://cs231n.stanfor...

NLP - Transformer and BERT

August 2, 2021 10 minute read

ML 모델 이해를 위한 팁 복잡한 ML 모델을 이해하기 위해서 다음과 같은 순서를 따라갈 것 이 모델이 풀려고 하는 문제는 무엇인가 추론 단계를 먼저 이해. “학습”된 모델이 어떤 “입력”을 받아어 어떤 “출력”을 계산하는지 파악할 것 ...

NLP - Assignment 1: subword sentencepiece embedding

August 2, 2021 less than 1 minute read

1번문제: https://direction-f.tistory.com/29 2번문제: http://yonghee.io/word-embedding-pytorchword2vec/

NLP - Word Embedding

July 30, 2021 8 minute read

Word Embedding 단어의 의미를 어떻게 나타낼 것인가 좋은 표현 방식: 단어간의 관계를 잘 표현할 수 있어야 함

NLP - Document Classification

July 28, 2021 6 minute read

문서 분류 (Text Classification) 문서 분류란 입력으로 받아, 텍스트가 어떤 종류의 범주에 속하는지를 구분하는 작업 다양한 문서 분류 문제 문서의 범주, 주제 분류 이메일 스팸 분류 감성 분류 언어 분류 ...

NLP - Language Model

July 27, 2021 5 minute read

언어모델 다음 문장 다음에 이어질 단어는? Please turn your homework in or the ? 다음 두 문장 중 나타날 확률이 더 높은 것은? ...

NLP - text preprocessing

July 26, 2021 5 minute read

Intro 자연어의 의미를 컴퓨터로 분석해서 특정작업을 위해 사용할 수 있도록 하는 것 응용분야 기계번역 감성분석 문서분류 질의응답시스템 챗봇 언어생성 음성인식 추천시스템 ...

Embedded system

October 21, 2021 less than 1 minute read

Embedded system

First-class citizen

October 21, 2021 less than 1 minute read

programming In programming language design, a first-class citizen (also type, object, entity, or value) in a given programming language is an entity which su...

vscode jupyter kernel

September 29, 2021 less than 1 minute read

python -m ipykernel install --user --name AI_hub_pre --display-name AI_hub_kernel

run jupyter notebook background with tmux

September 29, 2021 less than 1 minute read

https://deeplearning.lipingyang.org/2018/03/29/run-jupyter-notebook-from-terminal-with-tmux/

Linux tar

August 18, 2021 less than 1 minute read

extract tar

tmux installation and commands

August 4, 2021 less than 1 minute read

remote ssh와 remote container로 작업하다보니

Download Gdrive file via wget or gdown

July 29, 2021 less than 1 minute read

Wget 링크 생성(링크가 있는 모든 사용자에게 공개) wget 쿠키 설정으로 다운로드 wget --load-cookies ~/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget -...

Google Data Analytics Professional Certificate - Course 2 : Ask Questions to Make Data-Driven Decisions - week 2

October 13, 2021 less than 1 minute read

Week 2 - Understand the power of data Data-driven: Data-inspired: Explores different data sources to find out what they have in common. Algorithm: An algorit...

Google Data Analytics Professional Certificate - Course 2 : Ask Questions to Make Data-Driven Decisions - week 1

October 12, 2021 7 minute read

Week 1 - Problem-solving and effective questioning Structured thinking is the process of recognizing the current problem or situation, organizing available i...

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 5

October 12, 2021 less than 1 minute read

Week 5 - The importance of fair business decisions

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 4

October 12, 2021 4 minute read

Week 4 - SQL What is a query?

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 3

October 12, 2021 4 minute read

Week 3 - Follow the data life cycle The life cycle of data is plan, capture, manage, analyze, archive and destroy.

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 2

October 11, 2021 4 minute read

Week 2 - Embrace your data analyst skills Curiosity Curiosity is all about wanting to learn something. Curious people usually seek out new chal...

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 1

October 11, 2021 5 minute read

TOC of 8 weeks course Foundations: Data, Data, Everywhere (this course) Ask Questions to Make Data-Driven Decisions Prepare Data for Exploration Pro...

Google Data Analytics Professional Certificate - Course 2 : Ask Questions to Make Data-Driven Decisions - week 2

October 13, 2021 less than 1 minute read

Week 2 - Understand the power of data Data-driven: Data-inspired: Explores different data sources to find out what they have in common. Algorithm: An algorit...

Google Data Analytics Professional Certificate - Course 2 : Ask Questions to Make Data-Driven Decisions - week 1

October 12, 2021 7 minute read

Week 1 - Problem-solving and effective questioning Structured thinking is the process of recognizing the current problem or situation, organizing available i...

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 5

October 12, 2021 less than 1 minute read

Week 5 - The importance of fair business decisions

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 4

October 12, 2021 4 minute read

Week 4 - SQL What is a query?

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 3

October 12, 2021 4 minute read

Week 3 - Follow the data life cycle The life cycle of data is plan, capture, manage, analyze, archive and destroy.

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 2

October 11, 2021 4 minute read

Week 2 - Embrace your data analyst skills Curiosity Curiosity is all about wanting to learn something. Curious people usually seek out new chal...

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 1

October 11, 2021 5 minute read

TOC of 8 weeks course Foundations: Data, Data, Everywhere (this course) Ask Questions to Make Data-Driven Decisions Prepare Data for Exploration Pro...

Kaggle - Sartorius Cell Instance Segmentation

December 31, 2021 less than 1 minute read

Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task

Heart Datathon 2021

December 8, 2021 less than 1 minute read

Detection Metrics Dice Coefficient \[Dice = \frac{2 |A∩B|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]

NoonBody SemanticSegmentation

November 6, 2021 1 minute read

Task: Semantic Segmentation of Body labels are come from DensePose. Using these body labels, inference body parts.

Conda Vs. Pip

November 4, 2021 less than 1 minute read

conda 로 환경 만들어서 torch install을 conda로 했더니 cuda False가 되버려서 버전 문제인줄 알았더니 pip install 로 하니 문제 없이 cuda 사용 가능하게 되었다.

OpenSlide Usages

November 4, 2021 less than 1 minute read

OpenSlide lib 사용방법

Setup Env with conda

November 1, 2021 less than 1 minute read

대회마다 패키지 버전 이슈가 있을 수 있기 때문에 대회 참여할 때마다 다른 conda 환경을 만들어주고 시작하는게 좋다고 생각한다.

Setup DL Environment in Competition Container

October 21, 2021 less than 1 minute read

의료 대회에서 container로 진행하다보니 필요한 파일들을 가상환경처럼 설치한 후 컨테이너 재시작을 하면 다 날아가 버린다. 이에 따라 마운트 된 backup directory에 설치 및 저장 후 사용해야 하는데

Git Reset Modes: soft, mixed, hard

December 8, 2021 less than 1 minute read

commit을 reset해서 이전 commit 지점으로 돌아갈 필요가 있는 경우가 존재한다.

Git checkout submodule

September 26, 2021 less than 1 minute read

다른 branch로 checkout 할때 submodule 이 없을 경우 submodule init을 해주고 update –recursive를 해줘야 함.

Git checkout from commit

September 26, 2021 less than 1 minute read

특정 commit으로 부터 새로운 브랜치를 checkout 하는 cmd

Git Credential

September 11, 2021 less than 1 minute read

git credential로 암호키 매번 입력안해도 숨긴상태에서 git clone 가능하게 할 수 있다.

Git Large File push Error and Solution

May 7, 2021 less than 1 minute read

Plotting 과제 push하다가 100MB 넘는 파일을 push하려고 하니 error가 났다. 100MB 이상 파일 올리려면 Git LFS(Large File Storage)를 사용해야 한다는데 굳이 올리지 않아도 된다면, 에러만 해결하고 다시 PUSH 하고 싶다면 아래 링크를...

Git Pull Request (PR) - Project Contribution

May 5, 2021 2 minute read

Git Pull Request 다 적고보니 너무 자세하게 적은 것 같기도 하다.

07-22 Live Session

July 22, 2021 less than 1 minute read

Spark 이란 Pandas의 스테로이드 버전 + SQL + Scikit-learn + Streaming

07-01 Live Session

July 8, 2021 3 minute read

Live Session 커리어 어떤 기술을 아느냐가 아닌 결과를 내는데 초점

07-01 Live Session

July 1, 2021 1 minute read

GAP (Global Average Pooling) import torch.nn.functional as F x = F.adaptive_avg_pool2d(x, (1, 1))

06-24 Live Session

June 24, 2021 2 minute read

CS & Calculus background

Live Session 0622

June 22, 2021 less than 1 minute read

Underprediction \(t_{i}\): target label(i-th sample) \(y_{i}\): model’s prediction

Live Session 06/15

June 15, 2021 less than 1 minute read

Live Session with 강창성 박사님

NN basics - RNN

July 5, 2021 5 minute read

Sequential Data 표현 벡터의 벡터 \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). 사전 ...

NN basics - DL Optimization

July 2, 2021 9 minute read

Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) “The function we want to minimize or maximize is called the objective function, ...

NN basics - DL Basics

July 1, 2021 2 minute read

Computer Vision’s Difficulties 관점의 변화로 인해 같은 대상이라도 픽셀값이 다름. 배경과 피사체의 구분이 어려움. 조명에 따른 변화 대상의 기형적 형태 가려진 형태 같은 클래스안에서의 변화가 큼

NN basics - MLP

June 30, 2021 5 minute read

퍼셉트론 퍼셉트론의 동작 내적에 의한 선형과 활성함수에 의한 비선형에 의해 의미를 구분. 결국엔 공간의 분할을 만든다. 선형대수에서 w라는 가중치에 input을 내적하고 w에 projection했을때, 그 값이 0이면 직교하는 것이고, 0을 기준으로 비선형적 요소로 +1, -1로 ...

NN basics - ML & Math

June 29, 2021 10 minute read

To do 편미분 (partial derivative)

NN basics - ML Intro

June 28, 2021 4 minute read

To do Gradient Boost XGBoost

Small Intestine Lesion Detection

November 23, 2021 less than 1 minute read

Task: Object Detection of Small Intesine Lesion

YOLOv5 🚀 Custom dataset training and inference

August 9, 2021 less than 1 minute read

YOLOv5 🚀

Detectron Review

August 9, 2021 less than 1 minute read

Detectron

Faster RCNN

August 7, 2021 less than 1 minute read

Appendix Reference https://medium.datadriveninvestor.com/review-on-fast-rcnn-202c9eadd23b 2021 Lecture 15 Detection and Segmentation http://cs231n.stanfor...

MMdetection Train & Inference

August 4, 2021 less than 1 minute read

Train

Object Detection Models

July 22, 2021 less than 1 minute read

NLP - Transformer and BERT

August 2, 2021 10 minute read

ML 모델 이해를 위한 팁 복잡한 ML 모델을 이해하기 위해서 다음과 같은 순서를 따라갈 것 이 모델이 풀려고 하는 문제는 무엇인가 추론 단계를 먼저 이해. “학습”된 모델이 어떤 “입력”을 받아어 어떤 “출력”을 계산하는지 파악할 것 ...

NLP - Assignment 1: subword sentencepiece embedding

August 2, 2021 less than 1 minute read

1번문제: https://direction-f.tistory.com/29 2번문제: http://yonghee.io/word-embedding-pytorchword2vec/

NLP - Word Embedding

July 30, 2021 8 minute read

Word Embedding 단어의 의미를 어떻게 나타낼 것인가 좋은 표현 방식: 단어간의 관계를 잘 표현할 수 있어야 함

NLP - Document Classification

July 28, 2021 6 minute read

문서 분류 (Text Classification) 문서 분류란 입력으로 받아, 텍스트가 어떤 종류의 범주에 속하는지를 구분하는 작업 다양한 문서 분류 문제 문서의 범주, 주제 분류 이메일 스팸 분류 감성 분류 언어 분류 ...

NLP - Language Model

July 27, 2021 5 minute read

언어모델 다음 문장 다음에 이어질 단어는? Please turn your homework in or the ? 다음 두 문장 중 나타날 확률이 더 높은 것은? ...

NLP - text preprocessing

July 26, 2021 5 minute read

Intro 자연어의 의미를 컴퓨터로 분석해서 특정작업을 위해 사용할 수 있도록 하는 것 응용분야 기계번역 감성분석 문서분류 질의응답시스템 챗봇 언어생성 음성인식 추천시스템 ...

Google Data Analytics Professional Certificate - Course 2 : Ask Questions to Make Data-Driven Decisions - week 2

October 13, 2021 less than 1 minute read

Week 2 - Understand the power of data Data-driven: Data-inspired: Explores different data sources to find out what they have in common. Algorithm: An algorit...

Google Data Analytics Professional Certificate - Course 2 : Ask Questions to Make Data-Driven Decisions - week 1

October 12, 2021 7 minute read

Week 1 - Problem-solving and effective questioning Structured thinking is the process of recognizing the current problem or situation, organizing available i...

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 5

October 12, 2021 less than 1 minute read

Week 5 - The importance of fair business decisions

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 4

October 12, 2021 4 minute read

Week 4 - SQL What is a query?

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 3

October 12, 2021 4 minute read

Week 3 - Follow the data life cycle The life cycle of data is plan, capture, manage, analyze, archive and destroy.

Google Data Analytics Professional Certificate - Course 1 : Foundations: Data, Data, Everywhere - week 2

October 11, 2021 4 minute read

Week 2 - Embrace your data analyst skills Curiosity Curiosity is all about wanting to learn something. Curious people usually seek out new chal...

Heap Sort Implementation

October 28, 2021 2 minute read

코드 구현 원칙 수도코드보고 구현 실패시, 코드보고 코멘트 달고 작성해보기 재귀로 구현 완성 iterative version 구현하기

Merge Sort Implementation

October 26, 2021 2 minute read

Pseudo Code

Quick Sort Implementation

October 26, 2021 1 minute read

Pseudo Code 기준점(pivot)을 정한다. (4가지 방법 존재) Always pick first element as pivot. Always pick last element as pivot (implemented below) ...

Bubble Sort Implementation

October 26, 2021 less than 1 minute read

Pseudo Code adjacent elements 끼리 비교한다. 어떻게 sorted가 되었는지 판단하는가(종료조건) 2-1. 첫 pass를 통과하면 마지막 원소는 무조건 가장 큰 원소가 됨 2-2. 따라서 pass 할 때마다 뒤에서부터 정렬이 되는 알고리즘 2-...

N Queen

April 30, 2021 1 minute read

Backtracking 대표 문제 Backtracking 대표적 문제라고 한다.

Chapter4 - Induction, Recursion, and Reduction - Part2

May 11, 2021 16 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter4 - Induction, Recursion, and Reduction - Part1

May 10, 2021 8 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Recursion and Recurrence(2)

May 10, 2021 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Recursion and Recurrence(1)

May 6, 2021 6 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Sums

May 4, 2021 7 minute read

Book - Python Algorithms by Magnus Lie Hetland

SQL Analysis - 트랜잭션과 기타 고급 SQL 문법

July 8, 2021 10 minute read

숙제1 리뷰 사용자별로 처음 채널과 마지막 채널 알아내기 ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE 사용자 251번의 시간순으로 봤을 때 첫 번째 채널과 마지막 채널은 무엇인가? 아래 쿼리를 실행해서 처음과 마지막 채널을 보면 ...

SQL Analysis - JOIN & 리뷰

July 7, 2021 10 minute read

JOIN SQL 조인은 두 개 혹은 그 이상의 테이블들을 공통 필드를 가지고 MERGE 하는데 사용됨. 이는 스타 스키마로 구성된 테이블들로 분산되어 있던 정보를 통합하는 데 사용. JOIN의 결과는 방식에 상관없이 양쪽의 필드를 모두 가진 새로운 테이블을 만들어내게 됨. 조...

SQL Analysis - GROUP BY & CTAS

July 7, 2021 4 minute read

GROUP BY와 AGGREGATE 함수 테이블의 레코드를 그룹핑하여 그룹별로 다양한 정보를 계산 이는 두 단계로 이루어짐 그룹핑을 할 필드를 결정 (하나 이상의 필드가 될 수 있음) GROUP BY로 지정 (필드 이름...

SQL Analysis - SELECT

July 6, 2021 5 minute read

Redshift 론치 데모 예제 테이블 소개 사용자 ID: 웹서비스에서 등록된 사용자마다 부여하는 유일한 ID 세션 ID: 세션마다 부여되는 ID 세션: 사용자의 방문을 논리적인 단위로 나눈 것 사용자가 방문 후 30분...

SQL Analysis - SQL & DB

July 6, 2021 4 minute read

SQL의 중요성 데이터 관련 3개의 직군 데이터 엔지니어 Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop 데이터 분석가 ...

SQL Analysis - 트랜잭션과 기타 고급 SQL 문법

July 8, 2021 10 minute read

숙제1 리뷰 사용자별로 처음 채널과 마지막 채널 알아내기 ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE 사용자 251번의 시간순으로 봤을 때 첫 번째 채널과 마지막 채널은 무엇인가? 아래 쿼리를 실행해서 처음과 마지막 채널을 보면 ...

SQL Analysis - JOIN & 리뷰

July 7, 2021 10 minute read

JOIN SQL 조인은 두 개 혹은 그 이상의 테이블들을 공통 필드를 가지고 MERGE 하는데 사용됨. 이는 스타 스키마로 구성된 테이블들로 분산되어 있던 정보를 통합하는 데 사용. JOIN의 결과는 방식에 상관없이 양쪽의 필드를 모두 가진 새로운 테이블을 만들어내게 됨. 조...

SQL Analysis - GROUP BY & CTAS

July 7, 2021 4 minute read

GROUP BY와 AGGREGATE 함수 테이블의 레코드를 그룹핑하여 그룹별로 다양한 정보를 계산 이는 두 단계로 이루어짐 그룹핑을 할 필드를 결정 (하나 이상의 필드가 될 수 있음) GROUP BY로 지정 (필드 이름...

SQL Analysis - SELECT

July 6, 2021 5 minute read

Redshift 론치 데모 예제 테이블 소개 사용자 ID: 웹서비스에서 등록된 사용자마다 부여하는 유일한 ID 세션 ID: 세션마다 부여되는 ID 세션: 사용자의 방문을 논리적인 단위로 나눈 것 사용자가 방문 후 30분...

SQL Analysis - SQL & DB

July 6, 2021 4 minute read

SQL의 중요성 데이터 관련 3개의 직군 데이터 엔지니어 Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop 데이터 분석가 ...

Big data - ML Pipeline과 Tuning 소개와 실습

July 23, 2021 4 minute read

Spark MLlib 모델 튜닝 소개 Spark MLlib 모델 튜닝 최적의 하이퍼 파라미터 선택 최적의 모델 혹은 모델의 파라미터를 찾는 것이 아주 중요 하나씩 테스트해보는 것 vs. 다수를 동시 테스트 하는 것 모델 선택의 중요한 ...

Big data - Spark MLlib 소개와 머신러닝 모델 빌딩

July 21, 2021 6 minute read

Spark MLlib 소개 머신러닝 관련 다양한 알고리즘, 유틸리티로 구성된 라이브러리 Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, … ...

Big data - SparkSQL을 이용한 데이터 분석

July 21, 2021 10 minute read

커리어 이야기 남과 비교하지 말고 앞으로 20-30년을 보기 하나를 하기로 했으면 적어도 6개월은 파고 들기 너무 빨리 포기하지 않기 뭔가 잘 안되면 서두르기 보다는 오히려 천천히 가기 공부를 위한 공부를 하기 보다는 일을 ...

Big data - Spark

July 19, 2021 6 minute read

빅데이터 기술이란 Spark 소개 판다스와 비교 Spark 실습

Big data

July 19, 2021 6 minute read

데이터 팀의 역할 데이터 팀의 미션 신뢰할 수 있는 데이터를 바탕으로 부가가치 생성

Big data - ML Pipeline과 Tuning 소개와 실습

July 23, 2021 4 minute read

Spark MLlib 모델 튜닝 소개 Spark MLlib 모델 튜닝 최적의 하이퍼 파라미터 선택 최적의 모델 혹은 모델의 파라미터를 찾는 것이 아주 중요 하나씩 테스트해보는 것 vs. 다수를 동시 테스트 하는 것 모델 선택의 중요한 ...

Big data - Spark MLlib 소개와 머신러닝 모델 빌딩

July 21, 2021 6 minute read

Spark MLlib 소개 머신러닝 관련 다양한 알고리즘, 유틸리티로 구성된 라이브러리 Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, … ...

Big data - SparkSQL을 이용한 데이터 분석

July 21, 2021 10 minute read

커리어 이야기 남과 비교하지 말고 앞으로 20-30년을 보기 하나를 하기로 했으면 적어도 6개월은 파고 들기 너무 빨리 포기하지 않기 뭔가 잘 안되면 서두르기 보다는 오히려 천천히 가기 공부를 위한 공부를 하기 보다는 일을 ...

Big data - Spark

July 19, 2021 6 minute read

빅데이터 기술이란 Spark 소개 판다스와 비교 Spark 실습

Big data

July 19, 2021 6 minute read

데이터 팀의 역할 데이터 팀의 미션 신뢰할 수 있는 데이터를 바탕으로 부가가치 생성

Big data - ML Pipeline과 Tuning 소개와 실습

July 23, 2021 4 minute read

Spark MLlib 모델 튜닝 소개 Spark MLlib 모델 튜닝 최적의 하이퍼 파라미터 선택 최적의 모델 혹은 모델의 파라미터를 찾는 것이 아주 중요 하나씩 테스트해보는 것 vs. 다수를 동시 테스트 하는 것 모델 선택의 중요한 ...

Big data - Spark MLlib 소개와 머신러닝 모델 빌딩

July 21, 2021 6 minute read

Spark MLlib 소개 머신러닝 관련 다양한 알고리즘, 유틸리티로 구성된 라이브러리 Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, … ...

Big data - SparkSQL을 이용한 데이터 분석

July 21, 2021 10 minute read

커리어 이야기 남과 비교하지 말고 앞으로 20-30년을 보기 하나를 하기로 했으면 적어도 6개월은 파고 들기 너무 빨리 포기하지 않기 뭔가 잘 안되면 서두르기 보다는 오히려 천천히 가기 공부를 위한 공부를 하기 보다는 일을 ...

Big data - Spark

July 19, 2021 6 minute read

빅데이터 기술이란 Spark 소개 판다스와 비교 Spark 실습

Big data

July 19, 2021 6 minute read

데이터 팀의 역할 데이터 팀의 미션 신뢰할 수 있는 데이터를 바탕으로 부가가치 생성

Python - Sorting

December 4, 2021 8 minute read

Sorting

Heap Sort Implementation

October 28, 2021 2 minute read

코드 구현 원칙 수도코드보고 구현 실패시, 코드보고 코멘트 달고 작성해보기 재귀로 구현 완성 iterative version 구현하기

Merge Sort Implementation

October 26, 2021 2 minute read

Pseudo Code

Quick Sort Implementation

October 26, 2021 1 minute read

Pseudo Code 기준점(pivot)을 정한다. (4가지 방법 존재) Always pick first element as pivot. Always pick last element as pivot (implemented below) ...

Bubble Sort Implementation

October 26, 2021 less than 1 minute read

Pseudo Code adjacent elements 끼리 비교한다. 어떻게 sorted가 되었는지 판단하는가(종료조건) 2-1. 첫 pass를 통과하면 마지막 원소는 무조건 가장 큰 원소가 됨 2-2. 따라서 pass 할 때마다 뒤에서부터 정렬이 되는 알고리즘 2-...

ML basics - L2 regularization & Decision Region of MultiClassClassifier (python)

June 14, 2021 less than 1 minute read

Appendix Reference https://vivek-singh.medium.com/an-introduction-to-gradient-descent-54775b55ba4f https://jermwatt.github.io/machine_learning_refined/not...

ML basics - Linear Algebra

June 10, 2021 24 minute read

왜 선형대수를 알아야 하는가?

Numpy & LinearAlgebra

May 3, 2021 3 minute read

Numpy

SVD

April 29, 2021 less than 1 minute read

In Linear Algebra Course, SVD is one of matrix decomposition methods. (such as LU, QR)

Linux Disk Usage command

December 2, 2021 less than 1 minute read

du -bh --max-depth=1 | sort -hr | head

Understanding Linux network internals - day 1

October 14, 2021 10 minute read

This study is based on the book Understanding Linux network internals.

Linux tar

August 18, 2021 less than 1 minute read

extract tar

Change default shell in linux

April 29, 2021 1 minute read

Check current default shell ps -p $$ # or echo $0 # in my case # /bin/bash

ML Flow Tutorial

March 6, 2022 less than 1 minute read

MLOps 반복적인 작업을 해소할 수 있는 방법이면 다 MLOps 의 영역으로 간주한다.

FGAN Proj - Docker compose up with submodules as CICD

October 13, 2021 less than 1 minute read

clone proj from gitlab

GitLab runner

October 2, 2021 less than 1 minute read

Git lab runner로 이주 시작

Runners and ci-cd

September 27, 2021 less than 1 minute read

https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners

GitLab cicd starclass test

October 6, 2021 1 minute read

make test_run.py to pass with python uniitest 1-1. make cicd variables in settings.

GitLab cicd runner

October 5, 2021 2 minute read

DIND

GitLab runner

October 3, 2021 less than 1 minute read

bitbucket 용으로 ssh를 하나만 쓰다가

GitLab runner

October 2, 2021 less than 1 minute read

Git lab runner로 이주 시작

ML basics - Probability Part 2

June 2, 2021 10 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

ML basics - Probability Part 1

June 1, 2021 3 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

Cross Entropy

April 29, 2021 1 minute read

Entropy

Numpy & LinearAlgebra

May 3, 2021 3 minute read

Numpy

Chapter2 - The Basics - Graphs and Trees(1)

May 1, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Numpy Array Broadcasting

April 30, 2021 1 minute read

Numpy Array Broadcasting

Chapter3 - Counting 101 - Recursion and Recurrence(2)

May 10, 2021 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Recursion and Recurrence(1)

May 6, 2021 6 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Sums

May 4, 2021 7 minute read

Book - Python Algorithms by Magnus Lie Hetland

VSCode Editor tabs to wrap

May 19, 2021 less than 1 minute read

Go to setting: ctrl + , search: workbench.editor.wrapTabs Turn to True(as checked)

VSCode Update in linux

May 14, 2021 less than 1 minute read

sudo apt-get update sudo apt-get install code

Remote-ssh access in VSCode

May 11, 2021 1 minute read

Remote-ssh VScode install VSCODE press F1 Find Remote-SSH: Connect current window to Host (or Remote-SSH: Connect to Host) 만약 최초 config 만들어야 되면 4-1...

Jekyll serve error: address already in use - bind(2) for 127.0.0.1:4000

July 27, 2021 less than 1 minute read

Problem After unexpectedly reload vscode for updating vscode, as I served jekyll from local host by bundle exec jekyll serve, jekyll 3.9.1 | Error: Address ...

Jupyter Notebook to GithubBlog

June 27, 2021 less than 1 minute read

Failed so far.. with Jupyter Lab

Jekyll unmodifided code block

May 17, 2021 less than 1 minute read

While writing django code snippet, I found that it hides double curly brackets( {{}} ). Since Jekyll uses the Liquid templating language to process templates...

Django Chart Visualization

May 27, 2021 4 minute read

1. Add chart.js and jquery (layouts.html) This is currently located at head, but later I’ve to move those scripts down to the end of the body tag. <!-- ...

Django Deploy - pythonanywhere

May 25, 2021 1 minute read

Deploy Django Wep app - Pyhonanywhere

Django HTML Extension with Issue & Solution

May 24, 2021 less than 1 minute read

Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...

Git Reset Modes: soft, mixed, hard

December 8, 2021 less than 1 minute read

commit을 reset해서 이전 commit 지점으로 돌아갈 필요가 있는 경우가 존재한다.

Git checkout submodule

September 26, 2021 less than 1 minute read

다른 branch로 checkout 할때 submodule 이 없을 경우 submodule init을 해주고 update –recursive를 해줘야 함.

Git checkout from commit

September 26, 2021 less than 1 minute read

특정 commit으로 부터 새로운 브랜치를 checkout 하는 cmd

Conda Vs. Pip

November 4, 2021 less than 1 minute read

conda 로 환경 만들어서 torch install을 conda로 했더니 cuda False가 되버려서 버전 문제인줄 알았더니 pip install 로 하니 문제 없이 cuda 사용 가능하게 되었다.

OpenSlide Usages

November 4, 2021 less than 1 minute read

OpenSlide lib 사용방법

Setup DL Environment in Competition Container

October 21, 2021 less than 1 minute read

의료 대회에서 container로 진행하다보니 필요한 파일들을 가상환경처럼 설치한 후 컨테이너 재시작을 하면 다 날아가 버린다. 이에 따라 마운트 된 backup directory에 설치 및 저장 후 사용해야 하는데

Kaggle - Sartorius Cell Instance Segmentation

December 31, 2021 less than 1 minute read

Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task

Heart Datathon 2021

December 8, 2021 less than 1 minute read

Detection Metrics Dice Coefficient \[Dice = \frac{2 |A∩B|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]

Small Intestine Lesion Detection

November 23, 2021 less than 1 minute read

Task: Object Detection of Small Intesine Lesion

Git bash & conda in Windows

February 11, 2022 less than 1 minute read

Go to conda.sh location such as C:\Users\{your_username}\anaconda3\etc\profile.d Open git bash here by right click as Git ...

Change default shell in linux

April 29, 2021 1 minute read

Check current default shell ps -p $$ # or echo $0 # in my case # /bin/bash

Chapter3 - Counting 101 - Sums

May 4, 2021 7 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Python List

May 1, 2021 less than 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Sums

May 4, 2021 7 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Python List

May 1, 2021 less than 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(1)

May 1, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(1)

May 1, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(1)

May 1, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(1)

May 1, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(1)

May 1, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Git Large File push Error and Solution

May 7, 2021 less than 1 minute read

Plotting 과제 push하다가 100MB 넘는 파일을 push하려고 하니 error가 났다. 100MB 이상 파일 올리려면 Git LFS(Large File Storage)를 사용해야 한다는데 굳이 올리지 않아도 된다면, 에러만 해결하고 다시 PUSH 하고 싶다면 아래 링크를...

Git Pull Request (PR) - Project Contribution

May 5, 2021 2 minute read

Git Pull Request 다 적고보니 너무 자세하게 적은 것 같기도 하다.

Chapter3 - Counting 101 - Recursion and Recurrence(2)

May 10, 2021 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter3 - Counting 101 - Recursion and Recurrence(1)

May 6, 2021 6 minute read

Book - Python Algorithms by Magnus Lie Hetland

Flask API with Swagger

May 14, 2021 less than 1 minute read

Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run

Flask Connection to DB with SQLAlchemy - RESTful APIs

May 8, 2021 2 minute read

Flask and SQLAlchemy - RESTful APIs - connect to DB Flask Shell - create db fist Run Flask Shell on conda env or venv: flask shell ```flask f...

Flask API with Swagger

May 14, 2021 less than 1 minute read

Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run

Flask Connection to DB with SQLAlchemy - RESTful APIs

May 8, 2021 2 minute read

Flask and SQLAlchemy - RESTful APIs - connect to DB Flask Shell - create db fist Run Flask Shell on conda env or venv: flask shell ```flask f...

Flask API with Swagger

May 14, 2021 less than 1 minute read

Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run

Flask Connection to DB with SQLAlchemy - RESTful APIs

May 8, 2021 2 minute read

Flask and SQLAlchemy - RESTful APIs - connect to DB Flask Shell - create db fist Run Flask Shell on conda env or venv: flask shell ```flask f...

Flask API with Swagger

May 14, 2021 less than 1 minute read

Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run

Flask Connection to DB with SQLAlchemy - RESTful APIs

May 8, 2021 2 minute read

Flask and SQLAlchemy - RESTful APIs - connect to DB Flask Shell - create db fist Run Flask Shell on conda env or venv: flask shell ```flask f...

Chapter4 - Induction, Recursion, and Reduction - Part2

May 11, 2021 16 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter4 - Induction, Recursion, and Reduction - Part1

May 10, 2021 8 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter4 - Induction, Recursion, and Reduction - Part2

May 11, 2021 16 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter4 - Induction, Recursion, and Reduction - Part1

May 10, 2021 8 minute read

Book - Python Algorithms by Magnus Lie Hetland

Windows gitlab ssh

February 11, 2022 less than 1 minute read

Execute git bash by windows key command ssh-keygen Enter file in which to save the key (생성위치 정하는 파트) 기본경로로 할 예정이므로 ENTER ...

Remote-ssh access in VSCode

May 11, 2021 1 minute read

Remote-ssh VScode install VSCODE press F1 Find Remote-SSH: Connect current window to Host (or Remote-SSH: Connect to Host) 만약 최초 config 만들어야 되면 4-1...

Jekyll unmodifided code block

May 17, 2021 less than 1 minute read

While writing django code snippet, I found that it hides double curly brackets( {{}} ). Since Jekyll uses the Liquid templating language to process templates...

VSCode Update in linux

May 14, 2021 less than 1 minute read

sudo apt-get update sudo apt-get install code

ML basics - Probability Distributions 2

June 20, 2021 20 minute read

가우시안 분포 (Gaussian Distribution)

ML basics - Probability Distributions 1

June 16, 2021 6 minute read

밀도추정(Density Estimation) \(N\)개의 관찰데이터(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)가 주어졌을 때 분포함수 \(p(\mathbf{x})\)를 찾는 것

NLP - Assignment 1: subword sentencepiece embedding

August 2, 2021 less than 1 minute read

1번문제: https://direction-f.tistory.com/29 2번문제: http://yonghee.io/word-embedding-pytorchword2vec/

Assignment - KNN

June 21, 2021 3 minute read

This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier

ML basics - Technical Parts - Linear Models for Classification

June 27, 2021 less than 1 minute read

ML basics - Linear Models for Classification

June 23, 2021 28 minute read

선형분류의 목표와 방법들

Optimizers

October 21, 2021 1 minute read

Optimizers https://youtu.be/mdKjMPmcWjY

Autoencoder Naver d2

July 15, 2021 less than 1 minute read

Autoencoder

Big data - ML Pipeline과 Tuning 소개와 실습

July 23, 2021 4 minute read

Spark MLlib 모델 튜닝 소개 Spark MLlib 모델 튜닝 최적의 하이퍼 파라미터 선택 최적의 모델 혹은 모델의 파라미터를 찾는 것이 아주 중요 하나씩 테스트해보는 것 vs. 다수를 동시 테스트 하는 것 모델 선택의 중요한 ...

Big data - Spark MLlib 소개와 머신러닝 모델 빌딩

July 21, 2021 6 minute read

Spark MLlib 소개 머신러닝 관련 다양한 알고리즘, 유틸리티로 구성된 라이브러리 Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, … ...

Bitbucket Pipeline

September 27, 2021 less than 1 minute read

SSH key trouble shooting –build-arg ssh_prv_key=”$(cat ~/.ssh/id_rsa)” stargan

Bitbucket Pipeline runners

September 26, 2021 less than 1 minute read

create pipeline write bitbucket-pipelines.yml commit pipelines.yml file run docker at local (test runners in local env) ...

vscode jupyter kernel

September 29, 2021 less than 1 minute read

python -m ipykernel install --user --name AI_hub_pre --display-name AI_hub_kernel

run jupyter notebook background with tmux

September 29, 2021 less than 1 minute read

https://deeplearning.lipingyang.org/2018/03/29/run-jupyter-notebook-from-terminal-with-tmux/

GitLab cicd starclass test

October 6, 2021 1 minute read

make test_run.py to pass with python uniitest 1-1. make cicd variables in settings.

GitLab cicd runner

October 5, 2021 2 minute read

DIND

design scroll bar

October 25, 2021 less than 1 minute read

https://ansohxxn.github.io/blog/scrollbar/

create category UI

October 12, 2021 less than 1 minute read

https://ansohxxn.github.io/blog/category/

Python GMP

October 21, 2021 less than 1 minute read

Python GMP

First-class citizen

October 21, 2021 less than 1 minute read

programming In programming language design, a first-class citizen (also type, object, entity, or value) in a given programming language is an entity which su...

NoonBody SemanticSegmentation

November 6, 2021 1 minute read

Task: Semantic Segmentation of Body labels are come from DensePose. Using these body labels, inference body parts.

Setup Env with conda

November 1, 2021 less than 1 minute read

대회마다 패키지 버전 이슈가 있을 수 있기 때문에 대회 참여할 때마다 다른 conda 환경을 만들어주고 시작하는게 좋다고 생각한다.

Git bash & conda in Windows

February 11, 2022 less than 1 minute read

Go to conda.sh location such as C:\Users\{your_username}\anaconda3\etc\profile.d Open git bash here by right click as Git ...

conda export & import by yaml

November 29, 2021 less than 1 minute read

conda env export > environment.yaml or

Cross Entropy

April 29, 2021 1 minute read

Entropy

Change default shell in linux

April 29, 2021 1 minute read

Check current default shell ps -p $$ # or echo $0 # in my case # /bin/bash

Change default shell in linux

April 29, 2021 1 minute read

Check current default shell ps -p $$ # or echo $0 # in my case # /bin/bash

N Queen

April 30, 2021 1 minute read

Backtracking 대표 문제 Backtracking 대표적 문제라고 한다.

N Queen

April 30, 2021 1 minute read

Backtracking 대표 문제 Backtracking 대표적 문제라고 한다.

N Queen

April 30, 2021 1 minute read

Backtracking 대표 문제 Backtracking 대표적 문제라고 한다.

Chapter2 - The Basics - Python complexity

May 1, 2021 less than 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Python complexity

May 1, 2021 less than 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Python complexity

May 1, 2021 less than 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Python complexity

May 1, 2021 less than 1 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(1)

May 1, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter2 - The Basics - Graphs and Trees(2)

May 2, 2021 4 minute read

Book - Python Algorithms by Magnus Lie Hetland

Numpy & LinearAlgebra

May 3, 2021 3 minute read

Numpy

Numpy & LinearAlgebra

May 3, 2021 3 minute read

Numpy

Git Pull Request (PR) - Project Contribution

May 5, 2021 2 minute read

Git Pull Request 다 적고보니 너무 자세하게 적은 것 같기도 하다.

Chapter4 - Induction, Recursion, and Reduction - Part2

May 11, 2021 16 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter4 - Induction, Recursion, and Reduction - Part2

May 11, 2021 16 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter4 - Induction, Recursion, and Reduction - Part2

May 11, 2021 16 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter4 - Induction, Recursion, and Reduction - Part2

May 11, 2021 16 minute read

Book - Python Algorithms by Magnus Lie Hetland

Chapter4 - Induction, Recursion, and Reduction - Part2

May 11, 2021 16 minute read

Book - Python Algorithms by Magnus Lie Hetland

Remote-ssh access in VSCode

May 11, 2021 1 minute read

Remote-ssh VScode install VSCODE press F1 Find Remote-SSH: Connect current window to Host (or Remote-SSH: Connect to Host) 만약 최초 config 만들어야 되면 4-1...

Remote-ssh access in VSCode

May 11, 2021 1 minute read

Remote-ssh VScode install VSCODE press F1 Find Remote-SSH: Connect current window to Host (or Remote-SSH: Connect to Host) 만약 최초 config 만들어야 되면 4-1...

VSCode Update in linux

May 14, 2021 less than 1 minute read

sudo apt-get update sudo apt-get install code

Flask API with Swagger

May 14, 2021 less than 1 minute read

Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run

Django Deploy - pythonanywhere

May 25, 2021 1 minute read

Deploy Django Wep app - Pyhonanywhere

Minimal Mistakes Utility - Image Size Modification

June 1, 2021 less than 1 minute read

Minimal-Mistakes Style Sheet Structure Got a hint from: https://github.com/mmistakes/minimal-mistakes/issues/1583 {: .align-right .wid...

Interview Considerations

June 3, 2021 less than 1 minute read

Things to consider as an Interviewee

Interview Considerations

June 3, 2021 less than 1 minute read

Things to consider as an Interviewee

Pandas DL Code Snippet

June 5, 2021 2 minute read

Code Snippet

ML basics - Decision Theory & Linear Regression

June 7, 2021 6 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

ML basics - Decision Theory & Linear Regression

June 7, 2021 6 minute read

Deep Learning Model’s Outcome is the Probability of the Variable X

Ankle Supports

June 7, 2021 less than 1 minute read

하이엔드: 바우어파인트: 말레오트레인(평상시), 말레오스포츠(운동시) 게뉴트레인

Create back-to-top button in minimal-mistakes-theme

June 16, 2021 less than 1 minute read

Reference https://masunii.github.io/blog_custom/top_button/

Assignment - KNN

June 21, 2021 3 minute read

This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier

ML basics - Linear Models for Regression

June 23, 2021 15 minute read

선형 기저 함수 모델 가장 단순한 형태의 선형모델

Markdown Named Anchor

June 26, 2021 less than 1 minute read

```markdown go to header 1 go to header 2 go to header 3

Jupyter Notebook to GithubBlog

June 27, 2021 less than 1 minute read

Failed so far.. with Jupyter Lab

cs231n Assignment

July 2, 2021 10 minute read

1. 예제 따라하고, 개인 Github 정리하기 CNN

cs231n Assignment

July 2, 2021 10 minute read

1. 예제 따라하고, 개인 Github 정리하기 CNN

NN basics - RNN

July 5, 2021 5 minute read

Sequential Data 표현 벡터의 벡터 \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). 사전 ...

Download Gdrive file via wget or gdown

July 29, 2021 less than 1 minute read

Wget 링크 생성(링크가 있는 모든 사용자에게 공개) wget 쿠키 설정으로 다운로드 wget --load-cookies ~/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget -...

tmux installation and commands

August 4, 2021 less than 1 minute read

remote ssh와 remote container로 작업하다보니

Rename files with Python using os.rename

August 4, 2021 less than 1 minute read

```py import os def changeName(path, cName): i = 1 for filename in os.listdir(path): print(path+filename, ‘=>’, path+str(cName)+str(i)+’....

Python Regex

August 18, 2021 less than 1 minute read

Regex 자주 사용하는 문자 클래스

Coco Annotator install and usage

August 25, 2021 less than 1 minute read

Coco Annotator 설치

Backend using RabbitMQ and Celery with docker

September 8, 2021 1 minute read

Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.

Backend using RabbitMQ and Celery with docker

September 8, 2021 1 minute read

Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.

Backend using RabbitMQ and Celery with docker

September 8, 2021 1 minute read

Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.

Docker Redis

September 26, 2021 less than 1 minute read

Redis with Docker get redis image from docker hub Docker image pull redis redis-cli와 같이 구동해야 됨. 두 컨테이너를 연결...

Coroutines and Tasks

September 26, 2021 less than 1 minute read

Coroutines and Tasks

Coroutines and Tasks

September 26, 2021 less than 1 minute read

Coroutines and Tasks

urllib parse unquote

September 26, 2021 less than 1 minute read

urllib.parse.unquote(string, encoding=’utf-8’, errors=’replace’) Replace %xx escapes with their single-character equivalent. The optional encoding and err...

urllib parse unquote

September 26, 2021 less than 1 minute read

urllib.parse.unquote(string, encoding=’utf-8’, errors=’replace’) Replace %xx escapes with their single-character equivalent. The optional encoding and err...

Bitbucket Pipeline

September 27, 2021 less than 1 minute read

SSH key trouble shooting –build-arg ssh_prv_key=”$(cat ~/.ssh/id_rsa)” stargan

Pytorch IterableDataset

September 29, 2021 less than 1 minute read

https://inmoonlight.github.io/2021/02/21/PyTorch-IterableDataset/

FGAN Proj - Docker compose up with submodules as CICD

October 13, 2021 less than 1 minute read

clone proj from gitlab

Understanding Linux network internals - day 1

October 14, 2021 10 minute read

This study is based on the book Understanding Linux network internals.

Build Basic Generative Adversarial Networks (GANs)

October 14, 2021 3 minute read

Generative Adversarial Networks (GANs) Specialization offered by DeepLearning.AI

Build Basic Generative Adversarial Networks (GANs)

October 14, 2021 3 minute read

Generative Adversarial Networks (GANs) Specialization offered by DeepLearning.AI

Build Basic Generative Adversarial Networks (GANs)

October 14, 2021 3 minute read

Generative Adversarial Networks (GANs) Specialization offered by DeepLearning.AI

Multiprocessing and Fork

October 20, 2021 less than 1 minute read

multiprocessing in Windows not working sinc

Embedded system

October 21, 2021 less than 1 minute read

Embedded system

Conda Vs. Pip

November 4, 2021 less than 1 minute read

conda 로 환경 만들어서 torch install을 conda로 했더니 cuda False가 되버려서 버전 문제인줄 알았더니 pip install 로 하니 문제 없이 cuda 사용 가능하게 되었다.

Conda Vs. Pip

November 4, 2021 less than 1 minute read

conda 로 환경 만들어서 torch install을 conda로 했더니 cuda False가 되버려서 버전 문제인줄 알았더니 pip install 로 하니 문제 없이 cuda 사용 가능하게 되었다.

conda export & import by yaml

November 29, 2021 less than 1 minute read

conda env export > environment.yaml or

Python - Sorting

December 4, 2021 8 minute read

Sorting

Heart Datathon 2021

December 8, 2021 less than 1 minute read

Detection Metrics Dice Coefficient \[Dice = \frac{2 |A∩B|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]

Kaggle - Sartorius Cell Instance Segmentation

December 31, 2021 less than 1 minute read

Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task

Git bash & conda in Windows

February 11, 2022 less than 1 minute read

Go to conda.sh location such as C:\Users\{your_username}\anaconda3\etc\profile.d Open git bash here by right click as Git ...

Windows gitlab ssh

February 11, 2022 less than 1 minute read

Execute git bash by windows key command ssh-keygen Enter file in which to save the key (생성위치 정하는 파트) 기본경로로 할 예정이므로 ENTER ...

Windows gitlab ssh

February 11, 2022 less than 1 minute read

Execute git bash by windows key command ssh-keygen Enter file in which to save the key (생성위치 정하는 파트) 기본경로로 할 예정이므로 ENTER ...

ML Flow Tutorial

March 6, 2022 less than 1 minute read

MLOps 반복적인 작업을 해소할 수 있는 방법이면 다 MLOps 의 영역으로 간주한다.

시작

August 12, 2023 10 minute read

시작하게 된 이유 대체 뭘 시작하느냐에 대한 답은. 생각의 정리 및 살면서 드는 생각들 및 일하면서 느꼈던 것에 대한 회고이다. 왜 시작하게 되었는가. 일한지 1년이 지나고 내 딴에는 일하는 환경도 크게 바뀌진 않았지만, 종전까지는 혼자 일하고 책임지는 환경에서 아마도 팀원들을 꾸...