FGAN Proj - Docker compose up with submodules as CICD
clone proj from gitlab
clone proj from gitlab
git stash
git credentialλ‘ μνΈν€ λ§€λ² μ λ ₯μν΄λ μ¨κΈ΄μνμμ git clone κ°λ₯νκ² ν μ μλ€.
Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.
Coco Annotator μ€μΉ
K-Fashion Dataset Preprocessing To-do list json: coco formatμΌλ‘ json λ§λ€μ΄ μ€μΌ ν¨ mv: data root μ¬μ€μ rename: νμΌμ΄λ¦μ 곡백과 κ΄νΈ λ±μ΄ μ‘΄μ¬
Detectron
Appendix Reference https://medium.datadriveninvestor.com/review-on-fast-rcnn-202c9eadd23b 2021 Lecture 15 Detection and Segmentation http://cs231n.stanfor...
ML λͺ¨λΈ μ΄ν΄λ₯Ό μν ν 볡μ‘ν ML λͺ¨λΈμ μ΄ν΄νκΈ° μν΄μ λ€μκ³Ό κ°μ μμλ₯Ό λ°λΌκ° κ² μ΄ λͺ¨λΈμ΄ νλ €κ³ νλ λ¬Έμ λ 무μμΈκ° μΆλ‘ λ¨κ³λ₯Ό λ¨Όμ μ΄ν΄. βνμ΅βλ λͺ¨λΈμ΄ μ΄λ€ βμ λ ₯βμ λ°μμ΄ μ΄λ€ βμΆλ ₯βμ κ³μ°νλμ§ νμ ν κ² ...
1λ²λ¬Έμ : https://direction-f.tistory.com/29 2λ²λ¬Έμ : http://yonghee.io/word-embedding-pytorchword2vec/
3λ± μ루μ μμ DetectoRS λ₯Ό μ΄ μ΄μ ?(μΆμΈ‘) instance-segmentationμμ κ·Έ λΉμ SOTA μκΈ° λλ¬Έμ https://paperswithcode.com/sota/instance-segmentation-on-coco
Word Embedding λ¨μ΄μ μλ―Έλ₯Ό μ΄λ»κ² λνλΌ κ²μΈκ° μ’μ νν λ°©μ: λ¨μ΄κ°μ κ΄κ³λ₯Ό μ ννν μ μμ΄μΌ ν¨
docker run with bind_mount and assign name to the container docker run -d -v `pwd`:/whale_test -it --name docker123456 mydocker
λ¬Έμ λΆλ₯ (Text Classification) λ¬Έμ λΆλ₯λ μ λ ₯μΌλ‘ λ°μ, ν μ€νΈκ° μ΄λ€ μ’ λ₯μ λ²μ£Όμ μνλμ§λ₯Ό ꡬλΆνλ μμ λ€μν λ¬Έμ λΆλ₯ λ¬Έμ λ¬Έμμ λ²μ£Ό, μ£Όμ λΆλ₯ μ΄λ©μΌ μ€νΈ λΆλ₯ κ°μ± λΆλ₯ μΈμ΄ λΆλ₯ ...
π Reference: https://www.daleseo.com/docker-volumes-bind-mounts/
Build Docker Image & run, start, stop and exit container by using shell command $ bash docker/build.sh
μΈμ΄λͺ¨λΈ λ€μ λ¬Έμ₯ λ€μμ μ΄μ΄μ§ λ¨μ΄λ? Please turn your homework in or the ? λ€μ λ λ¬Έμ₯ μ€ λνλ νλ₯ μ΄ λ λμ κ²μ? ...
Intro μμ°μ΄μ μλ―Έλ₯Ό μ»΄ν¨ν°λ‘ λΆμν΄μ νΉμ μμ μ μν΄ μ¬μ©ν μ μλλ‘ νλ κ² μμ©λΆμΌ κΈ°κ³λ²μ κ°μ±λΆμ λ¬ΈμλΆλ₯ μ§μμλ΅μμ€ν μ±λ΄ μΈμ΄μμ± μμ±μΈμ μΆμ²μμ€ν ...
Spark MLlib λͺ¨λΈ νλ μκ° Spark MLlib λͺ¨λΈ νλ μ΅μ μ νμ΄νΌ νλΌλ―Έν° μ ν μ΅μ μ λͺ¨λΈ νΉμ λͺ¨λΈμ νλΌλ―Έν°λ₯Ό μ°Ύλ κ²μ΄ μμ£Ό μ€μ νλμ© ν μ€νΈν΄λ³΄λ κ² vs. λ€μλ₯Ό λμ ν μ€νΈ νλ κ² λͺ¨λΈ μ νμ μ€μν ...
Spark μ΄λ Pandasμ μ€ν λ‘μ΄λ λ²μ + SQL + Scikit-learn + Streaming
Spark MLlib μκ° λ¨Έμ λ¬λ κ΄λ ¨ λ€μν μκ³ λ¦¬μ¦, μ νΈλ¦¬ν°λ‘ ꡬμ±λ λΌμ΄λΈλ¬λ¦¬ Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, β¦ ...
μ»€λ¦¬μ΄ μ΄μΌκΈ° λ¨κ³Ό λΉκ΅νμ§ λ§κ³ μμΌλ‘ 20-30λ μ 보기 νλλ₯Ό νκΈ°λ‘ νμΌλ©΄ μ μ΄λ 6κ°μμ νκ³ λ€κΈ° λ무 빨리 ν¬κΈ°νμ§ μκΈ° λκ° μ μλλ©΄ μλλ₯΄κΈ° 보λ€λ μ€νλ € μ²μ²ν κ°κΈ° 곡λΆλ₯Ό μν 곡λΆλ₯Ό νκΈ° 보λ€λ μΌμ ...
λΉ λ°μ΄ν° κΈ°μ μ΄λ Spark μκ° νλ€μ€μ λΉκ΅ Spark μ€μ΅
λ°μ΄ν° νμ μν λ°μ΄ν° νμ λ―Έμ μ λ’°ν μ μλ λ°μ΄ν°λ₯Ό λ°νμΌλ‘ λΆκ°κ°μΉ μμ±
Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...
Live Session μ»€λ¦¬μ΄ μ΄λ€ κΈ°μ μ μλλκ° μλ κ²°κ³Όλ₯Ό λ΄λλ° μ΄μ
μμ 1 리뷰 μ¬μ©μλ³λ‘ μ²μ μ±λκ³Ό λ§μ§λ§ μ±λ μμλ΄κΈ° ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE μ¬μ©μ 251λ²μ μκ°μμΌλ‘ λ΄€μ λ 첫 λ²μ§Έ μ±λκ³Ό λ§μ§λ§ μ±λμ 무μμΈκ°? μλ 쿼리λ₯Ό μ€νν΄μ μ²μκ³Ό λ§μ§λ§ μ±λμ 보면 ...
JOIN SQL μ‘°μΈμ λ κ° νΉμ κ·Έ μ΄μμ ν μ΄λΈλ€μ κ³΅ν΅ νλλ₯Ό κ°μ§κ³ MERGE νλλ° μ¬μ©λ¨. μ΄λ μ€ν μ€ν€λ§λ‘ ꡬμ±λ ν μ΄λΈλ€λ‘ λΆμ°λμ΄ μλ μ 보λ₯Ό ν΅ν©νλ λ° μ¬μ©. JOINμ κ²°κ³Όλ λ°©μμ μκ΄μμ΄ μμͺ½μ νλλ₯Ό λͺ¨λ κ°μ§ μλ‘μ΄ ν μ΄λΈμ λ§λ€μ΄λ΄κ² λ¨. μ‘°...
GROUP BYμ AGGREGATE ν¨μ ν μ΄λΈμ λ μ½λλ₯Ό κ·Έλ£Ήννμ¬ κ·Έλ£Ήλ³λ‘ λ€μν μ 보λ₯Ό κ³μ° μ΄λ λ λ¨κ³λ‘ μ΄λ£¨μ΄μ§ κ·Έλ£Ήνμ ν νλλ₯Ό κ²°μ (νλ μ΄μμ νλκ° λ μ μμ) GROUP BYλ‘ μ§μ (νλ μ΄λ¦...
Redshift λ‘ μΉ λ°λͺ¨ μμ ν μ΄λΈ μκ° μ¬μ©μ ID: μΉμλΉμ€μμ λ±λ‘λ μ¬μ©μλ§λ€ λΆμ¬νλ μ μΌν ID μΈμ ID: μΈμ λ§λ€ λΆμ¬λλ ID μΈμ : μ¬μ©μμ λ°©λ¬Έμ λ Όλ¦¬μ μΈ λ¨μλ‘ λλ κ² μ¬μ©μκ° λ°©λ¬Έ ν 30λΆ...
SQLμ μ€μμ± λ°μ΄ν° κ΄λ ¨ 3κ°μ μ§κ΅° λ°μ΄ν° μμ§λμ΄ Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop λ°μ΄ν° λΆμκ° ...
Sequential Data νν 벑ν°μ λ²‘ν° \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). μ¬μ ...
Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) βThe function we want to minimize or maximize is called the objective function, ...
1. μμ λ°λΌνκ³ , κ°μΈ Github μ 리νκΈ° CNN
GAP (Global Average Pooling) import torch.nn.functional as F x = F.adaptive_avg_pool2d(x, (1, 1))
Computer Visionβs Difficulties κ΄μ μ λ³νλ‘ μΈν΄ κ°μ λμμ΄λΌλ ν½μ κ°μ΄ λ€λ¦. λ°°κ²½κ³Ό νΌμ¬μ²΄μ ꡬλΆμ΄ μ΄λ €μ. μ‘°λͺ μ λ°λ₯Έ λ³ν λμμ κΈ°νμ νν κ°λ €μ§ νν κ°μ ν΄λμ€μμμμ λ³νκ° νΌ
νΌμ νΈλ‘ νΌμ νΈλ‘ μ λμ λ΄μ μ μν μ νκ³Ό νμ±ν¨μμ μν λΉμ νμ μν΄ μλ―Έλ₯Ό ꡬλΆ. κ²°κ΅μ 곡κ°μ λΆν μ λ§λ λ€. μ νλμμμ wλΌλ κ°μ€μΉμ inputμ λ΄μ νκ³ wμ projectionνμλ, κ·Έ κ°μ΄ 0μ΄λ©΄ μ§κ΅νλ κ²μ΄κ³ , 0μ κΈ°μ€μΌλ‘ λΉμ νμ μμλ‘ +1, -1λ‘ ...
To do νΈλ―ΈλΆ (partial derivative)
To do Gradient Boost XGBoost
CS & Calculus background
μ νλΆλ₯μ λͺ©νμ λ°©λ²λ€
μ ν κΈ°μ ν¨μ λͺ¨λΈ κ°μ₯ λ¨μν ννμ μ νλͺ¨λΈ
Underprediction \(t_{i}\): target label(i-th sample) \(y_{i}\): modelβs prediction
This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier
κ°μ°μμ λΆν¬ (Gaussian Distribution)
λ°λμΆμ (Density Estimation) \(N\)κ°μ κ΄μ°°λ°μ΄ν°(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)κ° μ£Όμ΄μ‘μ λ λΆν¬ν¨μ \(p(\mathbf{x})\)λ₯Ό μ°Ύλ κ²
Live Session with κ°μ°½μ± λ°μ¬λ
Appendix Reference https://vivek-singh.medium.com/an-introduction-to-gradient-descent-54775b55ba4f https://jermwatt.github.io/machine_learning_refined/not...
μ μ νλμλ₯Ό μμμΌ νλκ°?
Deep Learning Modelβs Outcome is the Probability of the Variable X
Dataset Restaurant Location Cuisines AverageCost MinimumOrder Rating Votes Reviews De...
Deep Learning Modelβs Outcome is the Probability of the Variable X
Deep Learning Modelβs Outcome is the Probability of the Variable X
1. Add chart.js and jquery (layouts.html) This is currently located at head, but later Iβve to move those scripts down to the end of the body tag. <!-- ...
Deploy Django Wep app - Pyhonanywhere
Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...
Django Static & Debug Mode Keep in mind. If Debug = False, even though you correctly impletmented your static files, Django do not load any of your stati...
Basic Setting make project: $ django-admin startproject webproj
Model Django can have ORM (Object Relational DB) and sql.
MVT Pattern
Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run
Flask and SQLAlchemy - RESTful APIs - connect to DB Flask Shell - create db fist Run Flask Shell on conda env or venv: flask shell ```flask f...
Plotting κ³Όμ pushνλ€κ° 100MB λλ νμΌμ pushνλ €κ³ νλ errorκ° λ¬λ€. 100MB μ΄μ νμΌ μ¬λ¦¬λ €λ©΄ Git LFS(Large File Storage)λ₯Ό μ¬μ©ν΄μΌ νλ€λλ° κ΅³μ΄ μ¬λ¦¬μ§ μμλ λλ€λ©΄, μλ¬λ§ ν΄κ²°νκ³ λ€μ PUSH νκ³ μΆλ€λ©΄ μλ λ§ν¬λ₯Ό...
Git Pull Request λ€ μ κ³ λ³΄λ λ무 μμΈνκ² μ μ κ² κ°κΈ°λ νλ€.
Numpy
Numpy Array Broadcasting
Backtracking λν λ¬Έμ Backtracking λνμ λ¬Έμ λΌκ³ νλ€.
In Linear Algebra Course, SVD is one of matrix decomposition methods. (such as LU, QR)
Entropy
μ 리ν κ²
Autoencoder
Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...
μμ 1 리뷰 μ¬μ©μλ³λ‘ μ²μ μ±λκ³Ό λ§μ§λ§ μ±λ μμλ΄κΈ° ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE μ¬μ©μ 251λ²μ μκ°μμΌλ‘ λ΄€μ λ 첫 λ²μ§Έ μ±λκ³Ό λ§μ§λ§ μ±λμ 무μμΈκ°? μλ 쿼리λ₯Ό μ€νν΄μ μ²μκ³Ό λ§μ§λ§ μ±λμ 보면 ...
JOIN SQL μ‘°μΈμ λ κ° νΉμ κ·Έ μ΄μμ ν μ΄λΈλ€μ κ³΅ν΅ νλλ₯Ό κ°μ§κ³ MERGE νλλ° μ¬μ©λ¨. μ΄λ μ€ν μ€ν€λ§λ‘ ꡬμ±λ ν μ΄λΈλ€λ‘ λΆμ°λμ΄ μλ μ 보λ₯Ό ν΅ν©νλ λ° μ¬μ©. JOINμ κ²°κ³Όλ λ°©μμ μκ΄μμ΄ μμͺ½μ νλλ₯Ό λͺ¨λ κ°μ§ μλ‘μ΄ ν μ΄λΈμ λ§λ€μ΄λ΄κ² λ¨. μ‘°...
GROUP BYμ AGGREGATE ν¨μ ν μ΄λΈμ λ μ½λλ₯Ό κ·Έλ£Ήννμ¬ κ·Έλ£Ήλ³λ‘ λ€μν μ 보λ₯Ό κ³μ° μ΄λ λ λ¨κ³λ‘ μ΄λ£¨μ΄μ§ κ·Έλ£Ήνμ ν νλλ₯Ό κ²°μ (νλ μ΄μμ νλκ° λ μ μμ) GROUP BYλ‘ μ§μ (νλ μ΄λ¦...
Redshift λ‘ μΉ λ°λͺ¨ μμ ν μ΄λΈ μκ° μ¬μ©μ ID: μΉμλΉμ€μμ λ±λ‘λ μ¬μ©μλ§λ€ λΆμ¬νλ μ μΌν ID μΈμ ID: μΈμ λ§λ€ λΆμ¬λλ ID μΈμ : μ¬μ©μμ λ°©λ¬Έμ λ Όλ¦¬μ μΈ λ¨μλ‘ λλ κ² μ¬μ©μκ° λ°©λ¬Έ ν 30λΆ...
SQLμ μ€μμ± λ°μ΄ν° κ΄λ ¨ 3κ°μ μ§κ΅° λ°μ΄ν° μμ§λμ΄ Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop λ°μ΄ν° λΆμκ° ...
Sequential Data νν 벑ν°μ λ²‘ν° \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). μ¬μ ...
Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) βThe function we want to minimize or maximize is called the objective function, ...
1. μμ λ°λΌνκ³ , κ°μΈ Github μ 리νκΈ° CNN
Computer Visionβs Difficulties κ΄μ μ λ³νλ‘ μΈν΄ κ°μ λμμ΄λΌλ ν½μ κ°μ΄ λ€λ¦. λ°°κ²½κ³Ό νΌμ¬μ²΄μ ꡬλΆμ΄ μ΄λ €μ. μ‘°λͺ μ λ°λ₯Έ λ³ν λμμ κΈ°νμ νν κ°λ €μ§ νν κ°μ ν΄λμ€μμμμ λ³νκ° νΌ
νΌμ νΈλ‘ νΌμ νΈλ‘ μ λμ λ΄μ μ μν μ νκ³Ό νμ±ν¨μμ μν λΉμ νμ μν΄ μλ―Έλ₯Ό ꡬλΆ. κ²°κ΅μ 곡κ°μ λΆν μ λ§λ λ€. μ νλμμμ wλΌλ κ°μ€μΉμ inputμ λ΄μ νκ³ wμ projectionνμλ, κ·Έ κ°μ΄ 0μ΄λ©΄ μ§κ΅νλ κ²μ΄κ³ , 0μ κΈ°μ€μΌλ‘ λΉμ νμ μμλ‘ +1, -1λ‘ ...
To do νΈλ―ΈλΆ (partial derivative)
To do Gradient Boost XGBoost
μ νλΆλ₯μ λͺ©νμ λ°©λ²λ€
μ ν κΈ°μ ν¨μ λͺ¨λΈ κ°μ₯ λ¨μν ννμ μ νλͺ¨λΈ
This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier
κ°μ°μμ λΆν¬ (Gaussian Distribution)
λ°λμΆμ (Density Estimation) \(N\)κ°μ κ΄μ°°λ°μ΄ν°(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)κ° μ£Όμ΄μ‘μ λ λΆν¬ν¨μ \(p(\mathbf{x})\)λ₯Ό μ°Ύλ κ²
Appendix Reference https://vivek-singh.medium.com/an-introduction-to-gradient-descent-54775b55ba4f https://jermwatt.github.io/machine_learning_refined/not...
μ μ νλμλ₯Ό μμμΌ νλκ°?
Deep Learning Modelβs Outcome is the Probability of the Variable X
Dataset Restaurant Location Cuisines AverageCost MinimumOrder Rating Votes Reviews De...
Deep Learning Modelβs Outcome is the Probability of the Variable X
Deep Learning Modelβs Outcome is the Probability of the Variable X
Align Equations in mathjax format \(\begin{align} \sqrt{37} & = \sqrt{\frac{73^2-1}{12^2}} \\ & = \sqrt{\frac{73^2}{12^2}\cdot\frac{73^2-1}{73^2}} \...
clone proj from gitlab
https://www.44bits.io/ko/post/running-docker-registry-and-using-s3-storage
Redis with Docker get redis image from docker hub Docker image pull redis redis-cliμ κ°μ΄ ꡬλν΄μΌ λ¨. λ 컨ν μ΄λλ₯Ό μ°κ²°...
create pipeline write bitbucket-pipelines.yml commit pipelines.yml file run docker at local (test runners in local env) ...
Docker Orchestration Tool: Portainer (Web UI)
Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.
Coco Annotator μ€μΉ
Dockerhubμ Push κΉμ§ νλ κ²½μ° private repositoryλ νκ°κΉμ§λ§ κ°λ₯νκ³ λ μ°λ €λ©΄ μ λ£ νλμ κ°μ ν΄μΌ νλ€.
νκ²½ localμμ serverμ μλ docker containerμμ jupyter labμΌλ‘ μ μ
Error Message: RuntimeError: DataLoader worker (pid 4301) is killed by signal: Bus error. It is possible that dataloader's workers are out of shared memory. ...
μλ²μ μλ docker containerμ vscodeλ‘ μ μνλ λ°©λ²μ΄λ€.
3λ± μ루μ μμ DetectoRS λ₯Ό μ΄ μ΄μ ?(μΆμΈ‘) instance-segmentationμμ κ·Έ λΉμ SOTA μκΈ° λλ¬Έμ https://paperswithcode.com/sota/instance-segmentation-on-coco
λ컀μμ Container ν¬νΈμ Host ν¬νΈμ κ°λ
docker run with bind_mount and assign name to the container docker run -d -v `pwd`:/whale_test -it --name docker123456 mydocker
π Reference: https://www.daleseo.com/docker-volumes-bind-mounts/
Build Docker Image & run, start, stop and exit container by using shell command $ bash docker/build.sh
git repo https://github.com/dacon-ai/K-Fashion-3rd
Setup the docker via Repository 1. Update the apt package index and install packages to allow apt to use a repository over HTTPS: $ sudo apt-get update $ sud...
μ 리ν κ²
μ νλΆλ₯μ λͺ©νμ λ°©λ²λ€
μ ν κΈ°μ ν¨μ λͺ¨λΈ κ°μ₯ λ¨μν ννμ μ νλͺ¨λΈ
κ°μ°μμ λΆν¬ (Gaussian Distribution)
λ°λμΆμ (Density Estimation) \(N\)κ°μ κ΄μ°°λ°μ΄ν°(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)κ° μ£Όμ΄μ‘μ λ λΆν¬ν¨μ \(p(\mathbf{x})\)λ₯Ό μ°Ύλ κ²
Appendix Reference https://vivek-singh.medium.com/an-introduction-to-gradient-descent-54775b55ba4f https://jermwatt.github.io/machine_learning_refined/not...
μ μ νλμλ₯Ό μμμΌ νλκ°?
Deep Learning Modelβs Outcome is the Probability of the Variable X
Dataset Restaurant Location Cuisines AverageCost MinimumOrder Rating Votes Reviews De...
Deep Learning Modelβs Outcome is the Probability of the Variable X
Deep Learning Modelβs Outcome is the Probability of the Variable X
Sorting
Book - Python Algorithms by Magnus Lie Hetland
Book - Python Algorithms by Magnus Lie Hetland
Book - Python Algorithms by Magnus Lie Hetland
Book - Python Algorithms by Magnus Lie Hetland
Book - Python Algorithms by Magnus Lie Hetland
Book - Python Algorithms by Magnus Lie Hetland
Book - Python Algorithms by Magnus Lie Hetland
Book - Python Algorithms by Magnus Lie Hetland
Book - Python Algorithms by Magnus Lie Hetland
Utterances μ€μΉν΄μ λκΈ κΈ°λ₯ μΆκ°νκΈ°
Problem After unexpectedly reload vscode for updating vscode, as I served jekyll from local host by bundle exec jekyll serve, jekyll 3.9.1 | Error: Address ...
Failed so far.. with Jupyter Lab
```markdown go to header 1 go to header 2 go to header 3
Reference https://masunii.github.io/blog_custom/top_button/
Minimal-Mistakes Style Sheet Structure Got a hint from: https://github.com/mmistakes/minimal-mistakes/issues/1583 {: .align-right .wid...
While writing django code snippet, I found that it hides double curly brackets( {{}} ). Since Jekyll uses the Liquid templating language to process templates...
Align Equations in mathjax format \(\begin{align} \sqrt{37} & = \sqrt{\frac{73^2-1}{12^2}} \\ & = \sqrt{\frac{73^2}{12^2}\cdot\frac{73^2-1}{73^2}} \...
μ무 μκ° μμ΄ μ΄λ―Έμ§λ₯Ό _site/assets/images μ μ΄λ―Έμ§λ₯Ό μλ‘ μ½μ νλ €κ³ νλ μκΎΈ μ΄λ―Έμ§κ° μμ λλ κ²μ΄μλ€β¦ vscode remote connectionμ΄ λ¬Έμ μΈκ° μΆμ΄ server κ°μ dirμλ€ λ£μ΄λ λ³΄κ³ connectionλ λ€μ ν΄λ΄€μ§λ§ κ³μ μμ λκΈΈλ
if name == βmainβ: To better understand why and how this matters, we need to take a step back to understand how Python initializes scripts and how this inter...
Python GMP
https://inmoonlight.github.io/2021/02/21/PyTorch-IterableDataset/
```py import time data = [] start = time.time() from concurrent.futures import ThreadPoolExecutor import concurrent.futures
4-1. μΈλλ°κ° μμ νλ λΆμ κ²½μ° (ex: _variable) μ΄ κ²½μ°λ λͺ¨λ λ΄μμλ§ ν΄λΉ λ³μ/ν¨μλ₯Ό μ¬μ©νκ² λ€λ μλ―Έμ λλ€.(private) νΉν νμ μ ν λ λ€λ₯Έ νμμκ² βμ΄ λ³μ/ν¨μλ μ΄ λͺ¨λ λ΄λΆμμλ§ μ¬μ©ν κ±°λ€βλΌκ³ λͺ μμ μΌλ‘ ννΈλ₯Ό μ€ μ μμ΅λλ€.
urllib.parse.unquote(string, encoding=βutf-8β, errors=βreplaceβ) Replace %xx escapes with their single-character equivalent. The optional encoding and err...
Coroutines and Tasks
Regex μμ£Ό μ¬μ©νλ λ¬Έμ ν΄λμ€
```py import os def changeName(path, cName): i = 1 for filename in os.listdir(path): print(path+filename, β=>β, path+str(cName)+str(i)+β....
clone proj from gitlab
Coco Annotator μ€μΉ
K-Fashion Dataset Preprocessing To-do list json: coco formatμΌλ‘ json λ§λ€μ΄ μ€μΌ ν¨ mv: data root μ¬μ€μ rename: νμΌμ΄λ¦μ 곡백과 κ΄νΈ λ±μ΄ μ‘΄μ¬
3λ± μ루μ μμ DetectoRS λ₯Ό μ΄ μ΄μ ?(μΆμΈ‘) instance-segmentationμμ κ·Έ λΉμ SOTA μκΈ° λλ¬Έμ https://paperswithcode.com/sota/instance-segmentation-on-coco
git repo https://github.com/dacon-ai/K-Fashion-3rd
Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...
Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task
Detection Metrics Dice Coefficient \[Dice = \frac{2 |Aβ©B|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]
Task: Object Detection of Small Intesine Lesion
Task: Semantic Segmentation of Body labels are come from DensePose. Using these body labels, inference body parts.
conda λ‘ νκ²½ λ§λ€μ΄μ torch installμ condaλ‘ νλλ cuda Falseκ° λλ²λ €μ λ²μ λ¬Έμ μΈμ€ μμλλ pip install λ‘ νλ λ¬Έμ μμ΄ cuda μ¬μ© κ°λ₯νκ² λμλ€.
OpenSlide lib μ¬μ©λ°©λ²
λνλ§λ€ ν¨ν€μ§ λ²μ μ΄μκ° μμ μ μκΈ° λλ¬Έμ λν μ°Έμ¬ν λλ§λ€ λ€λ₯Έ conda νκ²½μ λ§λ€μ΄μ£Όκ³ μμνλκ² μ’λ€κ³ μκ°νλ€.
μλ£ λνμμ containerλ‘ μ§ννλ€λ³΄λ νμν νμΌλ€μ κ°μνκ²½μ²λΌ μ€μΉν ν 컨ν μ΄λ μ¬μμμ νλ©΄ λ€ λ μκ° λ²λ¦°λ€. μ΄μ λ°λΌ λ§μ΄νΈ λ backup directoryμ μ€μΉ λ° μ μ₯ ν μ¬μ©ν΄μΌ νλλ°
1. Add chart.js and jquery (layouts.html) This is currently located at head, but later Iβve to move those scripts down to the end of the body tag. <!-- ...
Deploy Django Wep app - Pyhonanywhere
Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...
Django Static & Debug Mode Keep in mind. If Debug = False, even though you correctly impletmented your static files, Django do not load any of your stati...
Basic Setting make project: $ django-admin startproject webproj
Model Django can have ORM (Object Relational DB) and sql.
MVT Pattern
1. Add chart.js and jquery (layouts.html) This is currently located at head, but later Iβve to move those scripts down to the end of the body tag. <!-- ...
Deploy Django Wep app - Pyhonanywhere
Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...
Django Static & Debug Mode Keep in mind. If Debug = False, even though you correctly impletmented your static files, Django do not load any of your stati...
Basic Setting make project: $ django-admin startproject webproj
Model Django can have ORM (Object Relational DB) and sql.
MVT Pattern
μ 리ν κ²
Autoencoder
Get started Recommender Environment conda conda conda create -n fashion python=3.8 install pytorch c...
Sequential Data νν 벑ν°μ λ²‘ν° \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). μ¬μ ...
Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) βThe function we want to minimize or maximize is called the objective function, ...
Computer Visionβs Difficulties κ΄μ μ λ³νλ‘ μΈν΄ κ°μ λμμ΄λΌλ ν½μ κ°μ΄ λ€λ¦. λ°°κ²½κ³Ό νΌμ¬μ²΄μ ꡬλΆμ΄ μ΄λ €μ. μ‘°λͺ μ λ°λ₯Έ λ³ν λμμ κΈ°νμ νν κ°λ €μ§ νν κ°μ ν΄λμ€μμμμ λ³νκ° νΌ
Code Snippet
Sequential Data νν 벑ν°μ λ²‘ν° \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). μ¬μ ...
Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) βThe function we want to minimize or maximize is called the objective function, ...
1. μμ λ°λΌνκ³ , κ°μΈ Github μ 리νκΈ° CNN
Computer Visionβs Difficulties κ΄μ μ λ³νλ‘ μΈν΄ κ°μ λμμ΄λΌλ ν½μ κ°μ΄ λ€λ¦. λ°°κ²½κ³Ό νΌμ¬μ²΄μ ꡬλΆμ΄ μ΄λ €μ. μ‘°λͺ μ λ°λ₯Έ λ³ν λμμ κΈ°νμ νν κ°λ €μ§ νν κ°μ ν΄λμ€μμμμ λ³νκ° νΌ
νΌμ νΈλ‘ νΌμ νΈλ‘ μ λμ λ΄μ μ μν μ νκ³Ό νμ±ν¨μμ μν λΉμ νμ μν΄ μλ―Έλ₯Ό ꡬλΆ. κ²°κ΅μ 곡κ°μ λΆν μ λ§λ λ€. μ νλμμμ wλΌλ κ°μ€μΉμ inputμ λ΄μ νκ³ wμ projectionνμλ, κ·Έ κ°μ΄ 0μ΄λ©΄ μ§κ΅νλ κ²μ΄κ³ , 0μ κΈ°μ€μΌλ‘ λΉμ νμ μμλ‘ +1, -1λ‘ ...
To do νΈλ―ΈλΆ (partial derivative)
To do Gradient Boost XGBoost
Appendix Reference https://medium.datadriveninvestor.com/review-on-fast-rcnn-202c9eadd23b 2021 Lecture 15 Detection and Segmentation http://cs231n.stanfor...
ML λͺ¨λΈ μ΄ν΄λ₯Ό μν ν 볡μ‘ν ML λͺ¨λΈμ μ΄ν΄νκΈ° μν΄μ λ€μκ³Ό κ°μ μμλ₯Ό λ°λΌκ° κ² μ΄ λͺ¨λΈμ΄ νλ €κ³ νλ λ¬Έμ λ 무μμΈκ° μΆλ‘ λ¨κ³λ₯Ό λ¨Όμ μ΄ν΄. βνμ΅βλ λͺ¨λΈμ΄ μ΄λ€ βμ λ ₯βμ λ°μμ΄ μ΄λ€ βμΆλ ₯βμ κ³μ°νλμ§ νμ ν κ² ...
1λ²λ¬Έμ : https://direction-f.tistory.com/29 2λ²λ¬Έμ : http://yonghee.io/word-embedding-pytorchword2vec/
Word Embedding λ¨μ΄μ μλ―Έλ₯Ό μ΄λ»κ² λνλΌ κ²μΈκ° μ’μ νν λ°©μ: λ¨μ΄κ°μ κ΄κ³λ₯Ό μ ννν μ μμ΄μΌ ν¨
λ¬Έμ λΆλ₯ (Text Classification) λ¬Έμ λΆλ₯λ μ λ ₯μΌλ‘ λ°μ, ν μ€νΈκ° μ΄λ€ μ’ λ₯μ λ²μ£Όμ μνλμ§λ₯Ό ꡬλΆνλ μμ λ€μν λ¬Έμ λΆλ₯ λ¬Έμ λ¬Έμμ λ²μ£Ό, μ£Όμ λΆλ₯ μ΄λ©μΌ μ€νΈ λΆλ₯ κ°μ± λΆλ₯ μΈμ΄ λΆλ₯ ...
μΈμ΄λͺ¨λΈ λ€μ λ¬Έμ₯ λ€μμ μ΄μ΄μ§ λ¨μ΄λ? Please turn your homework in or the ? λ€μ λ λ¬Έμ₯ μ€ λνλ νλ₯ μ΄ λ λμ κ²μ? ...
Intro μμ°μ΄μ μλ―Έλ₯Ό μ»΄ν¨ν°λ‘ λΆμν΄μ νΉμ μμ μ μν΄ μ¬μ©ν μ μλλ‘ νλ κ² μμ©λΆμΌ κΈ°κ³λ²μ κ°μ±λΆμ λ¬ΈμλΆλ₯ μ§μμλ΅μμ€ν μ±λ΄ μΈμ΄μμ± μμ±μΈμ μΆμ²μμ€ν ...
Embedded system
programming In programming language design, a first-class citizen (also type, object, entity, or value) in a given programming language is an entity which su...
python -m ipykernel install --user --name AI_hub_pre --display-name AI_hub_kernel
https://deeplearning.lipingyang.org/2018/03/29/run-jupyter-notebook-from-terminal-with-tmux/
extract tar
remote sshμ remote containerλ‘ μμ νλ€λ³΄λ
Wget λ§ν¬ μμ±(λ§ν¬κ° μλ λͺ¨λ μ¬μ©μμκ² κ³΅κ°) wget μΏ ν€ μ€μ μΌλ‘ λ€μ΄λ‘λ wget --load-cookies ~/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget -...
Week 2 - Understand the power of data Data-driven: Data-inspired: Explores different data sources to find out what they have in common. Algorithm: An algorit...
Week 1 - Problem-solving and effective questioning Structured thinking is the process of recognizing the current problem or situation, organizing available i...
Week 5 - The importance of fair business decisions
Week 4 - SQL What is a query?
Week 3 - Follow the data life cycle The life cycle of data is plan, capture, manage, analyze, archive and destroy.
Week 2 - Embrace your data analyst skills Curiosity Curiosity is all about wanting to learn something. Curious people usually seek out new chal...
TOC of 8 weeks course Foundations: Data, Data, Everywhere (this course) Ask Questions to Make Data-Driven Decisions Prepare Data for Exploration Pro...
Week 2 - Understand the power of data Data-driven: Data-inspired: Explores different data sources to find out what they have in common. Algorithm: An algorit...
Week 1 - Problem-solving and effective questioning Structured thinking is the process of recognizing the current problem or situation, organizing available i...
Week 5 - The importance of fair business decisions
Week 4 - SQL What is a query?
Week 3 - Follow the data life cycle The life cycle of data is plan, capture, manage, analyze, archive and destroy.
Week 2 - Embrace your data analyst skills Curiosity Curiosity is all about wanting to learn something. Curious people usually seek out new chal...
TOC of 8 weeks course Foundations: Data, Data, Everywhere (this course) Ask Questions to Make Data-Driven Decisions Prepare Data for Exploration Pro...
Week 2 - Understand the power of data Data-driven: Data-inspired: Explores different data sources to find out what they have in common. Algorithm: An algorit...
Week 1 - Problem-solving and effective questioning Structured thinking is the process of recognizing the current problem or situation, organizing available i...
Week 5 - The importance of fair business decisions
Week 4 - SQL What is a query?
Week 3 - Follow the data life cycle The life cycle of data is plan, capture, manage, analyze, archive and destroy.
Week 2 - Embrace your data analyst skills Curiosity Curiosity is all about wanting to learn something. Curious people usually seek out new chal...
TOC of 8 weeks course Foundations: Data, Data, Everywhere (this course) Ask Questions to Make Data-Driven Decisions Prepare Data for Exploration Pro...
Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task
Detection Metrics Dice Coefficient \[Dice = \frac{2 |Aβ©B|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]
Task: Semantic Segmentation of Body labels are come from DensePose. Using these body labels, inference body parts.
conda λ‘ νκ²½ λ§λ€μ΄μ torch installμ condaλ‘ νλλ cuda Falseκ° λλ²λ €μ λ²μ λ¬Έμ μΈμ€ μμλλ pip install λ‘ νλ λ¬Έμ μμ΄ cuda μ¬μ© κ°λ₯νκ² λμλ€.
OpenSlide lib μ¬μ©λ°©λ²
λνλ§λ€ ν¨ν€μ§ λ²μ μ΄μκ° μμ μ μκΈ° λλ¬Έμ λν μ°Έμ¬ν λλ§λ€ λ€λ₯Έ conda νκ²½μ λ§λ€μ΄μ£Όκ³ μμνλκ² μ’λ€κ³ μκ°νλ€.
μλ£ λνμμ containerλ‘ μ§ννλ€λ³΄λ νμν νμΌλ€μ κ°μνκ²½μ²λΌ μ€μΉν ν 컨ν μ΄λ μ¬μμμ νλ©΄ λ€ λ μκ° λ²λ¦°λ€. μ΄μ λ°λΌ λ§μ΄νΈ λ backup directoryμ μ€μΉ λ° μ μ₯ ν μ¬μ©ν΄μΌ νλλ°
Spark μ΄λ Pandasμ μ€ν λ‘μ΄λ λ²μ + SQL + Scikit-learn + Streaming
Live Session μ»€λ¦¬μ΄ μ΄λ€ κΈ°μ μ μλλκ° μλ κ²°κ³Όλ₯Ό λ΄λλ° μ΄μ
GAP (Global Average Pooling) import torch.nn.functional as F x = F.adaptive_avg_pool2d(x, (1, 1))
CS & Calculus background
Underprediction \(t_{i}\): target label(i-th sample) \(y_{i}\): modelβs prediction
Live Session with κ°μ°½μ± λ°μ¬λ
Sequential Data νν 벑ν°μ λ²‘ν° \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). μ¬μ ...
Objective Function Objective Funtion Vs. Loss Function(alias: Cost Function) βThe function we want to minimize or maximize is called the objective function, ...
Computer Visionβs Difficulties κ΄μ μ λ³νλ‘ μΈν΄ κ°μ λμμ΄λΌλ ν½μ κ°μ΄ λ€λ¦. λ°°κ²½κ³Ό νΌμ¬μ²΄μ ꡬλΆμ΄ μ΄λ €μ. μ‘°λͺ μ λ°λ₯Έ λ³ν λμμ κΈ°νμ νν κ°λ €μ§ νν κ°μ ν΄λμ€μμμμ λ³νκ° νΌ
νΌμ νΈλ‘ νΌμ νΈλ‘ μ λμ λ΄μ μ μν μ νκ³Ό νμ±ν¨μμ μν λΉμ νμ μν΄ μλ―Έλ₯Ό ꡬλΆ. κ²°κ΅μ 곡κ°μ λΆν μ λ§λ λ€. μ νλμμμ wλΌλ κ°μ€μΉμ inputμ λ΄μ νκ³ wμ projectionνμλ, κ·Έ κ°μ΄ 0μ΄λ©΄ μ§κ΅νλ κ²μ΄κ³ , 0μ κΈ°μ€μΌλ‘ λΉμ νμ μμλ‘ +1, -1λ‘ ...
To do νΈλ―ΈλΆ (partial derivative)
To do Gradient Boost XGBoost
Task: Object Detection of Small Intesine Lesion
Detectron
Appendix Reference https://medium.datadriveninvestor.com/review-on-fast-rcnn-202c9eadd23b 2021 Lecture 15 Detection and Segmentation http://cs231n.stanfor...
ML λͺ¨λΈ μ΄ν΄λ₯Ό μν ν 볡μ‘ν ML λͺ¨λΈμ μ΄ν΄νκΈ° μν΄μ λ€μκ³Ό κ°μ μμλ₯Ό λ°λΌκ° κ² μ΄ λͺ¨λΈμ΄ νλ €κ³ νλ λ¬Έμ λ 무μμΈκ° μΆλ‘ λ¨κ³λ₯Ό λ¨Όμ μ΄ν΄. βνμ΅βλ λͺ¨λΈμ΄ μ΄λ€ βμ λ ₯βμ λ°μμ΄ μ΄λ€ βμΆλ ₯βμ κ³μ°νλμ§ νμ ν κ² ...
1λ²λ¬Έμ : https://direction-f.tistory.com/29 2λ²λ¬Έμ : http://yonghee.io/word-embedding-pytorchword2vec/
Word Embedding λ¨μ΄μ μλ―Έλ₯Ό μ΄λ»κ² λνλΌ κ²μΈκ° μ’μ νν λ°©μ: λ¨μ΄κ°μ κ΄κ³λ₯Ό μ ννν μ μμ΄μΌ ν¨
λ¬Έμ λΆλ₯ (Text Classification) λ¬Έμ λΆλ₯λ μ λ ₯μΌλ‘ λ°μ, ν μ€νΈκ° μ΄λ€ μ’ λ₯μ λ²μ£Όμ μνλμ§λ₯Ό ꡬλΆνλ μμ λ€μν λ¬Έμ λΆλ₯ λ¬Έμ λ¬Έμμ λ²μ£Ό, μ£Όμ λΆλ₯ μ΄λ©μΌ μ€νΈ λΆλ₯ κ°μ± λΆλ₯ μΈμ΄ λΆλ₯ ...
μΈμ΄λͺ¨λΈ λ€μ λ¬Έμ₯ λ€μμ μ΄μ΄μ§ λ¨μ΄λ? Please turn your homework in or the ? λ€μ λ λ¬Έμ₯ μ€ λνλ νλ₯ μ΄ λ λμ κ²μ? ...
Intro μμ°μ΄μ μλ―Έλ₯Ό μ»΄ν¨ν°λ‘ λΆμν΄μ νΉμ μμ μ μν΄ μ¬μ©ν μ μλλ‘ νλ κ² μμ©λΆμΌ κΈ°κ³λ²μ κ°μ±λΆμ λ¬ΈμλΆλ₯ μ§μμλ΅μμ€ν μ±λ΄ μΈμ΄μμ± μμ±μΈμ μΆμ²μμ€ν ...
μ½λ ꡬν μμΉ μλμ½λλ³΄κ³ κ΅¬ν μ€ν¨μ, μ½λλ³΄κ³ μ½λ©νΈ λ¬κ³ μμ±ν΄λ³΄κΈ° μ¬κ·λ‘ ꡬν μμ± iterative version ꡬννκΈ°
Pseudo Code
Pseudo Code κΈ°μ€μ (pivot)μ μ νλ€. (4κ°μ§ λ°©λ² μ‘΄μ¬) Always pick first element as pivot. Always pick last element as pivot (implemented below) ...
Pseudo Code adjacent elements λΌλ¦¬ λΉκ΅νλ€. μ΄λ»κ² sortedκ° λμλμ§ νλ¨νλκ°(μ’ λ£μ‘°κ±΄) 2-1. 첫 passλ₯Ό ν΅κ³Όνλ©΄ λ§μ§λ§ μμλ 무쑰건 κ°μ₯ ν° μμκ° λ¨ 2-2. λ°λΌμ pass ν λλ§λ€ λ€μμλΆν° μ λ ¬μ΄ λλ μκ³ λ¦¬μ¦ 2-...
Backtracking λν λ¬Έμ Backtracking λνμ λ¬Έμ λΌκ³ νλ€.
commitμ resetν΄μ μ΄μ commit μ§μ μΌλ‘ λμκ° νμκ° μλ κ²½μ°κ° μ‘΄μ¬νλ€.
λ€λ₯Έ branchλ‘ checkout ν λ submodule μ΄ μμ κ²½μ° submodule initμ ν΄μ£Όκ³ update βrecursiveλ₯Ό ν΄μ€μΌ ν¨.
νΉμ commitμΌλ‘ λΆν° μλ‘μ΄ λΈλμΉλ₯Ό checkout νλ cmd
git credentialλ‘ μνΈν€ λ§€λ² μ λ ₯μν΄λ μ¨κΈ΄μνμμ git clone κ°λ₯νκ² ν μ μλ€.
Git Pull Request λ€ μ κ³ λ³΄λ λ무 μμΈνκ² μ μ κ² κ°κΈ°λ νλ€.
μμ 1 리뷰 μ¬μ©μλ³λ‘ μ²μ μ±λκ³Ό λ§μ§λ§ μ±λ μμλ΄κΈ° ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE μ¬μ©μ 251λ²μ μκ°μμΌλ‘ λ΄€μ λ 첫 λ²μ§Έ μ±λκ³Ό λ§μ§λ§ μ±λμ 무μμΈκ°? μλ 쿼리λ₯Ό μ€νν΄μ μ²μκ³Ό λ§μ§λ§ μ±λμ 보면 ...
JOIN SQL μ‘°μΈμ λ κ° νΉμ κ·Έ μ΄μμ ν μ΄λΈλ€μ κ³΅ν΅ νλλ₯Ό κ°μ§κ³ MERGE νλλ° μ¬μ©λ¨. μ΄λ μ€ν μ€ν€λ§λ‘ ꡬμ±λ ν μ΄λΈλ€λ‘ λΆμ°λμ΄ μλ μ 보λ₯Ό ν΅ν©νλ λ° μ¬μ©. JOINμ κ²°κ³Όλ λ°©μμ μκ΄μμ΄ μμͺ½μ νλλ₯Ό λͺ¨λ κ°μ§ μλ‘μ΄ ν μ΄λΈμ λ§λ€μ΄λ΄κ² λ¨. μ‘°...
GROUP BYμ AGGREGATE ν¨μ ν μ΄λΈμ λ μ½λλ₯Ό κ·Έλ£Ήννμ¬ κ·Έλ£Ήλ³λ‘ λ€μν μ 보λ₯Ό κ³μ° μ΄λ λ λ¨κ³λ‘ μ΄λ£¨μ΄μ§ κ·Έλ£Ήνμ ν νλλ₯Ό κ²°μ (νλ μ΄μμ νλκ° λ μ μμ) GROUP BYλ‘ μ§μ (νλ μ΄λ¦...
Redshift λ‘ μΉ λ°λͺ¨ μμ ν μ΄λΈ μκ° μ¬μ©μ ID: μΉμλΉμ€μμ λ±λ‘λ μ¬μ©μλ§λ€ λΆμ¬νλ μ μΌν ID μΈμ ID: μΈμ λ§λ€ λΆμ¬λλ ID μΈμ : μ¬μ©μμ λ°©λ¬Έμ λ Όλ¦¬μ μΈ λ¨μλ‘ λλ κ² μ¬μ©μκ° λ°©λ¬Έ ν 30λΆ...
SQLμ μ€μμ± λ°μ΄ν° κ΄λ ¨ 3κ°μ μ§κ΅° λ°μ΄ν° μμ§λμ΄ Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop λ°μ΄ν° λΆμκ° ...
μμ 1 리뷰 μ¬μ©μλ³λ‘ μ²μ μ±λκ³Ό λ§μ§λ§ μ±λ μμλ΄κΈ° ROW_NUMBER vs. FIRST_VALUE/LAST_VALUE μ¬μ©μ 251λ²μ μκ°μμΌλ‘ λ΄€μ λ 첫 λ²μ§Έ μ±λκ³Ό λ§μ§λ§ μ±λμ 무μμΈκ°? μλ 쿼리λ₯Ό μ€νν΄μ μ²μκ³Ό λ§μ§λ§ μ±λμ 보면 ...
JOIN SQL μ‘°μΈμ λ κ° νΉμ κ·Έ μ΄μμ ν μ΄λΈλ€μ κ³΅ν΅ νλλ₯Ό κ°μ§κ³ MERGE νλλ° μ¬μ©λ¨. μ΄λ μ€ν μ€ν€λ§λ‘ ꡬμ±λ ν μ΄λΈλ€λ‘ λΆμ°λμ΄ μλ μ 보λ₯Ό ν΅ν©νλ λ° μ¬μ©. JOINμ κ²°κ³Όλ λ°©μμ μκ΄μμ΄ μμͺ½μ νλλ₯Ό λͺ¨λ κ°μ§ μλ‘μ΄ ν μ΄λΈμ λ§λ€μ΄λ΄κ² λ¨. μ‘°...
GROUP BYμ AGGREGATE ν¨μ ν μ΄λΈμ λ μ½λλ₯Ό κ·Έλ£Ήννμ¬ κ·Έλ£Ήλ³λ‘ λ€μν μ 보λ₯Ό κ³μ° μ΄λ λ λ¨κ³λ‘ μ΄λ£¨μ΄μ§ κ·Έλ£Ήνμ ν νλλ₯Ό κ²°μ (νλ μ΄μμ νλκ° λ μ μμ) GROUP BYλ‘ μ§μ (νλ μ΄λ¦...
Redshift λ‘ μΉ λ°λͺ¨ μμ ν μ΄λΈ μκ° μ¬μ©μ ID: μΉμλΉμ€μμ λ±λ‘λ μ¬μ©μλ§λ€ λΆμ¬νλ μ μΌν ID μΈμ ID: μΈμ λ§λ€ λΆμ¬λλ ID μΈμ : μ¬μ©μμ λ°©λ¬Έμ λ Όλ¦¬μ μΈ λ¨μλ‘ λλ κ² μ¬μ©μκ° λ°©λ¬Έ ν 30λΆ...
SQLμ μ€μμ± λ°μ΄ν° κ΄λ ¨ 3κ°μ μ§κ΅° λ°μ΄ν° μμ§λμ΄ Python, Java/Scalar SQL, DB ETL/ELT(airflow, DBT) Spark, Hadoop λ°μ΄ν° λΆμκ° ...
Spark MLlib λͺ¨λΈ νλ μκ° Spark MLlib λͺ¨λΈ νλ μ΅μ μ νμ΄νΌ νλΌλ―Έν° μ ν μ΅μ μ λͺ¨λΈ νΉμ λͺ¨λΈμ νλΌλ―Έν°λ₯Ό μ°Ύλ κ²μ΄ μμ£Ό μ€μ νλμ© ν μ€νΈν΄λ³΄λ κ² vs. λ€μλ₯Ό λμ ν μ€νΈ νλ κ² λͺ¨λΈ μ νμ μ€μν ...
Spark MLlib μκ° λ¨Έμ λ¬λ κ΄λ ¨ λ€μν μκ³ λ¦¬μ¦, μ νΈλ¦¬ν°λ‘ ꡬμ±λ λΌμ΄λΈλ¬λ¦¬ Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, β¦ ...
μ»€λ¦¬μ΄ μ΄μΌκΈ° λ¨κ³Ό λΉκ΅νμ§ λ§κ³ μμΌλ‘ 20-30λ μ 보기 νλλ₯Ό νκΈ°λ‘ νμΌλ©΄ μ μ΄λ 6κ°μμ νκ³ λ€κΈ° λ무 빨리 ν¬κΈ°νμ§ μκΈ° λκ° μ μλλ©΄ μλλ₯΄κΈ° 보λ€λ μ€νλ € μ²μ²ν κ°κΈ° 곡λΆλ₯Ό μν 곡λΆλ₯Ό νκΈ° 보λ€λ μΌμ ...
λΉ λ°μ΄ν° κΈ°μ μ΄λ Spark μκ° νλ€μ€μ λΉκ΅ Spark μ€μ΅
λ°μ΄ν° νμ μν λ°μ΄ν° νμ λ―Έμ μ λ’°ν μ μλ λ°μ΄ν°λ₯Ό λ°νμΌλ‘ λΆκ°κ°μΉ μμ±
Spark MLlib λͺ¨λΈ νλ μκ° Spark MLlib λͺ¨λΈ νλ μ΅μ μ νμ΄νΌ νλΌλ―Έν° μ ν μ΅μ μ λͺ¨λΈ νΉμ λͺ¨λΈμ νλΌλ―Έν°λ₯Ό μ°Ύλ κ²μ΄ μμ£Ό μ€μ νλμ© ν μ€νΈν΄λ³΄λ κ² vs. λ€μλ₯Ό λμ ν μ€νΈ νλ κ² λͺ¨λΈ μ νμ μ€μν ...
Spark MLlib μκ° λ¨Έμ λ¬λ κ΄λ ¨ λ€μν μκ³ λ¦¬μ¦, μ νΈλ¦¬ν°λ‘ ꡬμ±λ λΌμ΄λΈλ¬λ¦¬ Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, β¦ ...
μ»€λ¦¬μ΄ μ΄μΌκΈ° λ¨κ³Ό λΉκ΅νμ§ λ§κ³ μμΌλ‘ 20-30λ μ 보기 νλλ₯Ό νκΈ°λ‘ νμΌλ©΄ μ μ΄λ 6κ°μμ νκ³ λ€κΈ° λ무 빨리 ν¬κΈ°νμ§ μκΈ° λκ° μ μλλ©΄ μλλ₯΄κΈ° 보λ€λ μ€νλ € μ²μ²ν κ°κΈ° 곡λΆλ₯Ό μν 곡λΆλ₯Ό νκΈ° 보λ€λ μΌμ ...
λΉ λ°μ΄ν° κΈ°μ μ΄λ Spark μκ° νλ€μ€μ λΉκ΅ Spark μ€μ΅
λ°μ΄ν° νμ μν λ°μ΄ν° νμ λ―Έμ μ λ’°ν μ μλ λ°μ΄ν°λ₯Ό λ°νμΌλ‘ λΆκ°κ°μΉ μμ±
Spark MLlib λͺ¨λΈ νλ μκ° Spark MLlib λͺ¨λΈ νλ μ΅μ μ νμ΄νΌ νλΌλ―Έν° μ ν μ΅μ μ λͺ¨λΈ νΉμ λͺ¨λΈμ νλΌλ―Έν°λ₯Ό μ°Ύλ κ²μ΄ μμ£Ό μ€μ νλμ© ν μ€νΈν΄λ³΄λ κ² vs. λ€μλ₯Ό λμ ν μ€νΈ νλ κ² λͺ¨λΈ μ νμ μ€μν ...
Spark MLlib μκ° λ¨Έμ λ¬λ κ΄λ ¨ λ€μν μκ³ λ¦¬μ¦, μ νΈλ¦¬ν°λ‘ ꡬμ±λ λΌμ΄λΈλ¬λ¦¬ Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, β¦ ...
μ»€λ¦¬μ΄ μ΄μΌκΈ° λ¨κ³Ό λΉκ΅νμ§ λ§κ³ μμΌλ‘ 20-30λ μ 보기 νλλ₯Ό νκΈ°λ‘ νμΌλ©΄ μ μ΄λ 6κ°μμ νκ³ λ€κΈ° λ무 빨리 ν¬κΈ°νμ§ μκΈ° λκ° μ μλλ©΄ μλλ₯΄κΈ° 보λ€λ μ€νλ € μ²μ²ν κ°κΈ° 곡λΆλ₯Ό μν 곡λΆλ₯Ό νκΈ° 보λ€λ μΌμ ...
λΉ λ°μ΄ν° κΈ°μ μ΄λ Spark μκ° νλ€μ€μ λΉκ΅ Spark μ€μ΅
λ°μ΄ν° νμ μν λ°μ΄ν° νμ λ―Έμ μ λ’°ν μ μλ λ°μ΄ν°λ₯Ό λ°νμΌλ‘ λΆκ°κ°μΉ μμ±
Sorting
μ½λ ꡬν μμΉ μλμ½λλ³΄κ³ κ΅¬ν μ€ν¨μ, μ½λλ³΄κ³ μ½λ©νΈ λ¬κ³ μμ±ν΄λ³΄κΈ° μ¬κ·λ‘ ꡬν μμ± iterative version ꡬννκΈ°
Pseudo Code
Pseudo Code κΈ°μ€μ (pivot)μ μ νλ€. (4κ°μ§ λ°©λ² μ‘΄μ¬) Always pick first element as pivot. Always pick last element as pivot (implemented below) ...
Pseudo Code adjacent elements λΌλ¦¬ λΉκ΅νλ€. μ΄λ»κ² sortedκ° λμλμ§ νλ¨νλκ°(μ’ λ£μ‘°κ±΄) 2-1. 첫 passλ₯Ό ν΅κ³Όνλ©΄ λ§μ§λ§ μμλ 무쑰건 κ°μ₯ ν° μμκ° λ¨ 2-2. λ°λΌμ pass ν λλ§λ€ λ€μμλΆν° μ λ ¬μ΄ λλ μκ³ λ¦¬μ¦ 2-...
Numpy
Numpy Array Broadcasting
In Linear Algebra Course, SVD is one of matrix decomposition methods. (such as LU, QR)
Entropy
du -bh --max-depth=1 | sort -hr | head
This study is based on the book Understanding Linux network internals.
extract tar
Check current default shell ps -p $$ # or echo $0 # in my case # /bin/bash
MLOps λ°λ³΅μ μΈ μμ μ ν΄μν μ μλ λ°©λ²μ΄λ©΄ λ€ MLOps μ μμμΌλ‘ κ°μ£Όνλ€.
clone proj from gitlab
Git lab runnerλ‘ μ΄μ£Ό μμ
https://docs.github.com/en/actions/hosting-your-own-runners/about-self-hosted-runners
make test_run.py to pass with python uniitest 1-1. make cicd variables in settings.
DIND
bitbucket μ©μΌλ‘ sshλ₯Ό νλλ§ μ°λ€κ°
Git lab runnerλ‘ μ΄μ£Ό μμ
Go to setting: ctrl + , search: workbench.editor.wrapTabs Turn to True(as checked)
sudo apt-get update sudo apt-get install code
Remote-ssh VScode install VSCODE press F1 Find Remote-SSH: Connect current window to Host (or Remote-SSH: Connect to Host) λ§μ½ μ΅μ΄ config λ§λ€μ΄μΌ λλ©΄ 4-1...
Problem After unexpectedly reload vscode for updating vscode, as I served jekyll from local host by bundle exec jekyll serve, jekyll 3.9.1 | Error: Address ...
Failed so far.. with Jupyter Lab
While writing django code snippet, I found that it hides double curly brackets( {{}} ). Since Jekyll uses the Liquid templating language to process templates...
1. Add chart.js and jquery (layouts.html) This is currently located at head, but later Iβve to move those scripts down to the end of the body tag. <!-- ...
Deploy Django Wep app - Pyhonanywhere
Django VScode Extension While I work with django-html files, everytime I had to type curly brackets and percentage sign. I found most popular django html ext...
conda λ‘ νκ²½ λ§λ€μ΄μ torch installμ condaλ‘ νλλ cuda Falseκ° λλ²λ €μ λ²μ λ¬Έμ μΈμ€ μμλλ pip install λ‘ νλ λ¬Έμ μμ΄ cuda μ¬μ© κ°λ₯νκ² λμλ€.
OpenSlide lib μ¬μ©λ°©λ²
μλ£ λνμμ containerλ‘ μ§ννλ€λ³΄λ νμν νμΌλ€μ κ°μνκ²½μ²λΌ μ€μΉν ν 컨ν μ΄λ μ¬μμμ νλ©΄ λ€ λ μκ° λ²λ¦°λ€. μ΄μ λ°λΌ λ§μ΄νΈ λ backup directoryμ μ€μΉ λ° μ μ₯ ν μ¬μ©ν΄μΌ νλλ°
Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run
Flask and SQLAlchemy - RESTful APIs - connect to DB Flask Shell - create db fist Run Flask Shell on conda env or venv: flask shell ```flask f...
Flask run as debug mode $ export FLASK_ENV=development $ flask run if not set as dev mode, need to keep restart flask like: $ flask run
Flask and SQLAlchemy - RESTful APIs - connect to DB Flask Shell - create db fist Run Flask Shell on conda env or venv: flask shell ```flask f...
Deep Learning Modelβs Outcome is the Probability of the Variable X
Deep Learning Modelβs Outcome is the Probability of the Variable X
Appendix Reference https://vivek-singh.medium.com/an-introduction-to-gradient-descent-54775b55ba4f https://jermwatt.github.io/machine_learning_refined/not...
μ μ νλμλ₯Ό μμμΌ νλκ°?
κ°μ°μμ λΆν¬ (Gaussian Distribution)
λ°λμΆμ (Density Estimation) \(N\)κ°μ κ΄μ°°λ°μ΄ν°(observations) \(\mathbf{x}_1,\ldots\mathbf{x}_N\)κ° μ£Όμ΄μ‘μ λ λΆν¬ν¨μ \(p(\mathbf{x})\)λ₯Ό μ°Ύλ κ²
1λ²λ¬Έμ : https://direction-f.tistory.com/29 2λ²λ¬Έμ : http://yonghee.io/word-embedding-pytorchword2vec/
This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier
μ νλΆλ₯μ λͺ©νμ λ°©λ²λ€
Optimizers https://youtu.be/mdKjMPmcWjY
Autoencoder
Spark MLlib λͺ¨λΈ νλ μκ° Spark MLlib λͺ¨λΈ νλ μ΅μ μ νμ΄νΌ νλΌλ―Έν° μ ν μ΅μ μ λͺ¨λΈ νΉμ λͺ¨λΈμ νλΌλ―Έν°λ₯Ό μ°Ύλ κ²μ΄ μμ£Ό μ€μ νλμ© ν μ€νΈν΄λ³΄λ κ² vs. λ€μλ₯Ό λμ ν μ€νΈ νλ κ² λͺ¨λΈ μ νμ μ€μν ...
Spark MLlib μκ° λ¨Έμ λ¬λ κ΄λ ¨ λ€μν μκ³ λ¦¬μ¦, μ νΈλ¦¬ν°λ‘ ꡬμ±λ λΌμ΄λΈλ¬λ¦¬ Classification, Regression, Clustering, Collaborative Filtering, Dimensionality Reduction, β¦ ...
SSH key trouble shooting βbuild-arg ssh_prv_key=β$(cat ~/.ssh/id_rsa)β stargan
create pipeline write bitbucket-pipelines.yml commit pipelines.yml file run docker at local (test runners in local env) ...
python -m ipykernel install --user --name AI_hub_pre --display-name AI_hub_kernel
https://deeplearning.lipingyang.org/2018/03/29/run-jupyter-notebook-from-terminal-with-tmux/
make test_run.py to pass with python uniitest 1-1. make cicd variables in settings.
DIND
https://ansohxxn.github.io/blog/scrollbar/
https://ansohxxn.github.io/blog/category/
Python GMP
programming In programming language design, a first-class citizen (also type, object, entity, or value) in a given programming language is an entity which su...
Task: Semantic Segmentation of Body labels are come from DensePose. Using these body labels, inference body parts.
λνλ§λ€ ν¨ν€μ§ λ²μ μ΄μκ° μμ μ μκΈ° λλ¬Έμ λν μ°Έμ¬ν λλ§λ€ λ€λ₯Έ conda νκ²½μ λ§λ€μ΄μ£Όκ³ μμνλκ² μ’λ€κ³ μκ°νλ€.
Detection Metrics Dice Coefficient \[Dice = \frac{2 |Aβ©B|}{(|A|+|B|)} = \frac{2 TP}{(2 TP + FP + FN)}\]
Task: Object Detection of Small Intesine Lesion
Go to conda.sh location such as C:\Users\{your_username}\anaconda3\etc\profile.d Open git bash here by right click as Git ...
conda env export > environment.yaml or
Backtracking λν λ¬Έμ Backtracking λνμ λ¬Έμ λΌκ³ νλ€.
Remote-ssh VScode install VSCODE press F1 Find Remote-SSH: Connect current window to Host (or Remote-SSH: Connect to Host) λ§μ½ μ΅μ΄ config λ§λ€μ΄μΌ λλ©΄ 4-1...
While writing django code snippet, I found that it hides double curly brackets( {{}} ). Since Jekyll uses the Liquid templating language to process templates...
Deploy Django Wep app - Pyhonanywhere
Minimal-Mistakes Style Sheet Structure Got a hint from: https://github.com/mmistakes/minimal-mistakes/issues/1583 {: .align-right .wid...
Things to consider as an Interviewee
Things to consider as an Interviewee
Code Snippet
Deep Learning Modelβs Outcome is the Probability of the Variable X
Deep Learning Modelβs Outcome is the Probability of the Variable X
νμ΄μλ: λ°μ°μ΄νμΈνΈ: λ§λ μ€νΈλ μΈ(νμμ), λ§λ μ€μ€ν¬μΈ (μ΄λμ) κ²λ΄νΈλ μΈ
Reference https://masunii.github.io/blog_custom/top_button/
This assignment basically comes from cs231n. https://cs231n.github.io/assignments2021/assignment1/#q1-k-nearest-neighbor-classifier
μ ν κΈ°μ ν¨μ λͺ¨λΈ κ°μ₯ λ¨μν ννμ μ νλͺ¨λΈ
```markdown go to header 1 go to header 2 go to header 3
Failed so far.. with Jupyter Lab
1. μμ λ°λΌνκ³ , κ°μΈ Github μ 리νκΈ° CNN
1. μμ λ°λΌνκ³ , κ°μΈ Github μ 리νκΈ° CNN
Sequential Data νν 벑ν°μ λ²‘ν° \(\boldsymbol{x} = (\boldsymbol{x}^{(1)}, \boldsymbol{x}^{(2)},\ldots ,\boldsymbol{x}^{(T)})^{T}\). μ¬μ ...
Wget λ§ν¬ μμ±(λ§ν¬κ° μλ λͺ¨λ μ¬μ©μμκ² κ³΅κ°) wget μΏ ν€ μ€μ μΌλ‘ λ€μ΄λ‘λ wget --load-cookies ~/cookies.txt "https://docs.google.com/uc?export=download&confirm=$(wget -...
remote sshμ remote containerλ‘ μμ νλ€λ³΄λ
```py import os def changeName(path, cName): i = 1 for filename in os.listdir(path): print(path+filename, β=>β, path+str(cName)+str(i)+β....
Regex μμ£Ό μ¬μ©νλ λ¬Έμ ν΄λμ€
Coco Annotator μ€μΉ
Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.
Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.
Build web api with fast api framework on top of python with Celery distributed queue and RabbitMQ.
Redis with Docker get redis image from docker hub Docker image pull redis redis-cliμ κ°μ΄ ꡬλν΄μΌ λ¨. λ 컨ν μ΄λλ₯Ό μ°κ²°...
νΉμ commitμΌλ‘ λΆν° μλ‘μ΄ λΈλμΉλ₯Ό checkout νλ cmd
νΉμ commitμΌλ‘ λΆν° μλ‘μ΄ λΈλμΉλ₯Ό checkout νλ cmd
Coroutines and Tasks
Coroutines and Tasks
urllib.parse.unquote(string, encoding=βutf-8β, errors=βreplaceβ) Replace %xx escapes with their single-character equivalent. The optional encoding and err...
urllib.parse.unquote(string, encoding=βutf-8β, errors=βreplaceβ) Replace %xx escapes with their single-character equivalent. The optional encoding and err...
SSH key trouble shooting βbuild-arg ssh_prv_key=β$(cat ~/.ssh/id_rsa)β stargan
https://inmoonlight.github.io/2021/02/21/PyTorch-IterableDataset/
clone proj from gitlab
This study is based on the book Understanding Linux network internals.
Generative Adversarial Networks (GANs) Specialization offered by DeepLearning.AI
Generative Adversarial Networks (GANs) Specialization offered by DeepLearning.AI
Generative Adversarial Networks (GANs) Specialization offered by DeepLearning.AI
multiprocessing in Windows not working sinc
Embedded system
conda λ‘ νκ²½ λ§λ€μ΄μ torch installμ condaλ‘ νλλ cuda Falseκ° λλ²λ €μ λ²μ λ¬Έμ μΈμ€ μμλλ pip install λ‘ νλ λ¬Έμ μμ΄ cuda μ¬μ© κ°λ₯νκ² λμλ€.
conda env export > environment.yaml or
Overall Entered around 2 weeks before the competition ends. Get used to implementing Detectron2 with custom data First Instance Segmentation Task
Go to conda.sh location such as C:\Users\{your_username}\anaconda3\etc\profile.d Open git bash here by right click as Git ...
Go to conda.sh location such as C:\Users\{your_username}\anaconda3\etc\profile.d Open git bash here by right click as Git ...
Execute git bash by windows key command ssh-keygen Enter file in which to save the key (μμ±μμΉ μ νλ ννΈ) κΈ°λ³Έκ²½λ‘λ‘ ν μμ μ΄λ―λ‘ ENTER ...
Execute git bash by windows key command ssh-keygen Enter file in which to save the key (μμ±μμΉ μ νλ ννΈ) κΈ°λ³Έκ²½λ‘λ‘ ν μμ μ΄λ―λ‘ ENTER ...
Execute git bash by windows key command ssh-keygen Enter file in which to save the key (μμ±μμΉ μ νλ ννΈ) κΈ°λ³Έκ²½λ‘λ‘ ν μμ μ΄λ―λ‘ ENTER ...
MLOps λ°λ³΅μ μΈ μμ μ ν΄μν μ μλ λ°©λ²μ΄λ©΄ λ€ MLOps μ μμμΌλ‘ κ°μ£Όνλ€.
μμνκ² λ μ΄μ λ체 λ μμνλλμ λν λ΅μ. μκ°μ μ 리 λ° μ΄λ©΄μ λλ μκ°λ€ λ° μΌνλ©΄μ λκΌλ κ²μ λν νκ³ μ΄λ€. μ μμνκ² λμλκ°. μΌνμ§ 1λ μ΄ μ§λκ³ λ΄ λ΄μλ μΌνλ νκ²½λ ν¬κ² λ°λμ§ μμμ§λ§, μ’ μ κΉμ§λ νΌμ μΌνκ³ μ± μμ§λ νκ²½μμ μλ§λ νμλ€μ κΎΈ...