๐Ÿข ETRI (2024.01.16)

๐Ÿ“Œ 01.15-TODO List:

1. ๋…ผ๋ฌธ์ €์ž์—๊ฒŒ ๋ฉ”์ผ๋ณด๋‚ด๊ธฐ!

2. ์ฃผ์ค‘์— ํ•  ๊ฒƒ: Deep Learning 2024(Bishop)
- Chapter 2: Exercise ํ’€๊ธฐ.

- Chapter 3 ์ฝ๊ณ  ๊ณต๋ถ€ํ•˜๊ธฐ
3.1. Discrete Variables
3.2. The Multivariate Gaussian
3.3. Periodic Variables
3.4. The Exponential Family
3.5. Nonparametric Methods


3. ํ‘œ๋ณธ๋ถ„ํฌ

4. ํ†ต๊ณ„

5. ํ†ต๊ณ„์  ์ถ”๋ก 



 
 


 
 

 
 

๐Ÿš ์ถœ๊ทผ! (8:10 - 8:25)

๊ทธ๋ƒฅ 7์‹œ 25๋ถ„์— ์•Œ๋žŒ ๋งž์ถฐ๋ฒ„๋ ธ๋‹ค ใ…‹ใ…‹ใ…‹
๊ทธ๋ž˜๋„ ๋ฐฅ์€ ๋ง›์žˆ๊ฒŒ ์•ผ๋ฌด์ง€๊ฒŒ ๋จน๊ณ ์™”๋‹ค ํžˆํžˆ๐Ÿคฃ
์ถœํ‡ด๊ทผ์€ ์…”ํ‹€๋ฒ„์Šค๊ฐ€ ์—ญ์‰ฌ ์ œ์ผ ๋น ๋ฅธ๊ฑฐ ๊ฐ™๋‹ค. (Shortest Path Algorithm?)
์•„ ๊ทธ๋ฆฌ๊ณ  ์–ด์ œ๋ถ€ํ„ฐ ์ƒˆ๋กœ์šด ๋ฃจํ‹ด ์ถ”๊ฐ€ํ•˜๋‹ˆ ํ™•์‹คํžˆ ์˜ค๋Š˜ ๋” ํ”ผ๊ณคํ•˜๋‹ค ใ„นใ…‡...
 

 
 
 
 

๐Ÿ“– ๊ณต๋ถ€! (8:30-12:00)

์…”ํ‹€๋ฒ„์Šค ํƒ€๊ณ  ์˜ค๋Š”๊ฒŒ ์ผ์ฐ๊ณต๋ถ€ํ•  ์ˆ˜ ์žˆ์–ด์„œ ์ด๋“์ธ๊ฑฐ ๊ฐ™๋‹ค.
์ด์ œ ๋‚จ์€ ํ• ์ผ:
โˆ™ ๋…ผ๋ฌธ review:
     ๋…ผ๋ฌธ ์ •๋ฆฌ
     ๋…ผ๋ฌธ review
     PPT๋งŒ๋“ค๊ธฐ

โˆ™ Deep Learning(Bishop 2024): Chapter 3 ์ด๋‹ค.
3.1. Discrete Variables
3.2. The Multivariate Gaussian
3.3. Periodic Variables
3.4. The Exponential Family
3.5. Nonparametric Methods
 
์•„ ๊ทธ๋ฆฌ๊ณ  ๋„ˆ๋ฌด ๋’ท๊ณจ ๋•ก๊ธฐ๊ณ  ๋ชฉ์•„ํ”„๊ณ  ๋จธ๋ฆฌ์•„ํŒŒ์„œ
์งœ์ž”- ์˜›๋‚ ์— ๋‹ค์ด์†Œ์—์„œ ์‚ฐ ๋ชฉ ๋งˆ์‚ฌ์ง€ ๊ธฐ๊ตฌ๋ฅผ ๋“ค๊ณ ์™”๋Š”๋ฐ ๊ฒจ์šฐ ์‚ด๋งŒํ–ˆ๋‹ค.
๊ทธ๋ž˜๋„ ๋‚˜๋ฆ„ ํšจ๊ณผ๊ฐ€ ์ค€์ˆ˜ํ•˜๋‹ค?
 
์•„...ํ• ๊ฑฐ ๋“œ~~~๋ฆ…๊ฒŒ ๋งŽ๋‹ค ์ง„์งœใ…‹ใ…‹๐Ÿ˜ฑ
 
 
 
 
 

๐Ÿš ๋ฐฅ์ด๋‹ค ๋ฐฅ! (12:30~13:00)

๋งˆ์ฐฌ๊ฐ€์ง€๋กœ ๋™ํŽธ์ œ(ํ•œ์‹): ์˜ค๋Š˜์€ ๊ฐœ๊ฟ€๋ง›! ๋ถˆํ–ฅ ๋ถˆ๊ณ ๊ธฐ๋ผ๋‹ˆ!!

๊ฑฐ๊ธฐ๋‹ค๊ฐ€ ์นดํŽ˜์—์„œ ๊ต์ˆ˜๋‹˜๊ป˜์„œ Java ํ”„๋ผํ‘ธ์น˜๋…ธ๋„ ์‚ฌ์ฃผ์…จ๋‹น ํžˆํžˆ
 
 

 
 
 
 

 
 

๐Ÿ’ป ์„œ๋ฒ„ ๋š๋”ฑ๋š๋”ฑ! (13:30-18:00)

์„œ๋ฒ„ cuda๋ž‘ cuDNN ๊น”๊ณ  python๊น”๊ณ  pip๋ž‘ pip3 ๋งํ‚นํ•˜๊ณ  Pytorch๊นŒ์ง€ ๊น”์•„์คŒ์œผ๋กœ์จ ๋งˆ๋ฌด๋ฆฌ!
 
1. Server ๊ตฌ์ถ• ๋ฐ IP์ฃผ์†Œ ssh๋กœ ์ ‘์† ์ดํ›„ cuda ๊น”๊ธฐ. (runfile(local) ์„ค์น˜)

 

CUDA Toolkit 11.8 Downloads

 

developer.nvidia.com

sudo apt install nvidia-cuda-toolkit
sudo sh cuda_11.8.0_520.61.05_linux.run

 
๋‹ค๋งŒ ๊ธฐ์กด nvidia driver๊ฐ€ ์กด์žฌ ์‹œ, ์œ„ ์ฝ”๋“œ์— ๋Œ€ํ•ด ์•„๋ž˜ ์‚ฌ์ง„์ฒ˜๋Ÿผ์˜ค๋ฅ˜๋ฐœ์ƒ๊ฐ€๋Šฅ...

์ด๋Ÿฌ๋ฉด ์•„๋ž˜ ์ฝ”๋“œ๋ฅผ ์‹คํ–‰ํ•ด์ฃผ์ž.

sudo apt-get purge nvidia*
sudo apt-get autoremove
sudo apt-get autoclean
nvidia-smi

 
 
2. cuDNN ๊น”๊ธฐ
cf) NVIDIA ํšŒ์›๊ฐ€์ž…์ด ํ•„์š”.(Local Installer for Linux x86_64(Tar) ๋‹ค์šด๋ฐ›์œผ๋ฉด ๋œ๋‹ค.)

 

cuDNN Archive

Download releases from the GPU-accelerated primitive library for deep neural networks.

developer.nvidia.com

$ nvcc --version

# ์••์ถ• ํ’€๊ธฐ, ์••์ถ•์„ ํ’€๋ฉด archive๋กœ ๋๋‚˜๋Š” ํด๋”๊ฐ€ ์ƒ์„ฑ๋œ๋‹ค.
$ tar -xvf cudnn-linux-x86_64-8.x.x.x_cudaX.Y-archive.tar.xz 

# ์•„๋ž˜๋ถ€ํ„ฐ๋Š” ํŒŒ์ผ์„ cuda์— ๋ณต์‚ฌํ•˜๊ธฐ
sudo cp include/cudnn* /usr/local/cuda-11.0/include
sudo cp lib64/libcudnn* /usr/local/cuda-11.0/lib64/
sudo chmod a+r /usr/local/cuda-11.0/lib64/libcudnn*

# cuDNN ์„ค์น˜ํ™•์ธ:
cat /usr/local/cuda/include/cudnn_version.h | grep CUDNN_MAJOR -A 2

 
 



cf) python, pip ๊น”๊ณ  pip3, python3๋ฅผ pip, python์œผ๋กœ ์—ฐ๊ฒฐ

sudo apt-get install python3-pip
nano ~/.bashrc

 
๋งจ ๋งˆ์ง€๋ง‰ ์ค„์— ์•„๋ž˜ ์ฝ”๋“œ ์ถ”๊ฐ€

alias python=python3
alias pip='pip3'
source ~/.bashrc


 
 

sudo apt-get install unzip
pip install transformers torch torchvision pytorch-lightning wandb numpy pandas pillow opencv-python matplotlib
pip install -U ultralytics

 
 
 

๐Ÿš ํ‡ด๊ทผ! (18:30 - 19:00)

ํ‡ด๊ทผ์ด ์ œ์ผ ์ข‹๋‹ค๋Š” ์ง์žฅ์ธ์˜ ๋ง์— ๊ณต๊ฐ์ด ์ ์ ๋œ๋‹คใ…‹ใ…‹ใ…‹
์•„์นจ์ถœ๊ทผ๋•Œ๋ฌธ์— ๊ทธ๋ƒฅ ์กธ๋ฆฌ๋‹คใ…‹ใ…‹ ํ”ผ๊ณค๐Ÿฉธํ•˜๊ณ ใ… ใ… 



 
 
 
 

๐Ÿ‹๐Ÿป ์šด๋™! (19:00 -)

์ด์ œ 3๋Œ€ ์šด๋™๋ณด๋‹จ ์ข€ ๋” ์„ธ๋ถ„ํ™”ํ•ด์„œ A,B๋ฃจํ‹ด ์•ˆํ•˜๋Š” ๋‚ ์—๋Š” ๊ฐ€์Šด,์‚ผ๋‘, ๋“ฑ,์ด๋‘, ์–ด๊ป˜ ์œ„์ฃผ๋กœ ํ•ด๋ด์•ผ๊ฒ ๋‹ค.
 
 

๐Ÿ‹๐Ÿป ์šด๋™ ์›”๊ฐ„ ๊ณ„ํš:

A→(๋ฒค์น˜,์‚ผ๋‘)→B→(๋ฐ๋“œ+๋“ฑ,์ด๋‘)→A→(๋ฒค์น˜,์‚ผ๋‘)→B→
(๋ฐ๋“œ+๋“ฑ,์ด๋‘)→A→(๋ฒค์น˜,์‚ผ๋‘)→B→(๋ฐ๋“œ+๋“ฑ,์ด๋‘)→A→(๋ฒค์น˜,์‚ผ๋‘)→
B→(๋ฐ๋“œ+๋“ฑ,์ด๋‘)→A→(๋ฒค์น˜,์‚ผ๋‘)→B→(๋ฐ๋“œ+๋“ฑ,์ด๋‘)→A→
(๋ฒค์น˜,์‚ผ๋‘)→B→(๋ฐ๋“œ+๋“ฑ,์ด๋‘)→A→(๋ฒค์น˜,์‚ผ๋‘)→B→(๋ฐ๋“œ+๋“ฑ,์ด๋‘)→
 

๐Ÿ‹๐Ÿป ์ด๋ฒˆ์ฃผ:

(๋ฐ๋“œ+๋“ฑ,์ด๋‘)→A→(์ธํด๋ผ์ธ,๋””ํด๋ผ์ธ๋ฒค์น˜, ์‚ผ๋‘)→B→(๋ฐ๋“œ+๋“ฑ,์ด๋‘)→A→(๋ฒค์น˜,์‚ผ๋‘)
 

๐Ÿ‹๐Ÿป ์˜ค๋Š˜: A๋ฃจํ‹ด


 

 
 

๐Ÿ“Œ TODO List:

1. DAOD์ ์šฉ




2. ์ฃผ์ค‘์— ํ•  ๊ฒƒ: Deep Learning 2024(Bishop)
- Chapter 2: Exercise ํ’€๊ธฐ.

- Chapter 3 ์ฝ๊ณ  ๊ณต๋ถ€ํ•˜๊ธฐ
3.1. Discrete Variables
3.2. The Multivariate Gaussian
3.3. Periodic Variables
3.4. The Exponential Family
3.5. Nonparametric Methods

3. Student t๋ถ„ํฌ ๋ฐ ๊ฐ€์„ค๊ฒ€์ • ๋‹ค์‹œ ๊ณต๋ถ€ํ•˜๊ธฐ.


 

'2024 winter > ETRI(์ผ์ƒ)' ์นดํ…Œ๊ณ ๋ฆฌ์˜ ๋‹ค๋ฅธ ๊ธ€

[ETRI] 2024.01.18  (0) 2024.01.18
[ETRI]2024.01.17  (0) 2024.01.17
[ETRI]2024.01.15  (0) 2024.01.15
[ETRI]2024.01.12  (2) 2024.01.12
[ETRI]2024.01.11  (0) 2024.01.11

+ Recent posts