배치 크기 (Batch Size)

  • Gradient Descent를 실행하고 모델의 가중치를 갱신할때 고려할 데이터의 갯수다.
  • 배치 크기가 1이라면 Stochastic Gradient Descent가 된다. 훈련이 느리다.
  • 배치 크기가 데이터 전부의 갯수라면 Batch Mode가 된다. 계산량이 많다.
  • 배치 크기가 그 사이라면, Mini-Batch Mode가 되며, 좋은 GPU의 사용이 가능하다면 각각의 데이터마다 동시에 병렬 계산이 되기 때문에 제일 빠른 수렴이 가능하다.
  • 배치 크기는 GPU에 따라 64, 128, 256, 512.. 등으로 설정한다.
  • Iteration * Batch Size = Epoch 이므로, 한 데이터셋을 도는데 최대한 병렬처리가 가능하게끔 배치 크기를 주는게 이득이다.

7 thoughts on “배치 크기 (Batch Size)

  1. Thank you for the auspicious writeup. It in reality used to be a leisure account it.
    Look complicated to more added agreeable from you! By the way, how can we communicate?

    my web page: who g

  2. Hey there! I just wanted to ask if you ever have any trouble with hackers?
    My last blog (wordpress) was hacked and I ended up losing several
    weeks of hard work due to no back up. Do you have any methods to stop
    hackers?

    Look at my web-site rsacwgxy g

  3. May I just say what a relief to discover somebody that really knows what they’re talking about
    on the internet. You certainly realize how to bring a problem to light and make it important.

    More people need to check this out and understand this side of the
    story. It’s surprising you are not more popular since you surely possess the gift.

    Feel free to surf to my page :: cbd oil; https://aascircle.com,

  4. Thanks for your marvelous posting! I definitely enjoyed reading it,
    you may be a great author. I will ensure that
    I bookmark your blog and will often come back later on. I want to encourage you to definitely continue your great writing, have a nice
    holiday weekend!

    Look into my web-site cbd oil [thelearnandburnconnection.com]

  5. I think this is one of the most significant information for me.
    And i am glad reading your article. But want to remark
    on some general things, The website style is great, the articles is really excellent :
    D. Good job, cheers

    My web-site … cbd oil that works 2020

댓글 남기기