배치 정규화 (혹은 표준화) Batch Normalization

미니배치에서 (보통은) 활성화 함수전에 해당 데이터들을 모두 Z-score 와 유사한 방법으로 표준화 (Normalization) 함으로써 빠르게 수렴하고 강건(robust) 하게 만드는 방법이다. 결과적으로는 정확도 상승에 도움을 준다.

정확도 상승을 위해 거의 필수적으로 구현하고 있다.

잘 보면, 미니배치 대상의 평균과 분산을 더해 Z-score를 계산한다. epsilon은 분모 0 방지를 위한 미세한 값이며, 마지막에 감마와 베타로 다시 조정하기는 하지만, 여튼 Z-score에 기반한다.

관련 논문 : Batch Normalization: Accelerating Deep Network Training b y Reducing Internal Covariate Shift, Sergey Ioffe, Christian Szegedy

  • Normalization의 번역은 컨텍스트에 따라 다른데, 여기서는 Z-score와 유사한 방법으로 표준화를 하기 때문에 일반적인 L1, L2 regularization과 구분할수 있도록 표준화라 했다.

10 thoughts on “배치 정규화 (혹은 표준화) Batch Normalization

  1. Cephalexin Kill Coccidia [url=https://buyciallisonline.com/]Buy Cialis[/url] Difference Entre Cialis Kamagra Buy Cialis what does levitra pill look like

  2. Quality articles or reviews is the important to interest the people to visit the web page, that’s what this web page
    is providing.

    Also visit my web site :: g who

  3. When I originally commented I seem to have clicked the -Notify me when new comments are added- checkbox
    and now each time a comment is added I recieve four emails with the exact same comment.

    Perhaps there is a way you can remove me from that service?
    Many thanks!

    my page – g into

  4. It’s appropriate time to make some plans for the future and it is time to be happy.

    I have read this post and if I could I desire to suggest
    you some interesting things or tips. Maybe you can write next articles referring to this article.
    I wish to read more things about it!

    my homepage: cbd oil (http://www.erospoetry.net)

  5. I don’t know if it’s just me or if perhaps everyone else
    encountering problems with your site. It seems like some
    of the text on your posts are running off the screen. Can someone else please provide feedback and let me know
    if this is happening to them too? This could be a issue with my
    browser because I’ve had this happen previously. Appreciate it

    My webpage :: cbd oil – apemoneyd.com

  6. I am really enjoying the theme/design of your blog. Do you ever run into any web browser compatibility problems?
    A handful of my blog visitors have complained about my blog not operating correctly in Explorer but looks great in Chrome.
    Do you have any advice to help fix this issue?

    Also visit my page … cbd oil (tinyurl.com)

댓글 남기기