7.3.5 Self-Consistent Beliefs

์‚ฌ์‹ค ์ด์ „์— ๊ทผ์‚ฌํ–ˆ๋˜ factorization์„ ๋‹ค์‹œ ์ƒ๊ฐํ•ด๋ณด๋ฉด, ๋‚ด๊ฐ€ ๋“ค๊ณ  ์žˆ๋Š” ์–ด๋–ค ์นด๋“œ๋“ค์— ์˜ํ•ด ์ƒ๋Œ€๋ฐฉ์ด ๋“ค๊ณ  ์žˆ์„ ์นด๋“œ๋Š” ์˜ํ–ฅ์„ ๋ฐ›์„ ์ˆ˜ ๋ฐ–์— ์—†์Šต๋‹ˆ๋‹ค. ํ•˜์ง€๋งŒ ์ด๋ฅผ ๋ฌด์‹œํ•œ ์ฑ„ ์–ด์ฉ” ์ˆ˜ ์—†๋Š” ๊ทผ์‚ฌ๋ฅผ ํ•˜์˜€์Šต๋‹ˆ๋‹ค.

๊ฒŒ๋‹ค๊ฐ€ ์ด๋Ÿฐ ๊ทผ์‚ฌ๋ฅผ ํ†ตํ•ด์„  ๊ฒฐ๊ณผ์ ์œผ๋กœ marginalํ•˜์ง€ ์•Š์€ fprif^{\mathrm{pri}}๋ฅผ ๊ตฌํ•˜๊ฒŒ ๋  ์ˆ˜๋„ ์žˆ์Šต๋‹ˆ๋‹ค. ๊ทธ ๊ฒƒ์„ ํ•ด๊ฒฐํ•˜๊ธฐ ์œ„ํ•ด ์ด ํ›„๋กœ๋Š” BAD์˜ ๋ฉ”์ธ ์•„์ด๋””์–ด๋Š” ์•„๋‹ˆ์ง€๋งŒ, ์–ด๋–ป๊ฒŒ marginalํ•˜๊ฒŒ Bt \mathcal{B}_t๋ฅผ ์—…๋ฐ์ดํŠธํ•  ์ˆ˜ ์žˆ์„์ง€์— ๋Œ€ํ•œ iterative procedure๋ฅผ ์ œ์•ˆํ•ฉ๋‹ˆ๋‹ค.

B0=Bt \mathcal{B}^0 = \mathcal{B}_t

Bk+1(f[i])=โˆ‘f[โˆ’i]Bk(f[โˆ’i])P(f[i]โˆฃf[โˆ’i],fโ‰คtpub,uโ‰คta,ฯ€^โ‰คt)\mathcal{B}^{k+1}(f[i]) = \sum_{f[-i]}\mathcal{B}^k(f[-i])P(f[i]|f[-i],f^{\mathrm{pub}}_{\leq t}, u^a_{\leq t}, \hat{\pi}_{\leq t})

โˆEf[โˆ’i]โˆผBk[Lt(f[i])P(f[i]โˆฃf[โˆ’i],ftpub)] \propto \mathbb{E}_{f[-i] \sim\mathcal{B}^k}[\mathcal{L}_t(f[i])P(f[i]|f[-i],f^{\mathrm{pub}}_t)]

๋งˆ์ง€๋ง‰ ํ…€์€ expectation ํ˜•ํƒœ๋กœ ๋ณ€ํ™˜ํ•จ์œผ๋กœ์จ sampling์„ ๊ฐ€๋Šฅํ•˜๋„๋ก ํ•˜์˜€์Šต๋‹ˆ๋‹ค.

Last updated