The paradox mentioned in the video might be alleviated with some strategies. For instance, if the required steps of SimpleLogic exceed BERT's capacity, it shouldn't be able to infer correctly (and if it does, it might be relying on statistical features). Therefore, we could introduce an additional loss by using more steps, ensuring that BERT cannot infer correctly when its capacity is exceeded.
![[Full Episode] The Restaurant War Thailand ศึกพ่อค้าซ่าแม่ค้าแซ่บ Episode 2 | 29 ก.ย. 67](http://i.ytimg.com/vi/r3lfLNH6Ke4/mqdefault.jpg)
The paradox mentioned in the video might be alleviated with some strategies.
For instance, if the required steps of SimpleLogic exceed BERT's capacity, it shouldn't be able to infer correctly (and if it does, it might be relying on statistical features). Therefore, we could introduce an additional loss by using more steps, ensuring that BERT cannot infer correctly when its capacity is exceeded.