A/B Test Like a Pro #2: Creating an Experiment

แชร์
ฝัง
  • เผยแพร่เมื่อ 8 พ.ย. 2017
  • Now that your app is set up to start taking advantage of A/B testing, how do you create an experiment in the Firebase console? Let's find out in this episode!
    Check out the rest of the series here: goo.gl/mv5fxf
    Subscribe to the Firebase Channel: goo.gl/9giPHG
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 31

  • @KaCaro38
    @KaCaro38 5 ปีที่แล้ว +2

    Thanks, this was very helpful! :)

  • @chand81p
    @chand81p 4 ปีที่แล้ว +1

    Great video series. Very informative. Is it possible to use Event Value instead of Event Count as the goal?

  • @cakec9
    @cakec9 3 ปีที่แล้ว

    Love it!

  • @mole364
    @mole364 6 ปีที่แล้ว +2

    Hi Todd, great series! One question: Let's say that I set up an A/B test for a variable where 50% of the users will get the defaultValue while the rest 50% will get the newValue. What happens when a new user launches the app? Will he get the defaultValue until the cache expires (after 12 hours) and then maybe change the value? Or will he instantly get one of these two values? I'm asking because I don't want users to see a change in the app after 12 hours. I want them to get either the defaultValue or the newValue instantly on launch.

  • @alecdelu83
    @alecdelu83 3 ปีที่แล้ว +1

    Thanks! you helped me cleared up many doubts!

    • @Firebase
      @Firebase  3 ปีที่แล้ว

      Glad to hear that!

  • @mateuszkaflowski3827
    @mateuszkaflowski3827 6 ปีที่แล้ว

    Its so easy now :) Testing everything. But I use oldschool setting user property toofor checking admob revenue. Are you going to add this to metrick tracks?
    Thanks.

  • @dmytrozasukha402
    @dmytrozasukha402 ปีที่แล้ว

    Great! Additionally, I would like to hear about Advanced options

  • @amirfakhim7797
    @amirfakhim7797 2 ปีที่แล้ว +2

    Greate video. thank you. Could we use the Firebase and remote config for website A/B testing and remote config?

  • @hakamsoufan
    @hakamsoufan 5 ปีที่แล้ว

    Nice work thank you

    • @hakamsoufan
      @hakamsoufan 5 ปีที่แล้ว

      I'm here because to understand how to left my channel ..A/B TEST

  • @walterlol
    @walterlol 6 ปีที่แล้ว +22

    Is it me or does he look like Robin Williams?

    • @r00t67
      @r00t67 4 ปีที่แล้ว

      @@ToddKerpelmanCorp red variant of t-short + RTFM is better.

    • @easterneuropeaninmexico3554
      @easterneuropeaninmexico3554 3 ปีที่แล้ว

      Because he does. :D

    • @MihaTech
      @MihaTech 2 ปีที่แล้ว

      when god conducts A/B testing

    • @scottledeuce
      @scottledeuce 2 หลายเดือนก่อน

      Id say more like Bubbles from trailer park boys

  • @thehowlerapp4252
    @thehowlerapp4252 6 ปีที่แล้ว

    How to rename or move files in the firebase firestore console

  • @lghiggino
    @lghiggino 3 ปีที่แล้ว

    Hey! This video series is great but I'm running into trouble. When I attempt to select my app, on the segmentation step, there is nothing in there to pick. The button looks disabled. Is it because its a web app only?

  • @gohanparningotan6769
    @gohanparningotan6769 4 ปีที่แล้ว

    when will the A/B test ready on web?

  • @quynhthunguyen5813
    @quynhthunguyen5813 ปีที่แล้ว

    Hello, I wonder how the sample size is split among different variants?
    Some documents of Bayesian method mention that one of the approach that helps Bayesian method generate results faster than frequentist method is the ability to distribute the sample to variant groups and of course the proportion of traffic to different groups can be different.
    Does Firebase (Google Optimize to be exact) keep the traffic proportion the same for all groups or dynamically change it dynamically ?
    Thank you

  • @miroslavpavlovic
    @miroslavpavlovic 6 ปีที่แล้ว +2

    Hi, thanks for the video! Really appreciate it!
    I'd like to set up an A/B testing for some variants that are actually remote config parameters with conditions. (I targeted 50% of the users with one value, and other 50% with different value... this was how I did A/B testing before). Should I remove those conditions and set only default value? It looks like A/B testing will randomize the value for that parameter now... Thanks!

    • @miroslavpavlovic
      @miroslavpavlovic 6 ปีที่แล้ว

      Thanks! Can't wait to see the results! :-)

  • @Bankai3474
    @Bankai3474 4 ปีที่แล้ว

    I don't see the option to manage test devices in my Draft for my experiment. Everything else is set up but I don't see an option for managing test devices.

  • @armelfabricekoudoum5178
    @armelfabricekoudoum5178 6 ปีที่แล้ว

    I keep having the error message "Error saving test devices: Validation error" while adding a test device on Android for my firebase AB testing. Can anyone help, please.?

  • @asthagarg4614
    @asthagarg4614 5 ปีที่แล้ว

    What if I want to give one value to 10% of the user base and other value to 90%?? How to achieve this?

  • @siddhant1249
    @siddhant1249 2 ปีที่แล้ว

    what is the meaning of `RTFM` on your cup?

  • @joegreen6209
    @joegreen6209 4 ปีที่แล้ว

    He's talking only about apps, which I assume are SPAs? What about plain old websites? Does this all apply?

    • @Chriscs7
      @Chriscs7 3 ปีที่แล้ว

      yes it does, you can create web app

  • @KoKo-hp5gy
    @KoKo-hp5gy 2 ปีที่แล้ว

    မင္ဂလာပါၾလဴကီးမင္းခင္ဗ်ာကြၽန္ေတာ္ဖုန္းကိုယ့္ဝိုင္ၿပီးပိတ္လိုက္သလာပဲ့စိတ္မေကာင္းပါဘူဗ်ာကြၽန္ေတာ္ႏွလံုးသားကိုယ္နင္‌ေျခခံလိုက္ရသလိုပါပဲဗ်ာေက်းဇူတင္ပါသည္ခင္ဗ်ာ