Write Playwright Tests in Seconds with ChatGPT!?

แชร์
ฝัง
  • เผยแพร่เมื่อ 24 ธ.ค. 2024

ความคิดเห็น • 30

  • @TestingMatters
    @TestingMatters 22 วันที่ผ่านมา +3

    If the complete code, incorporating validation and data flows, is available and provided to the LLM with a suitable prompt, success is almost certain. The LLM can generate Page Objects and a comprehensive set of positive and negative tests. From my experiments, Claude 3.5 has shown excellent capability in creating quality Playwright artifacts, but the results rely heavily on the context and the clarity of the prompt (e.g., specifying locator preferences).
    The challenge becomes apparent with component-based frameworks like React and Angular, where validation logic and data flows might be scattered across components or APIs. Without clear business rules or fully accessible code, it often feels like a game of peek-a-boo, leaving QA to ask the eternal question: “Show me the requirements!”

    • @ChecklyHQ
      @ChecklyHQ  19 วันที่ผ่านมา

      Yeah, that's right and thanks for the comment. I would be very keen on seeing a prompt that works well for you.

  • @kapilkapoor7191
    @kapilkapoor7191 หลายเดือนก่อน +2

    Honestly I loved the content.

    • @ChecklyHQ
      @ChecklyHQ  หลายเดือนก่อน

      Thank you! Glad it was valuable! 🦝

  • @manuQAE
    @manuQAE 28 วันที่ผ่านมา

    Very Cool! the best content for Playwright!

    • @ChecklyHQ
      @ChecklyHQ  28 วันที่ผ่านมา +1

      Thank you! Great to see that you're still following along. 💙

  • @Muhammad55597
    @Muhammad55597 หลายเดือนก่อน +1

    the best content for playwright 👌

  • @andersonmann
    @andersonmann 27 วันที่ผ่านมา

    Very helpful. Greetings from Brazil

  • @ppp.1334
    @ppp.1334 หลายเดือนก่อน +2

    Cool,
    But what happend when you have more complex issue
    With more files
    Like passing context etc
    -
    I have problem too keep browser connections
    When one test finishes and another should be run the same session,
    Any suggestions?

  • @sen86sen
    @sen86sen หลายเดือนก่อน +3

    have you tried with snapshots feature which is released today ??

    • @ChecklyHQ
      @ChecklyHQ  หลายเดือนก่อน +1

      I haven't checked the new feature yet, but I might play around with it next week. :)

    • @sen86sen
      @sen86sen หลายเดือนก่อน

      @ thanks for your reply

  • @alejandrosejas
    @alejandrosejas หลายเดือนก่อน +3

    great content, perhaps you could showcase how, codegen generated code can then be updated to use POM and omit clicks() etc using CursorAI

    • @ChecklyHQ
      @ChecklyHQ  หลายเดือนก่อน +1

      Yes! This is only part one of a planned series. Cursor and Copilot are next. And I'm very grateful for every suggestion. Thank you! 🦝

    • @alejandrosejas
      @alejandrosejas หลายเดือนก่อน

      @@ChecklyHQ@ChecklyHQ, we are very grateful that you and your team keep releasing this quality of content! It is really useful, and I've learned a lot from your videos. Please keep them coming! 🎭

    • @ChecklyHQ
      @ChecklyHQ  29 วันที่ผ่านมา

      Thanks for the kind words! 💙 Happy the videos are valuable.

  • @og4789
    @og4789 หลายเดือนก่อน

    Very impressive, Thank you for your efforts!

    • @ChecklyHQ
      @ChecklyHQ  หลายเดือนก่อน

      My pleasure! 🦝

    • @og4789
      @og4789 หลายเดือนก่อน

      Do you know the command for codegen in case of using .env files?

    • @ChecklyHQ
      @ChecklyHQ  หลายเดือนก่อน

      @@og4789 I'm not sure I understand. How do .env files relate to codegen?

    • @og4789
      @og4789 หลายเดือนก่อน +1

      So baseURL from env variables I have to type always manually into npx playwright codegen command right?

    • @ChecklyHQ
      @ChecklyHQ  19 วันที่ผ่านมา

      Yes I think so. :)

  • @alexanderkomanov4151
    @alexanderkomanov4151 หลายเดือนก่อน +2

    Thanks for your video.
    What about searchgpt, that can access the web. Or maybe perplexity, that also can go to the web sources.

    • @ChecklyHQ
      @ChecklyHQ  19 วันที่ผ่านมา

      I haven't used any of these but I'll put them on the list for possible future videos. Thank you! 🦝

  • @aidoka2000
    @aidoka2000 หลายเดือนก่อน +1

    Tabnine ai extension can help as well

    • @ChecklyHQ
      @ChecklyHQ  19 วันที่ผ่านมา +1

      Thank you! I'll check it out!

  • @Kabbinj
    @Kabbinj หลายเดือนก่อน +2

    First mistake was to use gpt4, instead of o1. It would probably have been able to do more with less.
    Anyways, you do not use chatgpt for this, and you mention, you need custom built in tools that can on their own, in an iterative fashion, fetch the data they need to keep writing the test.

    • @ChecklyHQ
      @ChecklyHQ  หลายเดือนก่อน

      Thanks for the tip. I just played with o1 a little bit and I couldn't find a real improvement. Without enough context, they both fail to generate good code, and with enough context, roles and rules, they both succeed.
      > you do not use chatgpt for this
      I 100% agree with you; I took this example as the kick-off, because I've literally seen these instructions in some docs: "To get started with Playwright, head over to ChatGPT and tell it what it should do"... And I'm not kidding. 🫣

  • @tririfandani1876
    @tririfandani1876 หลายเดือนก่อน

    Nice video Stefan!
    you should try using the new claude computer use API, it will opens up a lot more possibilities, for example I think we can omit the html/css/js context to the prompt

    • @ChecklyHQ
      @ChecklyHQ  หลายเดือนก่อน

      Great idea! I'll put it on the list because I'm planning a series and this video is only part 1. 🫣 Thank you!