Prompt 1: You are a researcher. I will now upload an interview transcript, and you will do what is called qualitative coding - specifically, initial coding also known as open coding. The text is an interview transcript, I do not want you to code the questions asked by the interviewer. I want the codes to be detailed and descriptive. I want you to apply codes to sentences or parts of sentences, and later when you develop a list of codes, I want you to be able to tell me what sentences or parts of sentences these codes were applied to. In other words, when I ask you to provide me example quotes for the codes that you create, I would like you to be able to do it. Here is the text to be coded: Prompt 2: Please develop more detailed codes. I would also like the codes to be a bit more descriptive, and please separately list quotes that show all sentences or parts of sentences coded with each code. Prompt 3: You are a researcher. I will now upload an interview transcript, and you will do what is called qualitative coding - specifically, initial coding also known as open coding. The text is an interview transcript, I do not want you to code the questions asked by the interviewer. I want the codes to be detailed and descriptive. I want you to apply codes to sentences or parts of sentences, and later when you develop a list of codes, I want you to be able to tell me what sentences or parts of sentences these codes were applied to. In other words, when I ask you to provide me example quotes for the codes that you create, I would like you to be able to do it. Here is the text to be coded: I want you to use exactly the same approach and the same format as you did above. Prompt 4: I would like the codes to be more descriptive, longer and more detailed. And also include the quotes for each code underneath.
I have watched several videos where qualitative research experts have used ChatGPT to support the analysis process. Most of them have concluded that, ChatGPT is not reliable in some cases for the analysis task. What is really going on is not inefficiencies in ChatGPT. It is in the inaccuracy, misalignment or ambiguity in your prompts. Generating Efficient prompts is a specialist area - prompt engineering. What you need is expert understanding of prompt engineering - specifically learning how to generate efficient prompts for qualitative research. It is not about typing what you want in plain English. Evidently, if one keeps modifying the prompts, you will eventually hit an aligned prompt and then get what you want. Learn prompt engineering or you will inadvertently ask ChatGPT to hallucinate. Yes, you asked it.
I'm not a "qualitative research experts" but I second this. I've tried both GPT-3.5 and GPT-4 and both cannot provide nuance and comprehensive result, especially when we provide them a chunk of data and straight asked them to analyze. However, after quite numbers of trials, I've found that it can be done but through "little by little" (explained in my 2nd paragraph), and for now it only works for identifying codes. First, I need to "establish the thematic process" with the GPT before I start asked for the code. I've provided them with 1) the title of my study, 2) my research objective that require thematic, 3) the condition of the "data collection", like in my case is a series of sessions (longitudinal study), number of participants and groups (treatment vs control) and 4) example of previous studies' "Thematic methodology". So, the GPT will establish the process or steps that we are going to do, including the details such as inductive/deductive, critical-realist perspective, or whatever needed. Second prompt is, I asked GPT, based on that (the established steps with details), I will provide him a table of subject and the question (type what is the question), where the subject's first letter indicate which group they belong to (e.g., T01 for treatment, C01 for Control), for total of number session (in my case is 8). For each subject's response, I want the GPT to provide the details such as a "nuance inductive coding" based on the research objective (repeat again to remind) based on the condition of each group, and specifically based on the question asked (repeat again to remind, type again the question). The "code" must be together with the "quote" and "reasoning", and list again for only the quote (so that I can have 2 data in a column for the "code, quote, and reasoning" which is for my future reference for further thematic steps, and list of "quotes" only so that later it is easy for me to do the next thematic step. I have tried posted whole column "subject" and "questions/response". After that, I posted again but 1 time for each subject, and I can see that a data from single subject has more codes, and it has better results in my own judgement of my study. I've tried 2 subjects at 1 time, it still provides quite decent result, but I'm so lazy to try 3,4,5 and so on. This is what I meant by "little by little". Both GPT-3.5 and GPT-4 will go NUT if we provide too many data to interpret, and it is undeniable that there are difference results between using GPT-3.5 and GPT-4, but don't forget that GPT-4 has limit caps, like 50 prompt per-3 hours. This method requires hard work as if were doing the thematic in a traditional way with a little help of the technology. And of course, we still need to manually verify and validate each result as well before moving to the next themed step (which has already listed in the established thematic step above). However, this is just my ignorant opinion, that, the "reasoning" ability provided by the GPT itself (assuming after we have validated and approve it) is a good handicap compared to using other software. Other software like Nvivo Atlas.ti does have the "reasoning" ability, but they did not provide as what GPT can do. But yeah, they were more easy and faster way to get a similar decent result as using this "semi-traditional" way - unless the GPT can remain "sane" with a chunk of data to interpret. Thats my 2cents.
Dr. G. Your chat GPT was VERY informative..I look forward to reviewing How can I get a transcript coding theme analysis using Microsoft WORD that you were referring to and an NVIVO TUTORIAL? I have all my data for my dissertation in transcript I need to expedite coding and theming in an accessible ethical way. Please guide me .... Very grateful to have found your page...
Have you tried the new chatgpt features with data analysis? I also found that you can continue to “train” or submit more detailed information within a given chat session to beef up the AI’s process around a given area
Having tried this, so far ChatGPT is not showing any worthwhile ability for open coding as far as I can see. Tempting, but not a good use of time for me at the moment, to try it with deductive coding. Thanks for the video though.
I agree. I definitely still prefer software that were specifically designed for data analysis, but with the current AI capabilities, I don't think we are far from the point where it will indeed surpass this kind of software
I have used the method mentioned in the video and it is indeed a very effective method, thank you. I only have concerns about the data entered into chatgpt. For example, I entered interviews for my university research and quotes were extracted from them via chatpgt under each code, which I will use them in the data discussion section. Will Turnitin not recognize the quotes as 100% AI generated, even though they are originally my raw data?
I cannot tell you for sure how this works, as I am not a programmer, but in my opinion, this would not make sense - since this is your original raw data. One thing you may try, and I know this will sound weird.... is to ask ChatGPT about these things - you will be surprised, I think it may actually give you the answer to this query
Great video Dr Kriukow, thank you, I found it really interesting. I'm currently coding the interview transcripts from the first study of my PhD by hand using NVivo 12 for Mac (that’s a learning curve). I found ChatGPT really helpful in learning how to use NVivo, much quicker and easier than trawling through the manual (mostly). I’d be interested to know, if you cover it in your next video, how you might integrate ChatGPT with using software like NVivo - I can imagine myself using ChatGPT later in the process to compare AI generated codes with my ones - a sort of triangulation/quality check on my codes and themes to see what I might be missing (subject to ethical approval, as you've already discussed!).
thank you for your question. One way to integrate chatGPT with NVivo would be to ask chatGPT to found codes/themes related to something specific we have in mind (or maybe just ask it to create Any codes or themes), making sure to instruct it to specify quotes for each code/theme (also specify that you want the quotes in the original, raw form - with no corrections from the bot, as it likes to do so), then you can locate these quotes by the text search option in NVivo (this is why you need the raw form, so that you can just copy and paste the quotes) and code them, using the code ideas from chatGPT
Great video Dr, but isn't it breaching the confidentiality of the respondent's interview transcription? and isn't it risky to put the transcriptions on chatgpt before submitting the thesis?
Yes, as I replied to a similar comment, I think that before it is confirmed what exactly is done to the data and whether it is being protected, this may indeed be an issue from the ethical point of view. I expect this issue to be addressed in the coming weeks or months, as it is certainly an important one
Hi, Dr. Kriukow, your videos on the use of chatgpt in text analysis are useful. I am learning them for my own research. I am wondering if there are academic articles on the coding skills taught in the videos for my references to a proposed paper for a journal. Looking forward to your professional support and thank you very much for that~~from Dr. Weiwei Zhang.
The process I use was influenced by Constructivist Grounded Theory, described, among others, in a book by Charmaz "Constructing Grounded Theory". This is not to say taht you can only use this approach if you are doing a GT study - I have been using thsi approach in a variety of studies, hardly any of them being grounded theory
Such as great video. Just a quick concern, if you use chatGPt for paraphrasing and literature review, can it be caught by AI detectors? Can you make a video on the best AI detectors please? Thank you
I believe it will be detected if you are using it for writing your literature review or any other parts of your thesis. I would also never recommend doing this for many other reasons
If you use it for literature review be sure to actually look up the source and read it and then cite it. You also need to include the AI output as an appendix of your work. If you do that, you shouldn't have to worry about the AI detectors
Is that academic ethically to put the chat-GPT as tool which help our analysis in our research report or research article just like others analysis tools (nVivo, atlas.ti, etc)?
helpful thank you! im using this for an open-ended qualitative survey, however im running into an issue that after giving me an initial set of 6-8 codes it then goes on to make up the rest of the quotes when i ask for more codes. Is there a way around this?
This is the main problem with Chat GPT, I think. I guess it's just trying to consistently ask for more, or maybe breaking the data up into chunks that are easier for the AI to digest? I know it can be annoying
Hi, thanks for your helpful videos . I've got a question: DO I NEED A SECOND PRSON TO CODE MY DATA? I mean, I finish coding and ask a second rater to code my data to increase reliability of coding?
I want to analyse job interviews. Qualitative analysis tells what was said but not if it was the right answer and what to do better to be more successful. I now experiment with custom chatgpt and include reviewing each answer on a scale for relevance and the use of STAR . Using chatgpt is a very interesting approach. You dont need so much programming skills and can use common sense. It works for processing small amounts of high value data. It might be slow and costly for large amounts. Thanks for the video i will look at all the other material.
New subscriber here! Thanks for all the knowledge you've been sharing. How has your experience of using ChatGPT been for coding in terms of completeness? I mean it seems like we're entrusting the initial coding to it, but how confident are we that it actually emulates going through the text line by line?
It is, as I often stress, a bit of a hit and miss. I think the only way to really entrust it is to make sure that we provide it with smaller chunks at a time (so I would definitely not upload several transcripts - rather, I would do one by one and even then I think you would need to monitor it closely, ask questions, evaluate etc)
you can do this in the free version, the only difference is that you have to then paste the transcript into the chat (the paid version lets you upload the whole file)
How will i do the coding if my researchs were not deductive i mean if its not in the form of interview . I mean the research may contain case studies differrent AI models and stastical analysis.
The idea of qualitative research, and grounded theory specifically is to arrive at new theory based on data. I tried to use it a few times. It does not work for in depth qualitative coding. ChatGPT has the tendency to find “reasonable theory” based on the historic training data. So you will likely not arrive at new rigorous insightful theory.
this is why you should definitely control the whole process, and I would definitely leave the theory generation to a human, I agree. I may only, if anything, use GPT's assistance for coding (provided that, again, I am overlooking the process)
Hello, Dr Kriukow. Based on your previous videos where you used the same dataset, it's clear that you're familiar with the qual data used in this video. However, I wonder, if it was a new data set, what would your strategy be in familiarising with it? would you do open coding manually/ with Nvivo or would you first ask AI to generate codes and then do focused coding? or would you do both in parallel? Also, you've mentioned there will be part2 and 3 (don't remember about the 3rd one) in this series of TA with chatGPT. Will you talk/show that you also familiarise yourself with data in a 'traditional' way, i.e., before this AI tool? thanks!
thank you for your question. In this video I only wanted to show how to create the codes. As I explained, ChatGPT should only be used if you want to support your own work, rather than something to be used separately. If I was using this method (normally I use NVivo), I think there are several variations to be used. You can either rely fully on the codes and associated extracts (thus, not read the transcript as a whole, but rather "learn" it from codes - remember, if you did the interviews, you are also pretty familiar with the data already, right?), or quickly skim through the texts and then ask the bot to do the codes as I did here, or even do your own coding (e.g. in MS Word - i have a video about it), and then ask chatGPT to also do it, thus validating the codes even more. I do not have a single answer to your question, as all of this is new to me too
Здравствуйте Асель! Просматривал это видео и увидел ваш комментарий и понял что вы с Казахстана (надеюсь я верно подметил). Согласно данному видео, автор указывает, что можно проводить анализ текстов (при помощи кодировании текста)?! Я пытаюсь понять применения данных методов. Может у вас есть другие способы анализирования текстов (больших текстовых данных)?!
Здравствуйте@@FrtnY ! Я только увидела ваш ответ; я использую программу MAXQDA для анализа текстовых данных. Возможно, она и вам подойдет. Насколько у вас большие текстовые данные ?
Thematic analysis, reflexive thematic analysis, grounded theory analysis, all of this is done in this way. Except for specific models (such as Brown and Clarkes' one) where more steps are provided. As I often explain in many videos, these approaches are not as different from each other as the authors describing them would like it to be the case
I believe someone has already done that in the comments. Also, you may check my website for an ebook where I share much updated and more detailed version of the prompts
Hey, thanks for the super useful video. I have a question: do you think it would work the same if instead of adding the interview/text in the message, I attach a file with the full interview to be coded? I'd only do this because of the lenght of the interview.
Hello Dr. Kriukow. Can you recommend how I would revise your process if I wanted to use Chat GPT for deductive coding of pre-established codes in support of a theoretical framework from my literature review. I like how you are using this tool but I don't plan on using open coding or an inductive approach. Any advice you can share is appreciated.
Never thought of it before, but I imagine I'd list all the pre-determined codes, explain the purpose of the study and ask GPT to code the data (which I would upload as a file if I'm using GPT4, or paste if the earlier version) and list quotes that match each of these codes
I don't have one specific solution to this, you'd just need to find a way to indicate them somehow, if not by colours then by different fonts, sizes, etc
Hello,, I would like to ask please if am conducting a qualitative research about a brand like Gucci so my data collection is through document and books only, how to gather data? do I take quotes from documents as data to later categorize under themes, then analyze?
yes, if you are doing document analysis, or any other secondary data analysis, you treat it just as you would treat any other data, which means using quotes from it too
I believe someone has already done that in the comments. Also, here is a video where I go into more detail of this process th-cam.com/video/rAfZOh3_p3k/w-d-xo.html
I have one question: if I used ChatGPT in the analysis of my dissertation data, would my university website identify that this generated by AI, especially talking about the quotes.
haha please that's the keyword you never know :D In my opinion, chatgbt do not store any kind of info so it wouldn't be an ethical issue .. What's your say on this?
please If you don't mind I would like to discuss something private concerning Nvivo with you. I will be glad if you can reach out. Hope to hear from you soon. Thanks
the rates should be on my website, it is 25GBP/1000 words, although discounts are available for larger documents like yours. The best way is to reach out through the email provided on the website - drkriukow.com
Thank you so much! While my dissertation is in review. I am going to use ChatGPT to code my transcripts just to compare the results out of curiosity. For my study, I used NVIVO 12 following your videos which were crucial to understanding the data analysis process using NVIVO.
new subscriber here! Could you please provide me with a prompt for asking chat gpt about determining politically correct phrases and gender stereotyping in English moduls? We will do document analysis in English modules for students in grades 8 to 10 to see if there is still gender stereotyping in learning materials master.
apologies for the delay. In terms of the prompt you asked for, you will need to experiment and do a bit of a trial and error and see what it "says", but I expect it to be fairly good at following what you described above, even in the same language. If it is confused, you just need to try to break each task into smaller chunks and be Very clear when you explain things to this tool :)
there is part 2 of this video. Once you generate your final set of themes, just write a report on your findings (I have a video about that too), using some quotes from the data, this is why I said it is important to have access to quotes
you should try and experiment with it. I am guessing that it would, but you would constantly need to monitor it, as it sometimes randomly goes nuts :) I was, for example, using it to translate some text that was written in another language, and it was doing an absolutely amazing job until it just randomly decided to start generating some text it just came up with, instead of translating what I was giving it. so chatGPT definitely needs someone to monitor its work :)
ChatGPT directly, or tools Based on ChatGPT (see my other videos in which I talk about SciSpace th-cam.com/video/lwAPOclunnE/w-d-xo.html&ab_channel=ResearchwithDrKriukow) that summarize the literature, provide main points, etc. Super useful! You do eventually want to read the literature yourself, of course, but these tools may automatize and speed the process up and make sure you are not wasting time reading things you do Not need to be reading
you would either need to break them down into bits and upload separately, or buy the premium version - which enables you to upload files to chatGPT. At first I did not think this is a good idea but eventually I got myself that premium version as I do use this tool a lot (not for analysis but in general for lots of things related to my business). I can't remember the exact price but it is not too much
Good question and one I still do nto have answers to - this is why I do not currently use it for any sensitive data. I believe, however (although you would need to double check) that they do not store any of that data. The model is based on what was originally available up to 2021 I think, so it does not add any new data to its database - but again, you do need to doublecheck that first to be sure
I saw an example where the text described something that was released after 2021 and got it wrong. It looked great until a closer look showed the new model # was impossible.@@qualitativeresearcher
as soon as I manage, I will try within the next 3 days - I spent whole morning today trying to do it but chatGPT kept crashing because of the number of users on it ;) will try again soon (and most likely this will be a part 2 and 3 video together)
you don't analyze yes/no answers thematically - if that's all you've got, it means your data is more quantitative and you need other methods to analyze it
it is something I have been thinking about to be honest. You may be right that this may not be acceptable from the point of view of ethics, as I am not sure about the protection of the data we input into ChatGPT, but otherwise I think this would be a brilliant way to validate our coding!
"You are a researcher. I will now upload an interview transcript, and you will do what is called qualitative coding - specifically, initial coding also known as open coding. The text is an interview transcript, I do not want you to code the questions asked by the interviewer. I want the codes to be detailed and descriptive. I want you to apply codes to sentences or parts of sentences, and later when you develop a list of codes, I want you to be able to tell me what sentences or parts of sentences these codes were applied to. In other words, when I ask you to provide me example quotes for the codes that you create, I would like you to be able to do it. Here is the text to be coded:"
there is definitely video in this, so must be something on your end. Are there specific sections where this happens? I double checked, and there is definitely video throughout
![3 Ways to Create PowerPoint Presentations with ChatGPT [for Teachers]](http://i.ytimg.com/vi/JmVWz2PFVA0/mqdefault.jpg)
Visit my website and explore the different ways in which I can support you and your study! drkriukow.com/my-services/
Prompt 1:
You are a researcher. I will now upload an interview transcript, and you will do what is called qualitative coding - specifically, initial coding also known as open coding. The text is an interview transcript, I do not want you to code the questions asked by the interviewer. I want the codes to be detailed and descriptive. I want you to apply codes to sentences or parts of sentences, and later when you develop a list of codes, I want you to be able to tell me what sentences or parts of sentences these codes were applied to. In other words, when I ask you to provide me example quotes for the codes that you create, I would like you to be able to do it. Here is the text to be coded:
Prompt 2:
Please develop more detailed codes. I would also like the codes to be a bit more descriptive, and please separately list quotes that show all sentences or parts of sentences coded with each code.
Prompt 3:
You are a researcher. I will now upload an interview transcript, and you will do what is called qualitative coding - specifically, initial coding also known as open coding. The text is an interview transcript, I do not want you to code the questions asked by the interviewer. I want the codes to be detailed and descriptive. I want you to apply codes to sentences or parts of sentences, and later when you develop a list of codes, I want you to be able to tell me what sentences or parts of sentences these codes were applied to. In other words, when I ask you to provide me example quotes for the codes that you create, I would like you to be able to do it. Here is the text to be coded:
I want you to use exactly the same approach and the same format as you did above.
Prompt 4:
I would like the codes to be more descriptive, longer and more detailed. And also include the quotes for each code underneath.
Thanks for the effort! :)
Thanks for the insightful video. Looking forward to see the rest of the series!
Very useful video as always! I'm currently working on the thematic analysis of my Master Dissertation, so the timing couldn't have been better 💯
glad to hear that!
Hey I am also working on my dissertation could you help me in this?
@@aditiyadav8544i can. I write academiic papers for masters and phd students
Wow, this video is amazing!😲 Your programming skills are truly impressive.
Dr Kriukow just gained a subscriber. Your approach has helped me crack my coding stage and I am extremely grateful for this. Onward and upwards sir!
Two subscribers, indeed.
Welcome aboard! :) Glad that I could help
Pp
I have watched several videos where qualitative research experts have used ChatGPT to support the analysis process. Most of them have concluded that, ChatGPT is not reliable in some cases for the analysis task. What is really going on is not inefficiencies in ChatGPT. It is in the inaccuracy, misalignment or ambiguity in your prompts. Generating Efficient prompts is a specialist area - prompt engineering. What you need is expert understanding of prompt engineering - specifically learning how to generate efficient prompts for qualitative research. It is not about typing what you want in plain English. Evidently, if one keeps modifying the prompts, you will eventually hit an aligned prompt and then get what you want. Learn prompt engineering or you will inadvertently ask ChatGPT to hallucinate. Yes, you asked it.
thanks for sharing !
I'm not a "qualitative research experts" but I second this. I've tried both GPT-3.5 and GPT-4 and both cannot provide nuance and comprehensive result, especially when we provide them a chunk of data and straight asked them to analyze. However, after quite numbers of trials, I've found that it can be done but through "little by little" (explained in my 2nd paragraph), and for now it only works for identifying codes. First, I need to "establish the thematic process" with the GPT before I start asked for the code. I've provided them with 1) the title of my study, 2) my research objective that require thematic, 3) the condition of the "data collection", like in my case is a series of sessions (longitudinal study), number of participants and groups (treatment vs control) and 4) example of previous studies' "Thematic methodology". So, the GPT will establish the process or steps that we are going to do, including the details such as inductive/deductive, critical-realist perspective, or whatever needed. Second prompt is, I asked GPT, based on that (the established steps with details), I will provide him a table of subject and the question (type what is the question), where the subject's first letter indicate which group they belong to (e.g., T01 for treatment, C01 for Control), for total of number session (in my case is 8). For each subject's response, I want the GPT to provide the details such as a "nuance inductive coding" based on the research objective (repeat again to remind) based on the condition of each group, and specifically based on the question asked (repeat again to remind, type again the question). The "code" must be together with the "quote" and "reasoning", and list again for only the quote (so that I can have 2 data in a column for the "code, quote, and reasoning" which is for my future reference for further thematic steps, and list of "quotes" only so that later it is easy for me to do the next thematic step.
I have tried posted whole column "subject" and "questions/response". After that, I posted again but 1 time for each subject, and I can see that a data from single subject has more codes, and it has better results in my own judgement of my study. I've tried 2 subjects at 1 time, it still provides quite decent result, but I'm so lazy to try 3,4,5 and so on. This is what I meant by "little by little". Both GPT-3.5 and GPT-4 will go NUT if we provide too many data to interpret, and it is undeniable that there are difference results between using GPT-3.5 and GPT-4, but don't forget that GPT-4 has limit caps, like 50 prompt per-3 hours.
This method requires hard work as if were doing the thematic in a traditional way with a little help of the technology. And of course, we still need to manually verify and validate each result as well before moving to the next themed step (which has already listed in the established thematic step above). However, this is just my ignorant opinion, that, the "reasoning" ability provided by the GPT itself (assuming after we have validated and approve it) is a good handicap compared to using other software. Other software like Nvivo Atlas.ti does have the "reasoning" ability, but they did not provide as what GPT can do. But yeah, they were more easy and faster way to get a similar decent result as using this "semi-traditional" way - unless the GPT can remain "sane" with a chunk of data to interpret. Thats my 2cents.
Dr. G. Your chat GPT was VERY informative..I look forward to reviewing How can I get a transcript coding theme analysis using Microsoft WORD that you were referring to and an NVIVO TUTORIAL? I have all my data for my dissertation in transcript
I need to expedite coding and theming in an accessible ethical way. Please guide me ....
Very grateful to have found your
page...
I have use chatgpt 4.0 and its powerfull results i got. Please use the right prompt. 😊
Have you tried the new chatgpt features with data analysis? I also found that you can continue to “train” or submit more detailed information within a given chat session to beef up the AI’s process around a given area
Having tried this, so far ChatGPT is not showing any worthwhile ability for open coding as far as I can see. Tempting, but not a good use of time for me at the moment, to try it with deductive coding. Thanks for the video though.
I agree. I definitely still prefer software that were specifically designed for data analysis, but with the current AI capabilities, I don't think we are far from the point where it will indeed surpass this kind of software
Looking forward to part 2 Doctor. Thank you for helping us expand our skillset during this AI revolution.
you're welcome, part 2 coming at the end of this week
Hello,
How to use literature based study based on thematic analysis
🎉You have earned yourself a subscriber Dr🎉
I have used the method mentioned in the video and it is indeed a very effective method, thank you. I only have concerns about the data entered into chatgpt. For example, I entered interviews for my university research and quotes were extracted from them via chatpgt under each code, which I will use them in the data discussion section. Will Turnitin not recognize the quotes as 100% AI generated, even though they are originally my raw data?
I cannot tell you for sure how this works, as I am not a programmer, but in my opinion, this would not make sense - since this is your original raw data. One thing you may try, and I know this will sound weird.... is to ask ChatGPT about these things - you will be surprised, I think it may actually give you the answer to this query
Part 2 and 3 would be wonderful, many of us are working on their dissertations right now
I will be posting it later this week
Hey Could you connect with as I need help in my dissertation
i will get the best grade!! top!!!
Thank you! I always learn a lot from you Dr!
Thank you , I'm glad to hear that this content is useful!
Great video Dr Kriukow, thank you, I found it really interesting. I'm currently coding the interview transcripts from the first study of my PhD by hand using NVivo 12 for Mac (that’s a learning curve). I found ChatGPT really helpful in learning how to use NVivo, much quicker and easier than trawling through the manual (mostly). I’d be interested to know, if you cover it in your next video, how you might integrate ChatGPT with using software like NVivo - I can imagine myself using ChatGPT later in the process to compare AI generated codes with my ones - a sort of triangulation/quality check on my codes and themes to see what I might be missing (subject to ethical approval, as you've already discussed!).
thank you for your question. One way to integrate chatGPT with NVivo would be to ask chatGPT to found codes/themes related to something specific we have in mind (or maybe just ask it to create Any codes or themes), making sure to instruct it to specify quotes for each code/theme (also specify that you want the quotes in the original, raw form - with no corrections from the bot, as it likes to do so), then you can locate these quotes by the text search option in NVivo (this is why you need the raw form, so that you can just copy and paste the quotes) and code them, using the code ideas from chatGPT
This is amazing. Is part 2 ready?
I will be posting it later next week
@@qualitativeresearcher Thank you, Dr. Would code sorting and grouping into themes be done manually or through ChatGPT?
Great video Dr, but isn't it breaching the confidentiality of the respondent's interview transcription? and isn't it risky to put the transcriptions on chatgpt before submitting the thesis?
Yes, as I replied to a similar comment, I think that before it is confirmed what exactly is done to the data and whether it is being protected, this may indeed be an issue from the ethical point of view. I expect this issue to be addressed in the coming weeks or months, as it is certainly an important one
Before you copy the text, make to remove anything that would breach confidentiality. @@qualitativeresearcher Example change names of people or places
Hi, Dr. Kriukow, your videos on the use of chatgpt in text analysis are useful. I am learning them for my own research. I am wondering if there are academic articles on the coding skills taught in the videos for my references to a proposed paper for a journal. Looking forward to your professional support and thank you very much for that~~from Dr. Weiwei Zhang.
The process I use was influenced by Constructivist Grounded Theory, described, among others, in a book by Charmaz "Constructing Grounded Theory". This is not to say taht you can only use this approach if you are doing a GT study - I have been using thsi approach in a variety of studies, hardly any of them being grounded theory
@@qualitativeresearcher thanks for the kind and detailed reply~~very informative~~
Such as great video. Just a quick concern, if you use chatGPt for paraphrasing and literature review, can it be caught by AI detectors? Can you make a video on the best AI detectors please? Thank you
I believe it will be detected if you are using it for writing your literature review or any other parts of your thesis. I would also never recommend doing this for many other reasons
If you use it for literature review be sure to actually look up the source and read it and then cite it. You also need to include the AI output as an appendix of your work. If you do that, you shouldn't have to worry about the AI detectors
Will this get plagiarized if we use this approach?
You would need to ask the developer what their rules for this are but I do not think you would have issues with plagiarism
Is that academic ethically to put the chat-GPT as tool which help our analysis in our research report or research article just like others analysis tools (nVivo, atlas.ti, etc)?
it is, if you use it ethically. However, convincing the academic community that this is acceptable and ethical is a completely different story! :)
Love the little cartoon inserts lol. Thanks. Makes it more human 🙂
Thank you! :)
helpful thank you! im using this for an open-ended qualitative survey, however im running into an issue that after giving me an initial set of 6-8 codes it then goes on to make up the rest of the quotes when i ask for more codes. Is there a way around this?
This is the main problem with Chat GPT, I think. I guess it's just trying to consistently ask for more, or maybe breaking the data up into chunks that are easier for the AI to digest? I know it can be annoying
This is just wonderful! Conducting my first interviews for my UX-career, and love the approach!
Hi, thanks for your helpful videos . I've got a question: DO I NEED A SECOND PRSON TO CODE MY DATA? I mean, I finish coding and ask a second rater to code my data to increase reliability of coding?
You do not. some people do this but this is entirely optional, and there are also many reasons Not to do this. I never do it
@@qualitativeresearcher thanks 😊 🙏
I want to analyse job interviews. Qualitative analysis tells what was said but not if it was the right answer and what to do better to be more successful. I now experiment with custom chatgpt and include reviewing each answer on a scale for relevance and the use of STAR .
Using chatgpt is a very interesting approach. You dont need so much programming skills and can use common sense. It works for processing small amounts of high value data. It might be slow and costly for large amounts.
Thanks for the video i will look at all the other material.
New subscriber here! Thanks for all the knowledge you've been sharing. How has your experience of using ChatGPT been for coding in terms of completeness? I mean it seems like we're entrusting the initial coding to it, but how confident are we that it actually emulates going through the text line by line?
It is, as I often stress, a bit of a hit and miss. I think the only way to really entrust it is to make sure that we provide it with smaller chunks at a time (so I would definitely not upload several transcripts - rather, I would do one by one and even then I think you would need to monitor it closely, ask questions, evaluate etc)
@@qualitativeresearcher thanks!
Very helpful! Do you need a paid version of Chat GPT for this? I think you can do this in the FREE version - can you confirm please?
you can do this in the free version, the only difference is that you have to then paste the transcript into the chat (the paid version lets you upload the whole file)
How will i do the coding if my researchs were not deductive i mean if its not in the form of interview . I mean the research may contain case studies differrent AI models and stastical analysis.
The idea of qualitative research, and grounded theory specifically is to arrive at new theory based on data.
I tried to use it a few times. It does not work for in depth qualitative coding. ChatGPT has the tendency to find “reasonable theory” based on the historic training data. So you will likely not arrive at new rigorous insightful theory.
this is why you should definitely control the whole process, and I would definitely leave the theory generation to a human, I agree. I may only, if anything, use GPT's assistance for coding (provided that, again, I am overlooking the process)
Hello, Dr Kriukow. Based on your previous videos where you used the same dataset, it's clear that you're familiar with the qual data used in this video. However, I wonder, if it was a new data set, what would your strategy be in familiarising with it? would you do open coding manually/ with Nvivo or would you first ask AI to generate codes and then do focused coding? or would you do both in parallel?
Also, you've mentioned there will be part2 and 3 (don't remember about the 3rd one) in this series of TA with chatGPT. Will you talk/show that you also familiarise yourself with data in a 'traditional' way, i.e., before this AI tool? thanks!
thank you for your question. In this video I only wanted to show how to create the codes. As I explained, ChatGPT should only be used if you want to support your own work, rather than something to be used separately. If I was using this method (normally I use NVivo), I think there are several variations to be used. You can either rely fully on the codes and associated extracts (thus, not read the transcript as a whole, but rather "learn" it from codes - remember, if you did the interviews, you are also pretty familiar with the data already, right?), or quickly skim through the texts and then ask the bot to do the codes as I did here, or even do your own coding (e.g. in MS Word - i have a video about it), and then ask chatGPT to also do it, thus validating the codes even more. I do not have a single answer to your question, as all of this is new to me too
Здравствуйте Асель! Просматривал это видео и увидел ваш комментарий и понял что вы с Казахстана (надеюсь я верно подметил). Согласно данному видео, автор указывает, что можно проводить анализ текстов (при помощи кодировании текста)?! Я пытаюсь понять применения данных методов. Может у вас есть другие способы анализирования текстов (больших текстовых данных)?!
Здравствуйте@@FrtnY ! Я только увидела ваш ответ; я использую программу MAXQDA для анализа текстовых данных. Возможно, она и вам подойдет. Насколько у вас большие текстовые данные ?
Which type of thematic analysis is hown in the video?, could you provide some sort of reference to it? thankyou
Thematic analysis, reflexive thematic analysis, grounded theory analysis, all of this is done in this way. Except for specific models (such as Brown and Clarkes' one) where more steps are provided. As I often explain in many videos, these approaches are not as different from each other as the authors describing them would like it to be the case
Fantastic learning...would you be ok sharing your prompts?
I believe someone has already done that in the comments. Also, you may check my website for an ebook where I share much updated and more detailed version of the prompts
Hey, thanks for the super useful video.
I have a question: do you think it would work the same if instead of adding the interview/text in the message, I attach a file with the full interview to be coded? I'd only do this because of the lenght of the interview.
yes, if you have the Plus version, then there is no reason not to attach the file :) At the time of recording, I think I could only paste the text
Hello Dr. Kriukow. Can you recommend how I would revise your process if I wanted to use Chat GPT for deductive coding of pre-established codes in support of a theoretical framework from my literature review. I like how you are using this tool but I don't plan on using open coding or an inductive approach. Any advice you can share is appreciated.
Never thought of it before, but I imagine I'd list all the pre-determined codes, explain the purpose of the study and ask GPT to code the data (which I would upload as a file if I'm using GPT4, or paste if the earlier version) and list quotes that match each of these codes
Thanks for this. I wanted to know about colour coding - in terms when we have several participants, how to identify
I don't have one specific solution to this, you'd just need to find a way to indicate them somehow, if not by colours then by different fonts, sizes, etc
Hello,, I would like to ask please if am conducting a qualitative research about a brand like Gucci so my data collection is through document and books only, how to gather data? do I take quotes from documents as data to later categorize under themes, then analyze?
yes, if you are doing document analysis, or any other secondary data analysis, you treat it just as you would treat any other data, which means using quotes from it too
Furthermore, yout teaching is so kind! You keeps us smiling while you teach us
I really appreciate you sharing this, really happy that my teaching makes the topic of research and data analysis a little bit less daunting :)
great dr Krikow can you send me prompt of that vedio or any respected member send theses prompt .much appreciated for this kid act
I believe someone has already done that in the comments. Also, here is a video where I go into more detail of this process th-cam.com/video/rAfZOh3_p3k/w-d-xo.html
I have one question: if I used ChatGPT in the analysis of my dissertation data, would my university website identify that this generated by AI, especially talking about the quotes.
Unfortunately, I do not know the answer at the moment of how the data is being stored and treated by ChatGPT
Thank you so much for your videos, they are helping a lot in my PhD research
you're welcome! I'm glad that you're finding this content useful
haha please that's the keyword you never know :D In my opinion, chatgbt do not store any kind of info so it wouldn't be an ethical issue .. What's your say on this?
I am really not sure. If it does not store anything, it's a good thing (for ethics), but I am really not sure, I just don't know enough about this
Please can you explain in detail in your next video what chatGPT is and how it's operate
Inspiring!I still have to figure out how to apply it to my bio molecular research 😢
please If you don't mind I would like to discuss something private concerning Nvivo with you. I will be glad if you can reach out. Hope to hear from you soon. Thanks
you can reach out through my website, thanks
@@qualitativeresearcher what’s your website please
Hi, Dr. How much will you charge for PhD dissertation proofreading? It's about 80000 words on the topic of English learning.
the rates should be on my website, it is 25GBP/1000 words, although discounts are available for larger documents like yours. The best way is to reach out through the email provided on the website - drkriukow.com
Could you please explain me what you are pasting first into chatgpt
I read out all the prompts that I use in the video. These are just prompts I previously wrote to save time on the video
Thank you so much! While my dissertation is in review. I am going to use ChatGPT to code my transcripts just to compare the results out of curiosity. For my study, I used NVIVO 12 following your videos which were crucial to understanding the data analysis process using NVIVO.
Glad it was helpful!
new subscriber here!
Could you please provide me with a prompt for asking chat gpt about determining politically correct phrases and gender stereotyping in English moduls?
We will do document analysis in English modules for students in grades 8 to 10 to see if there is still gender stereotyping in learning materials master.
apologies for the delay. In terms of the prompt you asked for, you will need to experiment and do a bit of a trial and error and see what it "says", but I expect it to be fairly good at following what you described above, even in the same language. If it is confused, you just need to try to break each task into smaller chunks and be Very clear when you explain things to this tool :)
It would be helpful if you had written out the prompt you used as a model
I believe someone has done that in the comments :)
Hi Dr. Can you tell me a method to use ChatGPT to write up my findings after second cycle coding?
there is part 2 of this video. Once you generate your final set of themes, just write a report on your findings (I have a video about that too), using some quotes from the data, this is why I said it is important to have access to quotes
This is thought provoking I am following all your presentations.
Please upload part 3 . I have my presentation soon
there is no part 3, I explain this in the video
Dr Kriukow, thank you for all of your insights. I'm wandering if this would work if you gave it a large set of pre-codes to code against?
you should try and experiment with it. I am guessing that it would, but you would constantly need to monitor it, as it sometimes randomly goes nuts :) I was, for example, using it to translate some text that was written in another language, and it was doing an absolutely amazing job until it just randomly decided to start generating some text it just came up with, instead of translating what I was giving it. so chatGPT definitely needs someone to monitor its work :)
In literature review how chatgpt would be helpful for researcher?
ChatGPT directly, or tools Based on ChatGPT (see my other videos in which I talk about SciSpace th-cam.com/video/lwAPOclunnE/w-d-xo.html&ab_channel=ResearchwithDrKriukow) that summarize the literature, provide main points, etc. Super useful! You do eventually want to read the literature yourself, of course, but these tools may automatize and speed the process up and make sure you are not wasting time reading things you do Not need to be reading
Hi sir can you also share the prompts please?
I'm pretty sure I shared it in one of hte comments
Heads off to you sir for such a helping content. Regards
It's my pleasure!
How do you handle situations when you have interviews in excess of 3000 words pls?
you would either need to break them down into bits and upload separately, or buy the premium version - which enables you to upload files to chatGPT. At first I did not think this is a good idea but eventually I got myself that premium version as I do use this tool a lot (not for analysis but in general for lots of things related to my business). I can't remember the exact price but it is not too much
Is this one still AILYZE?
I love these videos .. very informative and well presented
Thank you! Hope to keep doing this , and comments like yours keep me going!
Would love to see a how to qualitative coding guide using YouAI !
never heard of it, need to check this out
Thank you. This is so helpful. I have saved this to look at a few more times. 😊
Glad it was helpful! I have another one on this topic (either the most recent upload or one of the most recent ones) that I think will be useful too!
Awfully good! Thanks for sharing such information.
Glad it was helpful!
Hello Dr. Can you please tell me how to get the ideal version of Nvivo to start your course for N Vivo. I cant do it through my laptop. Please help
My course is on NVivo R1 (release one), and you will need to go through their website to purchase the license
@@qualitativeresearcher okay sir thank you. You are absolutely a saviour.
How do you cope with the ethical issues of uploading transcripts in ChatGPT which then absorbs that content into its repository?
Good question and one I still do nto have answers to - this is why I do not currently use it for any sensitive data. I believe, however (although you would need to double check) that they do not store any of that data. The model is based on what was originally available up to 2021 I think, so it does not add any new data to its database - but again, you do need to doublecheck that first to be sure
I saw an example where the text described something that was released after 2021 and got it wrong. It looked great until a closer look showed the new model # was impossible.@@qualitativeresearcher
This is very helpful. When is part 2 and 3 coming ?
as soon as I manage, I will try within the next 3 days - I spent whole morning today trying to do it but chatGPT kept crashing because of the number of users on it ;) will try again soon (and most likely this will be a part 2 and 3 video together)
@Research with Dr Kriukow you're incredible I hope you're told this enough
@@qualitativeresearcher Awesome, thanks looking forward to it...
@@Xeando Completely agree...
How do I conduct initial coding with self-assessment checklist with yes/no responses?
you don't analyze yes/no answers thematically - if that's all you've got, it means your data is more quantitative and you need other methods to analyze it
@@qualitativeresearcher thank you for the response! This was really helpful
Perfect explanation, I got it easily. thank you
Glad it helped!
Thank you for your excellent videos! I could use ChatGPT to verify my coding? My supervisors are very busy 😆
Except I cannot as I do not have ethical approval!
it is something I have been thinking about to be honest. You may be right that this may not be acceptable from the point of view of ethics, as I am not sure about the protection of the data we input into ChatGPT, but otherwise I think this would be a brilliant way to validate our coding!
Thank you ❤
I tried your prompt! Wow it is amazing!
Glad you like it!
❤
Love it, great great great VIDEO
Thanks so much!
Prompt plzzz
someone put all prompts in one of the comments
Please can you share your prompt
"You are a researcher. I will now upload an interview transcript, and you will do what is called qualitative coding - specifically, initial coding also known as open coding. The text is an interview transcript, I do not want you to code the questions asked by the interviewer. I want the codes to be detailed and descriptive. I want you to apply codes to sentences or parts of sentences, and later when you develop a list of codes, I want you to be able to tell me what sentences or parts of sentences these codes were applied to. In other words, when I ask you to provide me example quotes for the codes that you create, I would like you to be able to do it. Here is the text to be coded:"
Can you please share your 2nd and 3rd prompt
Just treat the chatgpt as a child who is struggling to focus 😂
Thank you
You're welcome!
Hi, is the next one available?
I will be posting it later next week
@@qualitativeresearcher I will be happy if you could compile everything into Part 2 as we are running out of time. Thanks
following
Voice is there but no video, why?
there is definitely video in this, so must be something on your end. Are there specific sections where this happens? I double checked, and there is definitely video throughout