👉 SQL Basics with Healthcare Data | 1 Hour
ฝัง
- เผยแพร่เมื่อ 27 มิ.ย. 2024
- Learn the basics of SQL in this 1 hour tutorial! We will be using a modified version of Synthea, a synthetic patient database. We will also be using a free type of SQL called PostgreSQL to learn how to upload, and query patient data.
Update: the header option 16:57 is going to be frozen when you import the txt files. You do not need to click on the header. It will be 'off' by default.
💻 This link for the github SQL script you will need: github.com/Data-Wizardry/SQL-...
📁 Click here to obtain the data for this tutorial: datawizardry.academy/sql-basi...
You will have to provide an email; then you'll be sent 2 emails. The first confirms that you're not a bot, the second contains the lesson files. Check your spam folder if you don't see anything.
💊 Become a Clinical Data Analyst! My course teaches you everything you need to know in just 10-12 weeks: datawizardry.academy/clinical...
00:00 Intro
01:34 Why SQL?
04:08 Installing PostgreSQL on PC
06:10 Installing PostgreSQL on Mac
10:05 Loading Data into SQL
Synthea: 17:32
SQL Intro: 20:09
What are Patient Encounters: 24:16
WHERE CLAUSE: 27:54
GROUP BY: 38:02
ORDER BY: 40:14
HAVING: 42:00
Practice Questions 45:20
Intro to Joins: 55:00
#sql #postgresql #sqltutorial #dataanalytics #healthcaretechnology - วิทยาศาสตร์และเทคโนโลยี
A question about the header option @16:57, in the import step, came up a couple times:
The header option is going to be frozen when you import the txt files. You do not need to click on the header. It will be 'off' by default.
Thanks Josh. Don't be discouraged if your channel isn't huge yet. This is a niche channel but it's invaluable for your target audience and we really appreciate your content. 🎉
Yeah, we really do...am happy I found you. I will love u b my mentor as a Healthcare analyst. Still waiting for your course. Can't wait
One question, is have MBA in Healthcare necessary as a health care analyst
@@stevetheanalyst No i dont think its necessary
yess sir
Favorite SQL tutorial! Please drop more project videos ☺️ I am enjoying building my own portfolios!
Keep up the good work Josh! I have an interview on Monday and learned many healthcare concepts from your video made SQL EASY! Thank You!🤝
Sure thing! Good luck! Fingers 🤞
Something helpful is the explanation of these medical terms. I know a lot of people are coming from a medical background but missing the data skillset, but for someone who has the inverse, it's helpful for me to learn some of these as well.
I am a Nurse transitioning into data analytics and i am so excited to have found your channel. Can't wait for the accelerator course.
PT here.
Have you guys joined any academy or any certifications?
Thank you so much, Josh. This is the first TH-cam tutorial I followed through without getting stuck. You're so good at what you do, Josh.
Thanks Esther! Glad it was easy to follow!
From the age of 21, my career has been in healthcare. For 7 years, I served as a unit secretary, transcribing doctors’ orders. Initially, it involved paper charting, and I remember consulting with other secretaries from different floors to ensure accurate interpretation to avoid errors. Later, I worked as a Clinical Data Abstractor in the Cancer department. Presently, I’m still in the healthcare field, focusing on billing, and I am currently making the transition to become a Healthcare Data Analyst. I’m enjoying the videos!
That's awesome, I also did data abstraction. Glad you're enjoying the videos!
Amazing intro, looking forward to learning more from upcoming videos
I just graduated with my masters in data analytics with a concentration in healthcare analytics. I am job hunting and mass applying and it sucks lol. This video teaches me things even in my curriculum I never learned. You are awesome, thank you
Thanks for this Josh! So helpful. I've been learning/practising SQL for a few months but haven't been able to practice on healthcare data. This is a perfect start, thank you!
Josh, your channel is so helpful and has helped guide my career/education path more than any college class I’ve taken. Thank you for your content!
Just wanted to say thank you! This is the perfect step by step tutorial.
i LOOOOVE your videos! i am in public health and want to transition into healthcare data analytics without going back to university. i just want you to know that your channel has been a tremendous help to me because there is a lot of info out there on different programs which can get very confusing. it makes me rlly happy there's someone on youtube who's focusing on healthcare because this is the field i wanna stick with. thanks so much for the tutorial!
Thank you so much for making this in depth tutorial! I've taken some other courses on SQL and this was by far the most clear and concise for a beginner. I can't wait to watch your Joins tutorial next.
Great help .I'm beginner with zero SQl knowledge but with health care background and interested to become health analyst.Thank you for you videos
Ditto.
Just found your channel. Nice to find someone that shares content I can relate to. Love your step by step too. Thank you!
Mannn this channel is blowing my minddddd I LOVE IT. Thanksss a lot dude
I have taken many courses on SQl and this is the best one that made it clear and easy to follow along. Thank you for your taking the time to make this video!!
@Cloak2248 Thank you for your kind words!
I am working on a website to store my tutorials and am collecting testimonials. Would it be okay if I list your comment as a testimonial on my website?
Thanks for this Josh. Will be looking forward for more health care centric videos
Yes he is the best youtuber from whom i learned many new concepts. If you want you can checkout my channel, i have projects on healthcare data.
My favourite SQL tutorial so far! 💙 Thank you and please: keep going! 🙂
Will do!
Thank you for this video! I work down the road from you, but loving the content.
omg your explanation is straight to the point, thank you for the video.
LOVE the practice problems 🙏
Glad they were helpful!
This is a really good video for me as I've only just started learning SQL and data analytics. Thank you for being so generous with your resources!
Omg thank you so much ! Just found your channel you are a blessing
This man is doing gods work 🙌
This is great and it has come in handy as i need to improve my skills in SQL, thanks alot i watched the video and i did all the exercises untill the end. i loved the way i accessed the data you used here, great job, waiting for more.
Data Wizardry you the best am going to check all your video and learn all I need to know and also register to your course I really need this to grow. thanks once again for this knowledge.
Glad it's been helpful!
You've got a new subscriber, thanks alot bro
You teach so well Josh and your videos are really good, even better than in the boot camp I was in. Thanks for your channel.
Thank you!
Very Useful video. Many thanks Josh for this great work.
Thank you for this tutorial, really well made video and easy to follow along. I'm sure your channel will grow very quickly!
Thanks @sebastianquirarte6705!
Wow! This is very informative. I am staying here with you. I am your target audience as a healthcare provider that is transitioning into this space. I was getting discouraged until I found this YT. Now I am tuned in and you make it very easy to follow along. I am now grasping this new language. Well, done 🎉. Thank you
Glad you're liking my videos, welcome to the channel!
This Channel is really awesome bro as a fellow healthcare professional I salute!
Thank you!
I'm glad I found your channel... I've always wanted to be a Healthcare Data Analyst
Glad you're liking it!
Same. If you want you can checkout my channel, i have SQL projects on healthcare data.
in fact your videos are very useful I even think they are the best. Thank you for your help.
Very insightful
Watching your videos is like listening to mind therapy. Lol...Amazing videos mannn.
Love Your Videos
thank you so much for your valuable content.
thanks for this knowledge.
Sure thing!
16:09 Encounters files is via a separate Dropbox file
Great and super helpful video, thank you so very much!! :DD
Glad you liked it!
Good job, well tutor
Hello Josh!. I am from Nepal. I don't know if you have heard about my country. :) I don't usually comment on videos but the topics that you are covering are something extremely helpful and please don't get demotivated with the views as your channel is still growing. I am BSc. Hons in Computing Student Final Year and I am so much interested to be a Data Analyst specifically on HealthCare just like you. And your content are helping me a lot. Thank you :)
Yeah bro he hasn’t heard of Nepal. Lol what even?! 😂😂
Thanks
EXCELLENT video!! Thank you!
Also, I would like to make a suggestion on Topics you could consider?
Career guidance for those who have a medical background and would like to transition those skills to Data Analytics, coding etc..
Great idea! I'll add it to my list. Will also be doing a Q&A in the near future that might be a good opportunity for this.
its really very nice information would make more videos on sql and power bi combained
Thanks @Vikramhhj! Yup, I can definitely do SQL + PowerBI videos in the future!
wow, your projects are much easier to learn compared to Alex the data analyst with this SQL project. I have built three projects with a breeze with your videos!!
Glad my videos have been helpful!
Hi Joshua
Love your vids. Do you have any thoughts or can do tutorials on power query to do the first step of cleaning and organising data?
Beginner here!
Hi @queenylau4400, I don't think I've used power query before, but my understanding is that it's sort of like a data prep tool that can be used in Microsoft products like PowerBI, so cleaning and prepping the data before it gets ingested into a reporting tool.
Data cleaning can be handled in lots of ways, and there's lots of tools for that. Personally, I usually use SQL for most of my cleaning, and Python for difficult cases that aren't easily handled by SQL.
But powerquery might also be a suitable option as well.
I could definitely check it out and do a video about it in the future, thanks for the suggestion!
Can you make videos on data analysis involved in pharmacovigilance
You are so cool
Do you perhaps have a video where you discuss how to gather synthetic data using synthea ?
Hi Josh,
Thanks for this awesome video, beneficial to start from scratch. Is there any second part after this? (Not able to find it on your channel.)
There will be! I'll be doing another video soon where I'll talk about joins, and relationship cardinality (one to many, one to one, etc.).
I also plan to do a third video where I apply all of the sql concepts and build a dashboard in Tableau.
Maybe sometime later this month.
@@DataWizardry thanks a lot !!
How can I explain how thankful I am that you exist
hey josh, thank you so much for your channel. im truly grateful for the time you've put into it! as someone in healthcare who wants to do healthcare data analytics its great to learn from you. im currently practicing along with you with the data you provided us, however i noticed there was a discrepancy between my "encounter descriptions" and my "encounter codes" - i.e my codes are not ICD10 codes vs yours are. can you help me with this?
Hi. Please can you help me to know how to get datasets? I couldn't find them. 😢
Hi @KeddyWairimu,
For me to better assist, can you provide an example of what disrepancy you are seeing? (Maybe you could provide a specific row of data, and the columns you are looking at?)
Hi @rosemandjeck6551 , you receive the lesson files by submitting your email here: datawizardry.academy/sql-basics-healthcare/
Hi Josh, thankyou. Your channel is very informative and helpful. Can you please share the information about how to get a data entry job.
If you are looking for data entry jobs, look for job titles like: "data abstraction". Not a lot of experience needed other than Excel experience, (and ideally, a Bachelor's degree)
How can we get data set related to pharmacovigilance or clinical data analysis
Sir can you do a portfolio project based on health care analytics right from data cleaning to visualizations
Yup, I'll be doing some more of these videos in the future!
In the meantime, I have this one if you haven't seen it already: th-cam.com/video/RKRHozoSlVk/w-d-xo.html, an ED dashboard tutorial. Although, it isn't based off of the more realistic-looking synthea data.
Will make a dashboard off of the Synthea data soon!
This is the video I have been waiting for!!! Thanks Josh
iam not accessing the text files to fill our empty tables!! i cant access the website where the data is, i will be happy fro your reply
Question here!
¿Can I use the same code lenguage from SQL Server Managment Studio in Postgre SQL?
Thanks you
I love your content !
58:45 I was experimenting with alternative primary keys for t2; I used t2.ssn instead of t2.id (in the context of: on t1.patient = t2.ssn). This *sort of* worked (i.e. the code ran and returned the correct number rows), but it yielded empty values for the columns: first, last, birthdate. Is it because when you do a LEFT JOIN the primary key from the joining table must be in the far left column?
Hi, AMAZING VIDEO! Can you please provide the list of the codes you used during this video. Thank you :)
Sure, here is the link to my github page: github.com/Data-Wizardry/SQL-Webinar-1
Hello Josh, this is amazing tutorial. however how did you go about downloading the data from Synthia. what is the name of the data in Synthia. do you have any video on how you downloaded the data? thank you
Hi Dominic, there's a file that you have to download from the mitre corporation and then interact with using a command prompt. I'll do a video on it in the future! But if you want to learn more, I would recommend checking out the synthea git hub wiki.
At 13:53 something funky happens and it skips to after you’ve downloaded something. So, when I go into my downloads, “conditions” is not there. Can you help out? Thank you
Josh, I am applying for a grant in substance use services and I am in need of accessing public data via PostGreSQL, can you do a tutorial explaining how to access public data with PostGreSQL?
can you provide the data set for practice
Hey, thanks for the great video! Could you explain a little more what "Configure your $PATH" means when downloading the Postgres app? sudo commands make me nervous, haha.
Are you using a Mac? To be honest, I'm not good with the command line either!
I believe this step is purely optional for Mac users; what it allows you to do is write SQL from the command line if you wanted. But we won't be doing this in the current tutorial. We'll be using PgAdmin instead.
So feel free to skip this step.
Hi Josh,
Hope you are doing well. Oracle SQL, PostgreSQL, or MySQL - I come from a non-coding background. Which one would you recommend for me to learn? My laptop already has Oracle SQL. Is learning Oracle SQL fine, or should I focus specifically on learning PostgreSQL for a Data Analyst role? Looking forward to your response
I would say, any of these is fine to learn on. Once you've learned one SQL language, you've pretty much learned them all. There's only slight differences between the languages, but you should be easily able to pick up other languages very quickly once you've learned the first.
Hi, Josh. Do you know of a similar way to import the datasets into MySQL? I am expanding on my SQL knowledge, but my job works with MySQL instead of PostGRES. I'd like to use your data on MySQL, if possible.
Thank you Josh, is PostGreSQL HIPPA compliant?
That's difficult to answer, because HIPAA can be complicated. If you store real data on a relational database management system, it doesn't matter if it's PostgreSQL, Sql Server, Oracle, Snowflake, BIgquery, there needs to be policies around only giving people access only on a need to know basis. A compliance officer can help advise on these matters.
Hello I am enjoying the content so far and like how you breaking this down because this is giving me a better understanding of how this language work however when I copy and paste the content into postgres this is giving me a error message can you please assist when you can?
Hi Josh, thank you for sharing the videos on Data analysis in Healthcare. I need your help.
I tried installing Postgresql and after installation when I start PGAdmin 4 - it says "server could not be connected ". I tried using all the solutions available on net but nothing works. Kindly guide. I am a window user.
Hi Josh, thank you so much for the fantastic work and the super clear and helpful tutorial! When I imported the "conditions" table data into postgres, the software wouldn't let me select and turn the "Header" button on under the "Options" tab. Are there any solutions to this? Thank you!!
I also encountered some loading issues when first starting pgAdmin4, so I downgraded it to v7.3 and then right-clicked and "ran the program as an administrator" to start using pgAdmin4 - unsure if that's why I'm facing this issue afterward.
Hi @kanainoue8328, for the header, was the circle blue, and on the right? Or was the circle white and on the left? For mine, I found that the header button was frozen on the right position with the blue. So if yours was the same, then I think you're okay.
But for the other issue, that's weird, feel free to email me with some screenshots of the loading issues at: sqlsorcery@gmail.com, and I can troubleshoot.
@@DataWizardry Hi Josh, thank you so much for your super quick response and my apologies for my delayed reply. These were resolved!
My “Header” button option was frozen and white with the circle on the left (the button cannot be adjusted). But as you posted on your pinned comment, I realized I can still perform other regular basic SQL functions that you went over in this video with the same number of rows. The only exception I noticed is that some of the columns don’t have the proper gray borders around the queried columns/tables, but that's pretty minimal and doesn’t affect any command or calculations up until now.
Re: the loading issue, although it didn't work out at first, I Googled and found out someone else having the same problem suggested using a downgraded version. So I downloaded the downgraded version (v7.3), and that worked! It would just say "pgAdmin 4v7" as its app name on my computer.
But thanks a lot for being resourceful and your quick response! :)
When your course will be live...?
Aiming for a beta version in late Sept, early Oct.
hai josh one question ,in 14: 22 u have the data prior in a conditions. text document ? if yes where is the data and link for the data in conditions and so on in tables
You can download those files by registering with your name and email here: datawizardry.academy/sql-basics-healthcare/
Thank you for this great tutorial. I have a problem with importing data in the tables. I could import data from the "Immunizations" file (like the way you explained), however, the importing process has failed for the other two documents. Would you please help me to find out what could be the possible reason that I encounter this problem?
Hello,
Send me an email at sqlsorcery@gmail.com, and I'll try to help as best as a I can.
@Datawizardry.. I can’t seem to load the data, I keep getting the ‘columns’ sign
Hey Josh for some strange reason when I am trying to go to options (before I import the file) I cannot enable the header. I tried clicking on it many times but to no avail. Do you have any solutions as to how I can enable the header?
You don't need to worry about the header option if you are importing the txt files. It will be locked by default.
You should be able to import without enabling the header option.
Hi I can’t type \N on the null strings bit. It doesn’t let me click on it. Any solutions ?
@15:00 I can't check the "header" option it is grayed out and when I click it nothing happens. I'm on a Mac. Also the data that I downloaded is missing "encounters"
Hello,
You dont need to click the header option. It's off by default.
Also, the email that you received should explain how to get the encounters data; its a separate link to dropbox.
Hi Josh, is there a reason my postgres doesn’t see the text files? It worked with a different data base but yours is just not visible and when I’m trying to add it from the location link as psv I get errors regarding \N and some syntax. I’m not sure what can be wrong here 😣
Hello Josh, I have tried your dataset to load on MySQL , thanks for the data, but I am facing issues due to birthdate column when the data is before 1970 , it is throwing error and only loading rows excluding those dates, i am working on mysql workbench, can you please guide me on this one.
Hello,
I think the reason you are seeing this error in MySQL is because it stores dates differently than Postgres. I would recommend following the steps to download PostgreSQL in the tutorial, and then trying to upload to that instead.
That way, if you are still coming across errors, I can assist in troubleshooting the error, as we'll both be working off of the same SQL language.
Hi I'm using MAcOS version 16.3 and don't see the same screen when I downloaded the PGAdmin so I had to copy and paste using the edit button on the top of my laptop to copy and paste from the Data Wizardry file Webinar but I can't import the conditions.
I'm not sure I understand, can you send me a screenshot at sqlsorcery@gmail.com? I can better assist if you can send me screenshots.
Just wondering if I can use the tables on my SQL instead of downloading postgresql?
Yes, the stuff that I'm doing in PostgresSQL is also do-able in MySQL. However, the syntax will be different.
Thanks. Please do I need Visual Studio code editor, or is pgadmin ok for all the stuff?
You don't need vs code for this. PgAdmin is good enough. Though you could link up vscode to postgres if you wanted to.
@DataWizardry
Ok, thanks. I tried connecting it to vs code earlier, but it was a bit confusing for me as a newbie.
ive been waiting for one day I have yet to receive the lesson files
Thanks alot for this tutorial. I'm taking it one step at a time as a beginner in Healthcare Data Analysis. Please what does it mean when i try to run the select * from public.conditions and it says connection to pgAdmin server has been lost? What should i do? I tried closing it but it said changes I've made will not be saved. Should i go ahead and close it?
P.S.
I noticed the second button (under header option didn't move when i tried doing what you did here) Could this be the problem? Thanks.
Hello,
A couple users have reported the connection to pgAdmin lost error, so I'll take a look at this and get back to you with my findings.
It seems like this is a bug some people are experiencing with a newer version of PgAdmin. If I can't find a resolution, then I'll post a follow-up video that shows you how to install a different graphical user interface (GUI). In the meantime, you could try:
1. Closing and rebooting Postgres (make sure you're logged into your server, and there isn't a red x anywhere on the left panel)
2. Reinstalling
Regarding the header issue. That is going to be locked by default, and you won't be able to adjust that. So I don't think that is causing the issue.
Alright. Thankyou very much.
@@florenceosuagwu2422 If you're still having issues, what I would do is: first check what version of PgAdmin you're using.
Then uninstall PgAdmin, and install a different version. Here is the link: www.pgadmin.org/download/
I was using version 7.2 and it was working for me.
If you are using Windows as your operating system, what you need to do is go to add or remove programs, then go to PostgreSQL to initiate the uninstall process,
and as you're doing the uninstall, click the uninstall individual components option, and only click PgAdmin.
What that will do is just remove PgAdmin, but not the PostgreSQL.
I hope that's helpful!
Hi Josh please How to get dataset? I went to Synthea but I couldn,t find datasets. I wanted to practice at the same time with you.
You can access the lesson files by providing your email here: datawizardry.academy/sql-basics-healthcare/
Can you please share the datasets with me if you received it from Josh or his team?
Hi mu name is Stephen Yamson from Ghana. Am into data analytics with finance and supplechain domain knowledge. Watching other videos of yours, i have been convinced of considering the health care sector as clinical analysts. Concerning your upcomong course. Will it cover everything i need to know to excel as a clinical analyst. Cos i really want to buy it and learn it. Will the course b very intensive??😊
Hi Steve, great question!
The course will be a 10-12 week program, designed to build all the skills you need to become a data analyst in healthcare.
It will be more focused on writing queries in SQL, creating dashboards in Tableau, and networking to land your first job.
I haven't decided yet if I'll include Excel; while Excel is a great first tool to learn in data analytics, I find myself using SQL and Tableau much more often.
Usually, when I do work in Excel, it's to simply reverse-engineer the manual processes that other people maintain so that I can learn how to replace that manual process with an automatic one. So I'm considering having a section where I talk about that.
I hope that's helpful!
@@DataWizardry that really helped. Pls when is it coming and is it affordable. Cos I need it
@@stevetheanalyst At this point, I'm still doing research on what a good price will be.
What I'll probably do is start small and have a beta testing where I'll release it at a cheaper price for a small group of people (maybe 10 to 20 people), that group would take the class, provide feedback to me, and then I would tweak it, make it better, and then release the final version with improvements.
This cheaper, initial round would probably be sometime in September this year.
@@DataWizardry hope to be part of the few people selected
@@stevetheanalyst Sure! Feel free to send me an email: sqlsorcery@gmail.com and I'll email you when it's ready!
Hello Josh, many thanks for doing this video. I keep getting the message Utility not found when i try to import/export data into my tables. Are you able to advise? thanks
Are using Windows with pgAdmin? I found an article on stackoverflow that may be of some help: stackoverflow.com/questions/67973596/in-pgadmin-4-utility-not-found
If that doesn't work, maybe try uninstalling pgAdmin and then installing an older version of pgAdmin.
@@DataWizardry many thanks Dude!
Hi under the descrition column , this is what i have "Hospital Encounter with Problem" when i use the syntax.
"Hospital Encounter with Problem"
"Hospital Encounter with Problem"
"Hospital Encounter with Problem"
"Hospital Encounter with Problem"
"Hospital Encounter with Problem"
ICU admition is not listed under the descrition column.
I'm guessing what's happening is, you're only seeing a small preview of the entire dataset. The default options are setup so that you only see 1000 rows at a time unless you scroll all the way down to the bottom, and ICU encounters aren't as frequent in this dataset.
If you want to verify how many rows of each encounter type you have in your dataset, you could try running a query like this
select description, count(*)
from encounters
group by description
order by description
Do you see ICU show up on that list? I get 162.
where can i get sample data that u using in this class?
Hi,
In order to obtain the files, you have to sign up at this link here to have them emailed to your inbox:
datawizardry.academy/sql-basics-healthcare/
Hi Josh, the folder I downloaded today has no encounters file. Can you check? thx
Hi Yang, once you sign up for the lesson files, the email that gets sent should give you instructions for 2 steps:
1. Unzip the folder (which only contains 3 files, patients, conditions, immunizations)
2. Follow this link for encounters (it's really big, so I had to put it in dropbox): www.dropbox.com/scl/fi/914gq2qrej6enwwaoc5vp/encounters.txt?dl=0&rlkey=uwc55hnx2d16kmcuvvampefkb
Try step #2 to download the remaining file.
@@DataWizardry Josh can you please create a dropbox of all the text files. I tried following your instructions but never got an email with lesson files.
From where can i get data set please provide me the details
You can find this at: datawizardry.academy/sql-basics-healthcare/
Pgadmin is not available in my setup components???
I'm not sure I understand what you're asking. Can you clarify?
Header doesn't shows active icon
Hi @Mahgdi, one thing I neglected to mention during the lesson is that the header is just going to be stuck on the 'off' position. It won't be clickable.
Should be fine though, try importing it and see what happens.
hiya, when I tried to import data into tables, it said : Utility file not found. Please correct the Binary Path in the Preferences dialogUtility file not found. What does that mean?
Maybe try this? stackoverflow.com/questions/67973596/in-pgadmin-4-utility-not-found
Thank you very much! I was finally able to import the data, though there is a new problem, at "options", I cannot turn on "header", like it is defaulted to ”off“, and i cannot click it@@DataWizardry
@@zhidaobu4179Yes, that's normal. You should be able to proceed with the full tutorial without clicking the header button.
why is the encounter file missing when I download the fake data ? I need the encounter data
The encounter file is not missing; rather, in the same email that you receive, there is a seperate hyperlink to a drop box file containing the download.
I had to do it this way because the data is too big to send via email.