Great video! Question: I have a dxp that loads tons of data (around 10 million rows or so). This video helps in loading the analyst on my desktop by changing the cache settings in the information link. My question is. If I want to make changes in the data canvas after opening (creating a join, adding a calculated column, etc) will the data automatically be reloaded or will those changes I made take place based on the cached data from the info link?
Generally speaking, anytime you open a DXP (unless using in db connections), the data is brought into memory and worked with from memory. Thus, when you create a calculated column, it's working with the data from memory. It's not reloading the data any time you create a calculated column. With that said, it still has to work thru 10m rows to create the calculated column, so it might not be super quick.
How Job Builder can provide a faster load time? Is the idea use a dxp file as an ETL process to generate a SBDF file in the library for another dxp file? Congratulations for the videos!
Excellent question. I could write an entire blog post just about this subject. If you check the box in the information designer to cache the information link (this is the important part), you can use the Automation Services job builder to create the cache before people start work. For example, I set the cache timeout period to be 4 hours. Then, I create a job with one task -open the file. That task runs at 7am. Opening the file creates the cache. Spotfire holds it for the next four hours, and when people open the file, it opens for cache and opens faster. To make this work the whole day, I would schedule a second and even third job to run right after the cache drops.
Great video but it looks like your wordpress site is offline. Is there another way to get the template?
also just noticed that I only have a Total load time line in my report whereas you have details by table. Is that a setting that can be adjusted?
Great video! Question: I have a dxp that loads tons of data (around 10 million rows or so). This video helps in loading the analyst on my desktop by changing the cache settings in the information link. My question is. If I want to make changes in the data canvas after opening (creating a join, adding a calculated column, etc) will the data automatically be reloaded or will those changes I made take place based on the cached data from the info link?
Generally speaking, anytime you open a DXP (unless using in db connections), the data is brought into memory and worked with from memory. Thus, when you create a calculated column, it's working with the data from memory. It's not reloading the data any time you create a calculated column. With that said, it still has to work thru 10m rows to create the calculated column, so it might not be super quick.
How Job Builder can provide a faster load time? Is the idea use a dxp file as an ETL process to generate a SBDF file in the library for another dxp file? Congratulations for the videos!
Excellent question. I could write an entire blog post just about this subject. If you check the box in the information designer to cache the information link (this is the important part), you can use the Automation Services job builder to create the cache before people start work. For example, I set the cache timeout period to be 4 hours. Then, I create a job with one task -open the file. That task runs at 7am. Opening the file creates the cache. Spotfire holds it for the next four hours, and when people open the file, it opens for cache and opens faster. To make this work the whole day, I would schedule a second and even third job to run right after the cache drops.
NOTE: This is improving the load time when DXPs are opened from the desktop app. A Scheduled Update will do the same thing for the web player.