วีดีโอ

I've just found your script activity video, which answered my question perfectly! ... Thanks again

Glad you found it, yes, the script activity allows you to return both output parameters and datasets from stored procedure.

Thanks for feedback, and I had the same experience, looks like stored procedure activity is good only for DML purposes.

Thanks for watching!

Thanks for feedback, and this is a good question. I recently asked Microsoft representative the same question and he said CDF isn't supported on Mirrored database.

Thanks for feedback, Aziz. That's right , those tables will be managed tables

Thanks for the feedback. Unfortunately I can't change audio for this one, but will ensure that doesn't happen to future videos.

Thanks for watching!

Thanks, for feedback! Yes, eventhouse is on my to do list, so stay tuned.

Thanks for the feedback, Michael!

Thanks!

Thanks for watching!

Thanks for feedback! Yes, Change Data Feed is a right technology to resolve your task. You can use Spark SQL and PySpark languages for that. Make sure that you filter out pre-update row versions, to exclude duplicates. As to learning Python, I'd suggest to start with PySpark tutorials and you'd find plenty good materials on Databricks' site, here's one example: docs.databricks.com/en/pyspark/basics.html

Hi there, I assume you're referring to Change Data Feed on Delta Lake? If yes, I don't think there's 7 days limit there.

Hi there, I'd use Spark SQL on Lakehouse- it's more compatible with T-SQL, especially for transformations requiring MERGE INTO logic.

Glad you enjoy it, thanks!

That's a good question, as both have advantages. I'd choose Lakehouse option, because following: -It has less limitations and probably would be more compatible with your original code -Spark and Delta Lake has been around longer, so you'd get more material on that Best luck with your conversions!

That's right, both NONCLUSTERED and NOT ENFORCED are required clauses when adding PK constraint to Synapse WH tables, see here more details: learn.microsoft.com/en-us/sql/t-sql/statements/alter-table-column-constraint-transact-sql?view=fabric

Thanks for feedback, Douglas. Yes, you're right - PK constrains will not prevent duplicate values, so in that sense they're not even truly constraints. According to Microsoft, the potential benefits of PK and FK constrains include improved query performance and their help in showing relationships between tables in modelling tools.

Hi Shreekanth, in most cases, you should be able to convert scalar UDF's to TVF's, providing they don't have Cursor logic and contain read-only queries. And then you can use them in your parent queries using CROSS APPLY constructs. I'll try to prepare a video to demonstrate the point, hopefully this week

@@fazizov ok, thanks a lot Fikrat

Hey Shreekanth, in case you haven't seen it, this video explains how to convert scalar UDF's to TVF's supported in Synapse: th-cam.com/video/3I8YcI-xokc/w-d-xo.html

@@fazizov , thanks a lot this helps

Thanks for watching!

Hi there, thanks for raising this point.Have you tried Script activity,that acts like stored procedure?

@@fazizov really appreciate your quick response, I will check and update in a day. Thanks a lot.

@@fazizov I have one more doubt, does fabric support user defined scalar function in warehouse, if not what would be the work arround. I have some complex scalar functions defined in on premises SQL server finding it difficult to handle in fabric warehouse

Hi there, You can use Delta Lake API's for update and merge related methods on PySpark. Please take a look at this video that describes that approach: th-cam.com/video/LeWOG_4umb8/w-d-xo.html

@@fazizov thanks a lot, very informative

Thanks for watching!

I'm glad it was helpful, good luck with your exam!

According to documentation ,only A SQL, and SQL managed Instance is currently supported.

Happy to hear that! Thanks!

No, scalar functions are not available in Fabric Warehouse, but you could use TVF instead, see example below: create function fn_geography(@GID int) returns table return (select City,State from dbo.Geography where GeographyID=@GID) select W.*,G.* from Weather W CROSS APPLY fn_geography(W.GeographyID) create function fn_geography(@GID int) returns table return (select City,State from dbo.Geography where GeographyID=@GID) select W.*,G.* from Weather W CROSS APPLY fn_geography(W.GeographyID) create function fn_geography(@GID int) returns table return (select City,State from dbo.Geography where GeographyID=@GID) select W.*,G.* from Weather W CROSS APPLY fn_geography(W.GeographyID) G

Thank you for letting me know, I will tryout

I'm glad it was helpful, thank you!

Thank you for feedback!

You raised a good question and I don't have answer for that unfortunately. That seems to limitation of Fabric's notebook interface...

Sorry, I don't have answer for this question.

Glad it helped! I'd check few things: Make sure all running streams stopped, delete the checkpoint folder, start stream again and check the status from handle, status usually great way to troubleshoot progress

Thanks for feedback! You could add all attributes to metadata and then add 2 filter activities downstream (for files and folders). See if this video helps: th-cam.com/video/VFYq7L8qlMA/w-d-xo.html&ab_channel=FikratAzizov

@@fazizov Thanks for the suggestion. I found recursive is little hard to achieve. for e.g. 1000 of files in a folder structure having many years folder, months of each year and 28-31 files every month. I will give it a try with the above recommendation

Which video are you looking for?

not sure but i guess event streaming and data pipelines

Thanks for feedback. To answer your questions: 1. Eventstreams could be helpful if your source isn't one that can feed to KQL directly (say IOT hubs) or if your transformations are simple enough to be done from it, otherwise it'll only add up to latency 2. Eventhouses are nice feature designed to optimize costs and make data sharing easier. However, at the base of Eventhouses are KQL databases, so all ingestion/transformation related to KQL are true for Eventhouses as well.

That's right, thanks for pointing to that, and sorry about it. I've uploaded e better version of that here: th-cam.com/video/SkBCbmSA9sE/w-d-xo.html

Thanks for feedback,I'll definitely prepare a tutorial on that

Thank you, @user-hw1mx6gu9e

Thanks for feedback!

Glad you like them!

Glad it was helpful, thanks!

Thanks for feedback!

Thanks for feedback, @mohammedmanna3488. I will post a video on copying from on-premises in the next 1-2 days, hope it helps.

@@fazizov Thank you for replying

Thanks a lot

Very useful

We already using we like to show u pl send ur e mail id

Thanks and welcome