pyspark - Azure Data Factory issue - Stack Overflow
Oct 30, 2024 · -1 i Have recently given a Data engineering interview. In that interviwer asked me a question on ADF where i faced a issue while responding to it. Your help would be helpful here. there …
azure data factory - What is the difference between scheduled and ...
Sep 25, 2022 · I'm exploring the Azure Data factory scheduled and tumbling trigger. In both cases suppose I choose the 1 hour recurrence interval, then the pipeline runs every hour.
How to increase performance of Azure Data Factory Pipeline?
Dec 30, 2021 · I have Azure Data Factory pipeline, which are running Lookup (SQL Selects) and Copy Data (Inserts) in ForEach for 5000-1000 times. I want to execute pipeline nightly, but currently it …
Azure Data Factory vs Azure Logic Apps - Stack Overflow
Aug 24, 2021 · Users commonly need to activate pipelines based on storage account events, such as the arrival or deletion of a file in an Azure Blob Storage account, in data integration scenarios. …
Newest 'azure-data-factory' Questions - Stack Overflow
Azure Data Factory is a tool with many levels of complexity and often understanding the technology doesn't come that naturally to data professionals already working with tools like SQL Server …
Nested ForEach in ADF (Azure Data Factory) - Stack Overflow
Jun 20, 2022 · 1 As per the documentation you cannot nest For Each activities in Azure Data Factory (ADF) or Synapse Pipelines, but you can use the Execute Pipeline activity to create nested pipelines, …
azure data factory - How to Zip files on Storage with ADF - Stack …
Nov 20, 2018 · Would there be a way to Zip/copy files on a blob-storage into another storage/folder but with a zipped result ? You can deflate with ADF, but can you enflate ? We receive +100k files a day, …
How to retrieve a List of Pipelines in azure data factory for a ...
Aug 25, 2024 · I need to retrieve a list of pipelines in Azure Data Factory (ADF) and are associated with a specific branch in a specific repository within Azure DevOps. Azure DevOps Pipelines Here’s what …
azure - Sink as Excel in ADF - Stack Overflow
Jul 7, 2023 · As a workaround, you can try Databricks or Azure functions to read the data from SQL table and write it as Excel file. Call those using Databricks Notebook activity or Azure functions …
Is it Possible to Call an Azure Pipeline from SQL Server
Jun 28, 2023 · Similar to 'sp_start_job', is there a way to execute a Data Factory Pipeline from SQL Server via a stored procedure? I tried researching and everything seemed to come back to using …