I need help transferring data from db to dataset in synapse
Hello everyone ๐, I'm working on a project where I need to dynamically copy all tables from a source SQL database to a dataset in Azure Synapse using pipelines. I'm looking for insights and ideas on how to achieve this effectively. Specifically, I'm interested in: 1. Dynamic Table Copy: How can I dynamically iterate through all tables in the source SQL database and copy them to the target dataset in Azure Synapse? 2. Pipeline Configuration: What are best practices for configuring Azure Synapse pipelines to handle dynamic table names and automate the data copying process?