Design, develop, and maintain scalable and efficient data pipeline architectures using Azure Data Factory (ADF). Build and manage ETL/ELT processes using Azure Databricks, with a strong understanding of Apache Spark and PySpark frameworks. Assemble and manage large, complex datasets that support bot