Big Data Engineer
Technology
Haystack1 month ago
Full timeOn-site
Job description
A world-leading technology solutions provider, focused on delivering innovative data platforms and analytics, is seeking a talented individual to join their dynamic team.
The Role
- Design and develop scalable data ingestion and transformation pipelines.
- Build and optimize ETL/ELT solutions using Azure Synapse, Spark/PySpark, and SQL.
- Develop data processing frameworks using Scala and Spark.
- Work with Cosmos DB and ADLS for data storage and management.
- Ensure data quality, performance tuning, and operational stability.
What You'll Need
- Strong expertise in Azure data platforms and big data technologies, particularly Azure Synapse Analytics.
- Hands-on programming skills in Scala and Spark/PySpark.
- Advanced SQL development and performance tuning experience.
- Experience with Cosmos DB and Azure Data Lake Storage (ADLS).
- Good understanding of data warehousing and big data concepts.
- Excellent problem-solving and communication skills.
What's On Offer
- Opportunity to work with cutting-edge Azure data technologies.
- Contribute to the design and optimization of scalable data pipelines.
- Collaborative environment with business and technical teams.
- Focus on continuous improvement and innovation.
Apply via Haystack today!
Keywords
big-datainsurance-consulting-and-technologydata-platformanalyticsdata-analyticsplanning-and-designvisual-art-designproduct-development-and-designextract-transform-and-load-etlelectronic-titleextract-load-transform-eltmicrosoft-azureazure-synapsemicrosoft-azure-synapsesparkpysparksqldata-processingscalaazure-cosmos-db
Interested in this role?