Skip to main content

Big Data Engineer

Technology
Haystack
1 month ago
Full timeOn-site

Job description

A world-leading technology solutions provider, focused on delivering innovative data platforms and analytics, is seeking a talented individual to join their dynamic team.

The Role

  • Design and develop scalable data ingestion and transformation pipelines.
  • Build and optimize ETL/ELT solutions using Azure Synapse, Spark/PySpark, and SQL.
  • Develop data processing frameworks using Scala and Spark.
  • Work with Cosmos DB and ADLS for data storage and management.
  • Ensure data quality, performance tuning, and operational stability.

What You'll Need

  • Strong expertise in Azure data platforms and big data technologies, particularly Azure Synapse Analytics.
  • Hands-on programming skills in Scala and Spark/PySpark.
  • Advanced SQL development and performance tuning experience.
  • Experience with Cosmos DB and Azure Data Lake Storage (ADLS).
  • Good understanding of data warehousing and big data concepts.
  • Excellent problem-solving and communication skills.

What's On Offer

  • Opportunity to work with cutting-edge Azure data technologies.
  • Contribute to the design and optimization of scalable data pipelines.
  • Collaborative environment with business and technical teams.
  • Focus on continuous improvement and innovation.

Apply via Haystack today!

Keywords
big-datainsurance-consulting-and-technologydata-platformanalyticsdata-analyticsplanning-and-designvisual-art-designproduct-development-and-designextract-transform-and-load-etlelectronic-titleextract-load-transform-eltmicrosoft-azureazure-synapsemicrosoft-azure-synapsesparkpysparksqldata-processingscalaazure-cosmos-db

Interested in this role?