Skip to main content

Coforge - AWS/Scala Data Engineer

Technology
Coforge
1 month ago

Job description

Job Description :

We are hiring for a highly skilled and experienced AWS-Scala Data Engineer to join our dynamic team.

The ideal candidate will have a strong background in cloud-based data engineering with at least 4 years of hands-on experience in AWS.

You will be responsible for designing, building, and maintaining scalable data pipelines and solutions using modern data engineering tools and frameworks.

Key Responsibilities :

  • Design and implement robust, scalable, and high-performance data pipelines on AWS.
  • Develop and maintain ETL workflows using Airflow.
  • Write efficient and optimized code in Python for data processing and transformation.
  • Work with SQL to query, manipulate, and analyze large datasets.
  • Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders.
  • Ensure data quality, integrity, and security across all data platforms.
  • Monitor and troubleshoot data pipeline performance and reliability.

Mandatory Skills :

  • Extensive AWS experience - including services like S3, Lambda, Glue, Redshift, EMR, etc.
  • Scala - strong programming skills for data manipulation and automation.
  • SQL - advanced querying and optimization techniques.

Preferred Qualifications :

  • Experience with big data technologies (e.g., Spark, Hadoop).
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Knowledge of data warehousing concepts and tools
Keywords
ScalaApache HadoopApache SparkRedshiftApache AirflowDevOpsAirflowPythonSqlHadoopApache LicenseApache Http ServerCI/CDBig data

Interested in this role?