Skip to main content

Coforge - Lead Data Engineer

Technology
Coforge
1 month ago

Job description

Job Description :

Key Responsibilities :

  • Design, develop, and maintain scalable data pipelines and ETL/ELT solutions.
  • Build Data Lake, Data Warehouse, BI, and Analytics platforms.
  • Convert business requirements into robust technical solutions.
  • Ensure data quality, security, governance, and performance optimization.
  • Perform code reviews, troubleshooting, and production support.
  • Collaborate with cross-functional teams on architecture and data engineering best practices.
  • Maintain metadata, data lineage, and data governance standards.

Technical Skills :

  • Cloud &
  • Big Data : Azure, Cloudera, Hadoop, Spark, Scala, Hive, HBase, Kafka
  • Data Engineering : Azure Data Factory (ADF), Databricks, Airflow, Apache NiFi, Oozie, Sqoop
  • Storage &
  • Processing : HDFS, ADLS Gen2, Snowflake, Streaming (Spark Streaming)
  • Data Integration : SnapLogic, TIBCO
  • Databases &
  • BI : SQL, Power BI, MicroStrategy, Elasticsearch
  • Version Control &
  • DevOps : Git, Bitbucket, Azure DevOps
  • File Formats : AVRO, PARQUET

Desired Profile :

  • Strong hands-on experience in end-to-end Data Engineering.
  • Familiarity with Data Lake, Data Warehouse, BI, and Analytics solutions.
  • Exposure to Agile/Waterfall methodologies.
  • Excellent problem-solving, communication, and stakeholder management skills.
  • Team player with a strong learning mindset
Keywords
ScalaApache HadoopApache KafkaApache SparkApache HBaseMetadataElasticsearchSqoopDevOpsAirflowApache ParquetSqlApache OozieHiveHbaseHadoopApache LicenseApache Http ServerApache AvroBig data

Interested in this role?