Skip to main content

Data Engineer

Technology
WillWare Technologies
Chennai, India1 month ago
Full time

Job description

Role: Data Engineer

Experience: 5 Years

Role: Data Engineer

Location: Bangalore, Chennai, Hyderabad, Pune, Kolkata

Work Mode: Onsite

Key Responsibilities

Build and maintain scalable batch and streaming data pipelines.

Develop distributed data processing using Spark, Apache Beam, or Flink.

Orchestrate workflows using Apache Airflow.

Develop data transformations using Python, SQL, and dbt.

Work with GCP or other major cloud platforms.

Ensure data quality, performance, and pipeline reliability.

Collaborate with Analytics and Platform Engineering teams.

Mandatory Skills

Strong Python & SQL

Apache Airflow

Spark / Apache Beam / Flink dbt

Cloud experience, preferably GCP

Streaming: Kafka / Pub/Sub

Hands-on experience with AI-assisted coding tools such as GitHub Copilot, Cursor, Gemini Code Assist, etc.

Good to Have: AI-driven data/ML pipelines, data quality/governance, BI/analytics experience.

Keywords
monthsOfExperience: 60CodingOCamlApache KafkaApache BeamApache SparkApache AirflowMicrosoft PublisherCursorAirflowPythonSqlApache LicenseApache Http ServerGithub

Interested in this role?