Skip to main content

Data Engineer

Technology
Taguig, Philippines2 weeks ago
Full time

Job description

WE ARE HIRING: DATA ENGINEER

Location: BGC, Taguig

Work Setup: Hybrid – 8x onsite per month

Employment Type: Project-Based (For Extension & Absorption)

JOB OVERVIEW We are looking for an experienced Data Engineer with strong expertise in Python, Spark, PySpark, SQL, and AWS data services. The ideal candidate should have hands-on experience developing, maintaining, and optimizing data pipelines and AWS-based data processing solutions.

KEY RESPONSIBILITIES

  • Develop, maintain, and optimize data pipelines using Python, PySpark/Spark.
  • Write and optimize complex SQL queries for data processing and transformation.
  • Manage and process large datasets using Apache Spark.
  • Develop and maintain data integration and ETL/ELT workflows.
  • Work with AWS S3 and Amazon Redshift for data storage and warehousing.
  • Configure and manage AWS Glue jobs and data workflows.
  • Manage AWS IAM roles, users, and policies.
  • Monitor data pipelines and troubleshoot issues using AWS CloudWatch.
  • Perform data synchronization using AWS DataSync.
  • Ensure data quality, accuracy, and consistency across data pipelines.
  • Collaborate with data architects, analysts, and other technical teams.

REQUIRED SKILLS & QUALIFICATIONS Programming & Data Processing

  • Python
  • SQL
  • Apache Spark
  • PySpark
AWS Services & Tools
  • AWS S3
  • Amazon Redshift
  • AWS IAM (Roles, Users, and Policies)
  • AWS Glue
  • AWS CloudWatch
  • AWS DataSync
Additional Skills
  • ETL/ELT Development
  • Data Pipeline Development
  • Data Integration
  • Data Transformation
  • Data Processing & Optimization
  • Data Quality Management
Keywords
Apache SparkRedshiftPythonSqlApache Http Server

Interested in this role?