وصف الوظيفة
Experience 5 yrs
Location Qatar
Duration 12 Months
- Job Purpose / Role
- Main Capabilities / Mandatory SkillsETL/ELT Pipeline Engineering in GCPEvent-Based and Streaming Architecture using Pub/Sub and DataflowBigQuery Engineering, SQL and PythonSchema Evolution, Replay, Idempotency and Dead-Letter HandlingData Quality, Reconciliation, Lineage and ObservabilityCI/CD, Automated Testing, Performance and Cost Optimization
- Required Experience - Mandatory
- Core ResponsibilitiesOwn Hands-on Technical Delivery for the Assigned Data Engineer ScopeTranslate Approved Requirements and Architecture into Implementable Designs, Configurations, Code, Controls or Delivery ArtefactsApply the Defined Capabilities using Secure, Maintainable, Testable and Supportable Engineering PracticesIdentify Technical Risks, Dependencies, Gaps and Decisions Early, and Drive Them to Closure with Accountable StakeholdersSupport End-to-End Validation, Production Readiness, Troubleshooting and Controlled HandoverMaintain Version-Controlled Documentation, Decisions, Runbooks and Knowledge-Transfer Material
- Expected Outputs / DeliverablesRole-Specific Technical Designs, Implementation Artefacts or Operational DeliverablesDocumented Decisions, Assumptions, Dependencies, Risks and Acceptance EvidenceReusable Standards, Templates, Code, Configurations, Runbooks or ChecklistsTesting or Validation Evidence and Production-Readiness InputsStructured Technical Documentation and Knowledge Transfer
- Education & Certifications
- Technical AssessmentCandidate selection should include a structured technical discussion based on recent delivery examples. Assessment should validate genuine hands-on depth in ETL/ELT Pipeline Engineering in GCP, Event-Based and Streaming Architecture using Pub/Sub and Dataflow, BigQuery Engineering, SQL and Python, Schema Evolution, Replay, Idempotency and Dead-Letter Handling, Data Quality, Reconciliation, Lineage and Observability. Candidate should be able to explain Personal Contribution, Design Trade-offs, Control and Failure Handling, Testing or Validation Evidence, and How Delivered Solutions were Supported in Production.8.
Role BoundariesThe role is accountable for Technical Delivery within the assigned scope but does not replace Business Product Ownership, Formal Architecture or Security Approval, Security Risk Acceptance, Platform Ownership or Vendor Contractual Accountability. Production changes must follow approved Engineering, Security, Release and Operational Processes.
Keywords
PythonSqlBigQuery
هل أنت مهتم بهذه الوظيفة؟