Opis stanowiska
What you need to have to succeed in this role
- Proven experience as a Senior Data Engineer or in a similar role delivering production-grade data pipelines and platform capabilities.
- Strong SQL skills, including complex transformations, relational modelling, query-plan analysis and performance optimisation.
- Practical understanding of graph-based ontologies and knowledge graphs, including ontology concepts, entity and relationship modelling, schema alignment and mappings from source data.
- Hands-on experience with graph databases, including data modelling, loading, querying, traversal patterns and performance considerations.
- Practical experience designing NoSQL data models, with an understanding of access patterns, partitioning, indexing and consistency trade-offs.
- Strong Python skills or equivalent for pipeline orchestration, integration, transformation and automated testing.
- Experience designing reusable pipeline frameworks across multiple sources, projects or domains.
- Understanding of batch and event-driven processing patterns, incremental loads, idempotency, retries, replay and backfill strategies.
- Experience working with structured and unstructured data, including document content, source metadata and extracted representations.
- Strong understanding of data quality, schema evolution, lineage, provenance, access controls and data lifecycle management.
- Experience with cloud data services, pipeline orchestration, CI/CD and operational monitoring.
- Ability to diagnose data correctness and performance issues across pipelines and storage systems.
- Clear communication and collaboration skills, with experience working across engineering, architecture, analysis and business teams.
- Experience delivering data capabilities in complex or regulated environments, with a proactive approach to technical risk and dependencies.
Keywords
OrchestrationMetadataPartitionPythonSqlCI/CDData management
Interesuje Cię ta oferta?