Skip to main content

Blue Cloud Softech - Senior Data Ingestion Engineer - Fivetran

Technology
2 months ago
On-site

Job description

Role Overview :

We are looking for an experienced Senior Data Ingestion Engineer / Fivetran Specialist to design, develop, and support enterprise-scale data ingestion solutions across on-premises, cloud, SaaS, and relational database environments. The role will primarily focus on non-SAP data ingestion using Fivetran, with strong exposure to Oracle and other relational databases, APIs, SFTP/file-based integrations, and cloud-based data sources.

Key Responsibilities :

  • Design, develop, configure, and support enterprise-grade data ingestion pipelines using Fivetran.
  • Build and manage Fivetran connectors across heterogeneous source systems, including Oracle, DB2, SQL Server, MySQL, PostgreSQL, SaaS applications, and on-premises databases.
  • Configure and manage initial/full loads, incremental loads, and Change Data Capture (CDC) ingestion patterns.
  • Implement and troubleshoot Oracle-based CDC and incremental replication using Fivetran.
  • Configure secure connectivity between Fivetran and enterprise on-premises and cloud-based source systems.
  • Design ingestion solutions considering scalability, throughput, latency, reliability, security, source-system impact, and cost.
  • Monitor ingestion pipelines and proactively identify and resolve failures, data quality issues, and connectivity problems.
  • Troubleshoot connector failures, replication issues, schema changes, and source-system dependencies.
  • Collaborate with Data Engineering, Application, Infrastructure, and business teams to define appropriate ingestion strategies.
  • Support data ingestion from APIs, SFTP/file-based sources, SaaS platforms, and relational databases.
  • Ensure ingestion solutions follow enterprise data governance, security, and operational standards.
  • Document ingestion architecture, connector configurations, dependencies, operational procedures, and troubleshooting guidelines.
  • Contribute to continuous improvement of ingestion frameworks, monitoring, reliability, and operational processes.

Requirements :

  • 6 - 10 years of experience in Data Engineering, Data Integration, Data Ingestion, or related roles.
  • Strong hands-on experience with Fivetran, particularly for enterprise-scale non-SAP data ingestion.
  • Proven experience building and supporting data ingestion solutions across Oracle and other relational databases.
  • Strong understanding of CDC, incremental replication, full loads, and data synchronization patterns.
  • Hands-on experience with Oracle CDC and replication using Fivetran.
  • Experience working with DB2, SQL Server, MySQL, PostgreSQL, or similar relational databases.
  • Experience integrating data from SaaS applications, APIs, SFTP/file-based systems, and on-premises sources.
  • Strong understanding of secure connectivity between cloud data platforms and enterprise source systems.
  • Ability to design ingestion solutions with consideration for performance, scalability, reliability, latency, security, and cost.
  • Strong troubleshooting and problem-solving skills across data pipelines, connectors, databases, and source systems.
  • Good understanding of enterprise data engineering and integration practices.
  • Strong communication and stakeholder management skills.
  • High ownership and accountability with the ability to independently manage assigned deliverables.
  • Willingness to learn new data integration technologies and contribute to evolving data engineering practices.
Keywords
SCHEMAIBM Db2 FamilyAutoconfScalabilityOracle DatabaseMysqlPostgresqlSqlRelational grammarData managementReplication

Interested in this role?