Data Integration Engineer – Python & BigQuery

Data Integration Engineer – Python & BigQuery

Overview

We are seeking a Data Integration Engineer to develop and support integrations between our Point of Sale (POS) platform, cloud data warehouse, and third-party business applications. The primary responsibility of this role is to extract, transform, and deliver POS transaction data from Google BigQuery to external Loss Prevention (LP) systems through APIs, SFTP/FTP, and automated data pipelines.

Key Responsibilities

• Develop and maintain Python-based data integration solutions.
• Query and extract large datasets from Google BigQuery.
• Design and implement data delivery processes using REST APIs, SFTP, and FTP.
• Build and support ETL/ELT pipelines for data transformation and validation.
• Perform data reconciliation and ensure data accuracy across systems.
• Monitor, troubleshoot, and optimize production integrations.
• Implement logging, error handling, and audit mechanisms for operational support.
• Collaborate with business stakeholders and third-party vendors to define and deliver integration requirements.

Required Skills

• 3 years of experience in Python development.
• Strong SQL skills and experience working with large datasets.
• Hands-on experience with Google BigQuery or similar cloud data warehouses.
• Experience developing or consuming REST APIs.
• Experience with file-based integrations (CSV, JSON, XML) and SFTP/FTP processes.
• Understanding of ETL/ELT concepts and data integration best practices.
• Experience with Git and software development lifecycle practices.
• Strong analytical and problem-solving skills.

Preferred Skills

• Experience in retail, POS, or transactional data environments.
• Experience with cloud platforms such as GCP or AWS.
• Experience with workflow orchestration and automation tools.
• Familiarity with data warehousing solutions such as BigQuery or Snowflake.
• Experience integrating with Loss Prevention, Fraud Detection, or Security platforms.

Success in This Role The successful candidate will be able to independently design and implement reliable data pipelines that extract POS data from Google BigQuery and securely deliver it to downstream applications while ensuring data quality, performance, and operational stability.