Data Engineer
Tecnologia
Formulated Automation
Brasil, BrasilHá 2 dias
Descrição da vaga
Hi there! We are South and our client is looking for a Data Engineer!
Note To Applicants
- Eligibility: This position is open to candidates residing in Latin America.
- Application Language: Please submit your CV in English. Applications submitted in other languages will not be considered.
- Professional Presentation: We encourage you to showcase your professional experience by including a Loom video in the application form. While this is optional, candidates who provide a video presentation will be given priority.
- Interview Policy: The use of artificial intelligence (AI) tools during interviews are strictly prohibited.
- Note: As part of the final stages of the selection process, contractors may be asked to provide professional references for a reference check. If you're selected, you may also be asked to update their LinkedIn profile. 🙂
You will work on client engagements alongside strategists, architects, and fellow engineers to design and implement scalable, reliable, and efficient data solutions.
Key Responsibilities
- Build Data Pipelines & Systems: Design, build, and implement scalable, secure, and high-performance data pipelines based on architectural guidance. Ingest data from databases and marketing APIs, handling rate limits, pagination, and incremental loads.
- Develop ELT Workflows: Load raw data into cloud data warehouses and transform it using SQL and dbt.
- Work with Semi-Structured Data: Ingest webhook and API payloads through queues, API gateways, or managed ingestion tools. Parse and flatten nested JSON within the data warehouse.
- Develop with Python: Build and maintain custom connectors, automation scripts, and transformation logic.
- Design Data Models: Create and maintain schemas for cloud data warehouses and work with relational databases when needed.
- Support Identity Resolution: Contribute to data models that connect user identifiers, such as cookies, email addresses, and device IDs, to support Customer 360 and attribution initiatives.
- Manage Cloud Infrastructure: Deploy and maintain data infrastructure and object storage across AWS, GCP, or Azure.
- Optimize Performance & Costs: Monitor database performance, optimize queries, implement indexing, and improve infrastructure efficiency while balancing warehouse performance and costs.
- Ensure Data Quality & Reliability: Implement data quality checks, monitoring, and alerting. Troubleshoot pipeline issues and maintain accurate, reliable data assets.
- Collaborate with Stakeholders: Translate requirements from marketers, analysts, and product managers into reliable data structures and solutions.
- Follow Engineering Best Practices: Participate in code reviews, use CI/CD workflows, write data tests, and follow privacy and governance standards, particularly when handling personally identifiable information (PII).
- 2 years of experience as a Data Engineer in a production cloud environment.
- Hands-on experience with at least one major cloud platform (AWS, GCP, or Azure), with the ability to adapt to others.
- Experience building SQL-based ELT workflows using version-controlled models (dbt or similar) and automated data testing.
- Strong Python programming skills for data engineering tasks.
- Advanced SQL skills, including query optimization and performance tuning.
- Experience querying, parsing, and flattening nested JSON data using SQL.
- Experience working with data from CRM systems, marketing automation platforms, web analytics, or advertising platforms.
- Working knowledge of managed data services and data lake architectures within at least one major cloud provider.
- Familiarity with Git, version control, and code review practices.
- Comfortable using AI coding assistants as part of the development workflow.
- Strong written and verbal communication skills, with the ability to explain technical concepts and decisions to non-technical stakeholders.
If this opportunity sounds good to you, send us your resume!
Tem interesse nesta vaga?