Data Engineer - Python/Django

About the Role:

We are looking for a Mid-Level Data Engineer with 2 - 5 years of experience to develop and maintain scalable, secure, and reliable data solutions. The ideal candidate should have experience in Python, data engineering, cloud platforms, and DevOps practices.

Responsibilities:

• Write clean, efficient, reusable, and testable Python code.
• Develop backend APIs using FastAPI or Django/Django REST Framework.
• Build, maintain, and optimize ETL/ELT pipelines using Python.
• Work with SQL and NoSQL databases.
• Troubleshoot issues and optimize application and pipeline performance.
• Participate in code reviews and maintain technical documentation.
• Work with Linux environments and understand system design fundamentals.
• Develop batch and streaming data workflows, data ingestion pipelines, and data transformation processes.
• Understand data modeling and data warehousing concepts.

Tech Stack:

• AWS: S3, Lambda, Glue, Athena, RDS, ECS, CloudWatch.
• GCP: Cloud Storage, Cloud Functions, Dataflow, BigQuery, Pub/Sub, Cloud Run.

DevOps Skills:

• CI/CD tools: GitHub Actions, Jenkins, AWS CodeBuild, or Cloud Build.
• Docker and container-based development and deployment.
• Infrastructure as Code: Terraform or CloudFormation.
• Familiarity with monitoring, logging, and alerting systems.

Desirable Skills:

• Test-driven development and automated testing.
• Experience with Grafana or CloudWatch dashboards.
• Exposure to digital signage or marketing platforms.