Data Engineer
Technology
Mindlance2 months ago
Service contractOn-site
Job description
Job Title: Data Engineer
Duration: 12 Months (Possible extension)Location: Remote
Banking and Financial domain experience is highly preferrable.Job Summary
We are looking for a Senior Data Engineer with strong AWS, Python/Scala, Spark/Pyspark, Snowflake and AWS Glue experience, along with hands-on experience developing APIs and cloud-based applications .The ideal candidate will build and support scalable data pipelines and cloud applications, while also working on low-latency APIs, GraphQL/API development, performance optimization and monitoring . This role requires someone who can go beyond traditional ETL and understand how data services interact with production applications and microservices.
Key Responsibilities
- Design and develop scalable data pipelines using AWS Glue, Spark/Pyspark and Python/Scala.
- Build and maintain data solutions using Snowflake and AWS .
- Develop and integrate REST/GraphQL APIs and cloud-based applications.
- Work on low-latency, high-performance applications and APIs .
- Troubleshoot application and API performance, latency and scalability issues.
- Implement monitoring, logging and observability for data and cloud applications.
- Work with AWS services and cloud-native architectures.
- Collaborate with application, data and engineering teams to deliver production-ready solutions.
- Senior Data Engineering experience
- Strong AWS
- Python or Scala
- Spark/Pyspark
- Snowflake
- AWS Glue
- Data pipeline development
- Hands-on API/GraphQL development
- Low-latency application/API experience
- Cloud application development
- Performance/latency troubleshooting
- Monitoring/observability
Keywords
amazon-web-servicespythonscalasparkpysparksnowflakeaws-gluedata-pipelinecloud-applicationsnetwork-latencygraphqlapplication-programming-interface-apitraining-and-developmentperformance-optimizationextract-transform-and-load-etlmicroservicesplanning-and-designvisual-art-designproduct-development-and-designtroubleshooting
Interested in this role?