Hiring : AWS Data Engineer
Location : Bangalore (Bagmane Solarium)
Work Mode : Hybrid (3 Days/Week Work from Office Mandatory)
Experience : 58 Years
Employment Type : Full-Time
Job Summary :
We are looking for an experienced AWS Data Engineer to join our growing data engineering team. The ideal candidate should have strong expertise in designing, developing, and optimizing scalable data solutions on the AWS cloud platform.
You will play a key role in building robust ETL/ELT pipelines, implementing modern data architectures, and enabling data-driven decision-making across the organization.
You will work closely with data scientists, business analysts, software engineers, and cross-functional teams to deliver reliable, secure, and high-performance data solutions while ensuring adherence to industry best practices and cloud standards.
Key Responsibilities :
- Design, develop, and maintain scalable, secure, and cost-effective data platforms using AWS cloud technologies.
- Build and optimize robust ETL/ELT pipelines for processing large volumes of structured and unstructured data.
- Develop scalable data ingestion frameworks and automate data workflows across multiple sources.
- Design and implement efficient data models, schemas, and data warehouse solutions to support business reporting and analytics.
- Build high-performance data processing solutions using Python, SQL, and Apache Spark.
- Develop and maintain AWS Glue jobs for data transformation and orchestration.
- Utilize AWS services such as S3, Redshift, Lambda, CloudWatch, IAM, and related cloud services to build enterprise-grade data solutions.
- Optimize data pipelines for performance, scalability, reliability, and cost efficiency.
- Monitor production data pipelines, troubleshoot issues, and implement proactive solutions to improve system stability.
- Ensure data quality, consistency, governance, and security across enterprise data platforms.
- Implement logging, monitoring, and alerting using AWS CloudWatch and related monitoring tools.
- Collaborate with business stakeholders, product owners, data scientists, and analytics teams to understand business requirements and translate them into scalable technical solutions.
- Participate in architectural discussions and contribute to defining enterprise data engineering standards and best practices.
- Perform code reviews and mentor junior engineers by promoting clean coding practices and design standards.
- Work closely with DevOps teams to implement CI/CD pipelines and Infrastructure as Code (IaC) for automated deployments.
- Maintain technical documentation, architecture diagrams, and operational runbooks.
Required Skills :
- 58 years of experience in Data Engineering.
- Minimum 3 years of hands-on experience working with AWS Cloud-based Big Data platforms.
- Strong programming skills in Python.
- Excellent SQL development and query optimization skills.
- Hands-on experience with Apache Spark for large-scale data processing.
- Strong knowledge of ETL/ELT design principles and implementation.
- Experience building scalable cloud-native data pipelines.
- Good understanding of data warehousing concepts and dimensional data modeling.
- Experience with version control systems such as Git.
- Knowledge of CI/CD pipelines and DevOps practices.
- Familiarity with Infrastructure as Code (Terraform or CloudFormation).
AWS Services Required :
- AWS Glue
- Amazon S3
- Amazon Redshift
- AWS Lambda
- Amazon CloudWatch
- AWS IAM
Technical Skills :
- Python
- SQL
- Apache Spark
- AWS Glue
SOFTPATH TECHNOLOGIES