Mohammad Abid Shah
Data Engineer
Talent
BengaluruMember since September 7, 2026
Amazon S3IAMAWS GlueEventBridgePythonSQLPySparkDockerCI/CDGitHub ActionsPower BIGitGitHub
·
Hire this person
Send a job offer directly to this candidate
Amazon S3IAMAWS GlueEventBridgePython
About
Data Engineer with a B.Tech in CSE and 6 months of internship experience building ETL/ELT pipelines on Amazon S3, Glue, Athena and Lambda. Proficient in Python, PySpark and SQL for data integration, validation, and query optimization. Automated cloud workflows and CI/CD pipelines, reducing pipeline effort and improving reliability.
Experience
Data Engineer Intern at Defcon Innovations (2026-01 – 2026-06)
Internship
- Architected AWS ETL/ELT pipelines with GitHub Actions CI/CD, automating 15–20 weekly runs and eliminating manual deployment intervention.
- Built Python/PySpark transformations and validation with 20+ pytest cases, identifying schema and data-quality issues before deployment.
- Delivered curated data to Athena and Power BI for 3–5 recurring reports, utilizing Docker for consistent service deployment.
- Resolved 10+ production issues, including IAM permission and schema mismatches, reducing recurring pipeline failures and enhancing reliability.
Education
Bachelor of Technology in Computer Science and Engineering – University of Kashmir (2021-12 – 2025-12)
Skills
Data Engineer
