Skip to main content
Akash Rajpoot

Akash Rajpoot

Data Engineer | Azure & AWS | PySpark & ETL Expert

Talent
KanpurMember since April 2, 2026
PythonJavaSQLPySparkApache SparkHadoopAzure DatabricksADLS Gen2Delta LakeAzure Data FactoryAWS S3AWS GlueEMRAmazon RedshiftAWS LambdaETL/ELT PipelinesData ModelingData ValidationData Lake ArchitectureData WarehousingMedallion ArchitecturePerformance OptimizationSQL ServerMySQLOracleApache AirflowAutoSysAzure SynapseSplunkServiceNowGitGitHubSSMSPyCharmJupyter NotebookVS CodeAzure PortalDatabricksJira
·

Hire this person

Send a job offer directly to this candidate

PythonJavaSQLPySparkApache Spark

About

Data Engineer with 4+ years of experience designing and delivering enterprise-scale data pipelines and cloud data platforms across BFSI, Public Sector, and Investment Management domains. Experienced in building scalable ETL/ELT pipelines and distributed data processing solutions using Azure Data Factory, Azure Databricks, PySpark, ADLS Gen2, Delta Lake, and AWS services including S3, Glue, EMR, Redshift, and Lambda. Strong expertise in processing large-scale datasets (GB–TB scale) using Apache Spark and implementing Medallion Architecture (Bronze, Silver, Gold) for modern data lake platforms.

Proven ability to optimize data pipelines, reduce data latency, and improve data processing performance by up to 30%. Proficient in workflow orchestration using Apache Airflow, AutoSys, and Azure Data Factory with monitoring through Splunk and ServiceNow. Experienced in multi-environment deployments, CI/CD pipelines, and delivering reliable cloud data platforms in Agile environments

Experience

Senior System Engineer (Data Engineer) at Infosys Limited (2022-01 – Present)

Architected and maintained enterprise-scale cloud data platforms on Azure and AWS, supporting high-volume data pipelines and optimizing distributed data processing workloads.

  • Engineered scalable ETL pipelines using Azure Databricks and PySpark processing 10M+ financial records daily with 99.9% data accuracy.
  • Automated complex data transformation workflows improving financial reporting efficiency by 25%
  • Optimized Apache Spark workloads using partitioning, caching, and broadcast joins reducing compute cost by 30%.
  • Resolved 50+ production incidents using Splunk and ServiceNow ensuring 98% SLA compliance for enterprise data platforms.
  • Coordinated release deployments with client teams ensuring stable production releases.
  • Managed multi-environment deployments across DEV, QA, and PROD environments.

Education

Bachelor of Technology (B.Tech) in Electronics & Instrumentation – Mahatma Jyotiba Phule Rohilkhand University (2019-06)

Skills

Data EngineerAzure & AWSPySpark & ETL Expert

Reviews

Related