Skip to main content
Rahul Seth

Rahul Seth

Data & AI Architect • Cloud Solutions Architect

Talent
Noida, Gautam Buddha NagarMember since March 26, 2025
PythonPySparkSQLDatabricksUnity CatalogDelta Live TablesMLflowLangChainLlamaIndexRAGVector DBsAWS BedrockAmazon S3 VectorsOpenAI GPT-4Prompt EngineeringSnowflakeHadoopSparkAWS GlueAWS S3AWS Step FunctionsAmazon EventBridgeAWS RedshiftAWS EMRAWS LambdaAWS AthenaAWS RDSAWS SQSAWS SNSCloudFormation
·

Hire this person

Send a job offer directly to this candidate

PythonPySparkSQLDatabricksUnity Catalog

About

Results-driven Data & AI Architect with 14+ years of experience designing scalable data platforms, cloud-native architectures, and AI-powered solutions. Deep expertise in AWS, Databricks, Snowflake, and Generative AI (RAG/LLM). Proven ability to architect end-to-end data ecosystems — from real-time ingestion to LLM-powered analytics — while leading cross-functional teams and enforcing enterprise-grade data governance.

Experience

Associate Manager – Data & AI Engineering at Accenture (2017-04 – Present)

  • Designed and optimized scalable ETL pipelines with PySpark and Databricks Delta Live Tables, ensuring resilient, high-throughput data processing across batch workloads.
  • Integrated Generative AI into data workflows — built RAG-based document Q&A systems using LangChain + AWS Bedrock (Claude/Titan models) and vector stores, with Amazon S3 Vectors for semantic retrieval, deployed on AWS Lambda and ECS.
  • Implemented Databricks Unity Catalog for centralized governance, lineage tracking, and fine-grained access control across lakehouse environments.
  • Led implementation of Informatica EDC and Axon to build comprehensive data governance incorporating automated validation and quality controls.
  • Configured row-level and column-level security for GDPR-compliant data access in Unity Catalog and Snowflake.
  • Designed REST API services integrated with backend databases using FastAPI; built high-performance web applications ensuring scalability and interoperability.
  • Partnered with DevOps to design deployment and monitoring strategies for Spark and Databricks applications.
  • Provided technical guidance and mentorship to junior developers, fostering a culture of quality and adherence to architectural best practices.

Senior Consultant – Data Engineering at Capgemini India (2014-10 – 2017-03)

  • Designed and built data lake pipelines on AWS using S3, Glue, and Athena, handling both batch and real-time data.
  • Managed end-to-end ETL pipelines for financial and customer analytics platforms.
  • Led data governance implementation using Informatica AXON and EDC.
  • Optimized PySpark jobs, improving pipeline efficiency by 40%.

Software Engineer at Intelliswift Software India Pvt. Ltd (2013-05 – 2014-10)

  • Led front-end and back-end development of large-scale multilingual, multisite Drupal CMS websites including theming and performance tuning.

Software Engineer at DNS Education Pvt. Ltd (2011-05 – 2013-05)

  • Developed robust web applications with a focus on scalability, proactively improving performance through strategic enhancements and bug resolution.

Education

Master of Computer Applications in MCA – Uttarakhand Technical University, Haldwani (2011)

Bachelor of Computer Applications in BCA – Kumaun University, Haldwani (2008)

Skills

Data & AI ArchitectCloud Solutions Architect

Reviews

Related