Praveen Krish
Senior Data Engineer
Hire this person
Send a job offer directly to this candidate
About
Results-driven Data Engineer with 4 years of experience at Novac Technology, specialising in designing, building and optimising scalable ETL/ELT pipelines on Azure and on-premise environments. Hands-on expertise across the full data engineering stack — from ingestion and transformation to warehousing and governance. Currently serving as Associate Project Manager, leading a team of engineers, mentoring junior developers, and driving cross-functional delivery.
Experienced with Azure Databricks and Unity Catalog for scalable data processing and governance.
Experience
Associate Project Manager - Novac Technology
(2024-04)
- Lead a team of data engineers — conducting code reviews, sprint planning, and mentoring junior developers on pipeline design and data quality best practices.
- Oversee end-to-end project delivery — from requirements gathering and architecture design through to deployment and stakeholder sign-off.
- Design and implement complex ETL/ELT workflows using Apache Airflow, Azure Data Factory, Dbt, Python, SSIS, and Stored Procedures, improving efficiency and reducing error rates.
- Build and maintain real-time streaming data pipelines to support analytics and business intelligence use cases.
- Collaborate with IT, compliance, and business teams to ensure system reliability, security, and data governance standards.
- Drive automation initiatives that reduce manual intervention across data workflows.
- Led on-premise to cloud migration and AWS to Azure data migration projects using Python and Polars.
Software Engineer (Data Engineer) - Novac Technology
(2022-03 - 2024-04)
- Designed and developed ETL processes for Finance and Insurance domains on Azure, processing large volumes of structured and unstructured data.
- Applied advanced SQL techniques — query optimisation, indexing, and stored procedures — to significantly improve data access speeds.
- Used Azure Databricks (PySpark, Pandas, Polars) for large-scale data transformation and performance optimisation.
- Built RESTful APIs using Flask and Django REST Framework to enable seamless data exchange between systems.
- Supported data extraction and transformation tasks, enhancing reporting capabilities and business intelligence insights.
- Maintained version control and CI/CD pipelines using GitHub, BitBucket, and Jenkins.
Education
Bachelor of Computer Applications - BCA - DRBCCC Hindu College, Pattabiram (2021-06)
