Krishna S

Results-driven Data Platform Developer with 4+ years of experience in designing, implementing, and optimizing scalable data architectures, specializing in ETL/ELT, DWH, and Cloud-based solutions. Proficient in data modeling, data integration, and analytics, with a strong focus on building high-performance data pipelines and enterprise BI solutions. Expert in developing end-to-end data platforms, leveraging cloud, on premises technologies to drive real-time analytics and business intelligence.

Adept at data profiling, transformation, and governance, ensuring data integrity, consistency, and compliance. Highly skilled in orchestrating data workflows, implementing CI/CD for data pipelines, and optimizing query performance for large-scale distributed systems.

BI & Data Engineer - Sun Tech

(2024-03 - 2026-01)

Responsible for analysis, requirements gathering, functional and technical specifications, development, deployment, and testing related to DWH, BI, Analytics and ETL projects.

• Developed and scheduled ETL workflows in ADF to extract data from various sources and store it in ADLS for further processing, ensuring a streamlined data pipeline for analytics.
• Worked with Azure Databricks for complex data transformations, implementing PySpark and Spark SQL to process large datasets, optimize queries, and improve data quality, availability.
• Set up data hierarchies and folder structures in ADLS Gen2 to simplify data management, making it easier to retrieve and process data for analytics projects.
• Configured Azure Key Vault to securely store and manage sensitive keys such as database credentials and connection strings, ensuring best practices for data security across pipelines.
• Designed and implemented ETL processes that improved data pipeline efficiency by 30%, integrating Azure Data Factory, PySpark, and various Azure storage solutions.
• Assisted in setting up Azure Active Directory user groups and defining permissions for accessing data in Azure, ensuring secure and compliant data access management.
• Implemented version tracking and deployment management techniques using Git, DevOps, ensuring smooth rollouts, and minimizing potential issues during dev and testing stages.
• Automated regular data refreshes and report exports using Power BI and Power Automate to deliver up-to-date insights on marketing and sales performance to relevant stakeholder.

BI & Data Engineer - Brisbane Council

(2021-08 - 2022-11)

• Optimized ADF, Databricks jobs by implementing partitions and caching strategies, reducing query execution time, improve overall performance for batch and streaming data processing.
• Leveraged SQL Data Warehouse to load and transform large volumes of data, optimizing performance through indexing and partitioning strategies to support BI workloads.
• Created automated monitoring and alerting systems using Azure Monitor and Log Analytics to ensure the smooth execution of data pipelines and address any performance issues.
• Performed data quality checks within the ETL pipeline to handle data anomalies, such as duplicates, missing values, ensuring high-quality, accurate data for reporting and analytics.
• Designed interactive data visualization dashboards and reports using Power BI, combining data from various sources to provide valuable insights to organizational executives.
• Implemented security measures, established user roles, and ensured adherence to corporate policies and regulations within the Power Platform to protect data and manage access.
• Designed and implemented complex workflows using Power Automate, automating data flows between Power BI, Dataverse, and other Microsoft 365 services.
• Transformed and cleaned data from different CRM, ERP platforms to ensure consistency, removed duplicates, handled missing values, and merged data for accurate reporting.
• Implemented data governance best practices, ensuring data quality, security, and compliance by enforcing access controls, data validation rules, and performance tuning strategies.

BI & Data Engineer - Kelloggs

(2020-02 - 2021-08)

• Collaborated closely with corporate internal and external stakeholders to identify needs, develop solutions, and execute Power Platform projects on time and within budget.
• Designed, developed, and maintained ETL pipelines using ADF and SSIS to extract, transform, and load data from diverse sources into Data Warehouses and Data Lakes.
• Optimized and automated complex ETL workflows, leveraging ADF Dataflows, SSIS packages, and stored procedures to improve data processing efficiency and reliability.
• Implemented robust logging, error handling, and monitoring mechanisms for ETL processes, reducing failure rates and ensuring seamless data integration in Data Factory, and SSIS.
• Developed and managed data models using SSAS, implementing OLAP cubes and tabular models to enhance analytical performance and reporting capabilities.
• Utilized Python for data preprocessing, automation of ETL workflows, and building reusable scripts for data transformation, validation, and quality checks.
• Designed and developed interactive dashboards and reports using Power BI, Tableau, and SSRS, providing actionable insights and data-driven decision-making support for stakeholders
• Integrated complex datasets from multiple sources, applied business logic, and optimized DAX queries in Power BI to improve report performance and visualization responsiveness.
• Created and optimized SQL queries, stored procedures, and views to support reporting needs, ensuring data accuracy and efficient query performance across BI solutions.

BI & Data Engineer - ITC Hotels

(2019-05 - 2019-12)

• Worked closely with business users and stakeholders to gather requirements, translate them into technical specifications, and develop intuitive self-service BI solutions.
• Developed, and maintained ETL workflows using SSIS, Alteryx, and SAP BW to integrate data from multiple sources, ensuring efficient and accurate data across enterprise systems.
• Designed and implemented OLAP cubes in SSAS to enable multidimensional data analysis, optimizing query performance for Power BI, Tableau, and SSRS reports.
• Developed interactive Power BI dashboards for the client, providing real-time insights into key performance indicators (KPIs) and facilitating data-driven decision-making.
• Highlighted performance trends over months, identified trending certifications, and visualized geographical performance variations to support strategic business decisions.
• Conducted in-depth analysis and debugging of DAX queries using DAX Studio, identifying, and resolving performance bottlenecks, and ensuring data accuracy and report reliability.
• Was responsible to managing and administrating Power BI Service app workspaces, user roles, publishing apps and setting data sources on enterprise gateways.
• Built advanced visualizations and KPI dashboards in Power BI and Tableau, leveraging DAX calculations, and drill-through functionalities to provide actionable business insights.

Master of Science (MSc) - Data Science - Teesside University (2024)

Bachelor of Technology (B.Tech) - Electronics and Communication Engineering - Sathyabama University (2017)