Sr Data Engineer
Request a quote with no obligation
I am a Senoir Data Engineer who have developed a strong foundation in handling large-scale data processing and analysis using a variety of technologies and tools. With over 5 years of professional experience in the field, I have honed my skills in Big Data analytics, cloud services, and data engineering pipelines.
As a data engineer with the qualifications and experience listed in my resume, I have developed a strong foundation in handling large-scale data processing and analysis using a variety of technologies and tools. With over 5 years of professional experience in the field, I have honed my skills in Big Data analytics, machine learning, cloud services, and data engineering pipelines.
Throughout my career, I have gained expertise in working with the Hadoop ecosystem, including technologies like MapReduce, HDFS, Hive, Pig, Sqoop, and Spark.In addition to Hadoop, I have a strong grasp of cloud computing platforms such as AWS and Azure. I have worked extensively with AWS services like EMR, Redshift, S3, and Athena, leveraging their power to handle large volumes of data and enable efficient data processing. I have also utilized Azure Data Lake, Azure Data Factory, and SQL Data Warehouse to design and implement robust data engineering pipelines.
Python and PySpark are my go-to programming languages for data manipulation and automation projects. I have developed Spark applications using Spark SQL, RDD APIs, and DataFrames, enabling efficient data processing and analysis.
A project management course provided individuals with the knowledge and skills required to effectively plan, execute, and control projects. It covered key concepts, methodologies, and best practices in project management. I learned about defining the project goals, creating schedules, allocating resources, managing risks, and communicating effectively with stakeholders. The course emphasized project planning, organization, and successful delivery within specified constraints. Overall, it equiped the individuals with the tools and techniques necessary to lead and manage projects successfully.