Dayton, City of Dayton, MontgomeryMember since May 21, 2024
·
Hire this person
Send a job offer directly to this candidate
About
I am a Data Engineer looking for new opportunities in crop to crop[
Experience
Experienced data engineer with over 7 years of technical IT experience, proficient in all phases of the Software Development Life Cycle (SDLC).
Skilled in data analysis, design, development, testing, and deployment of software systems.
Extensive expertise in working with Spark, Hadoop, Aws, Azure, and GCP stack.
Strong Experience in Big Data analytics, Data manipulation, using Hadoop Ecosystem tools Map - Reduce, HDFS, Yarn/MRv2, Pig, Hive, HDFS, HBase, Spark, Kafka, Sqoop, Flume, Oozie, Avro, Sqoop, AWS, Spring Boot, Spark integration with Cassandra, Avro, Solr, and Zookeeper
Extensive hands-on experience in using distributed computing architectures such as AWS products (e.g., EC2, Redshift, EMR, and Elastic search), Hadoop, Python, Spark, and effective use of Azure SQL Database, Map Reduce, Hive, SQL, and PySpark to solve big data type problems.
Experience on building data warehouse and data loading in Snowflake
Experience with UNIX/Linux and Shell Scripting.
Experience in Query Performance tuning in analyzing and optimizing complex SQL queries for efficiency and speed.
Adept at utilizing BI tools such as Power BI and QlikView for enhancing reporting capabilities and developing BI applications in accordance with client requirements.
Experience in developing data pipelines using AWS services, including EC2, S3, Redshift, Glue, Lambda functions, Step functions, cloud Watch, SNS, Dynamo, and SQS.
Experienced in working with tools such as Alteryx, Splunk, and Control-M for data analytics, automation, and workflow management.
Education
Master’s in Computer Science, University of Dayton(2022)
Bachelors in ECE, JNTUH(2016)
Reviews
Similar people near Dayton, City of dayton, Montgomery