2 - 5 years of diversified experience in design, development, analysis, testing and implementation of data pipelines using AWS services, Python, Apache Spark, Jupyter Notebook.
Excellent understanding and hand on experience in AWS Architecture and services; DynamoDB, Lambda, EC2, S3, ELB, EMR, Redshift.
Extensively worked on AWS Data pipelines using Python and also leveraged python libraries such as numPY and Pandas for data analytics.
Hands on experience in using data warehousing technologies such as AWS Redshift, Oracle and Teradata.
Experience working on API development.
Hands-on experience in Data Visualization tools like Tableau, Power BI.
Experience in RDBMS like MySQL ,programming languages like Pyspark
Hands on experience with Python IDE's like Pycharm, Jupyter Notebook.
Knowledge on GIT processes and UNIX machines.
Performance Tuning of long running SQL queries and procedures and effectively reduced SLA breaches.
Worked on scripting with python in spark for transforming the data from various - les like Text - les, CSV and JSON Demonstrated experience in effective decision making within a high-pressure environment.
Excellent analytical and problem solving skills and ability to quickly learn new technologies
Good communication and interpersonal skills, team player and can work independently.

Data Engineer - Python/PySpark

Related