Senior Cloud/Data Engineer

Job Description

Top Skills:

Data Engineering with Python programming

Apache Spark and PySpark

AWS

Snowflake

Bachelors degree in computer science or related discipline; advanced Studies/ Degree preferred.

5-7 years of experience in data engineering with strong proficiency in Python programing language (Nice to have: Scala, Java).

Strong proficiency in spark SQL, SQL, gremlin, GraphQL and database management (Snowflake cloud-base warehousing).

Strong experience with data processing frameworks, DataFrames, Apache Spark, Graph DBs

Experience with cloud platform

AWS(EMR, EKS, Lambda).

Experience writing statistical and/or optimization programs to develop models and algorithms.

Programming languages may includebut are not limited toPython, R

Solid understanding of SDLC practices including development, testing, and release management.

Experience with version control systems such as Git, BitBucket

Experience with RESTful API design and development.

Familiarity with PySpark for large-scale data processing and analysis.