Job description
The Data Developer works within the ETL and Operations team to build high quality data pipelines driving analytic solutions from diverse, disparate sources of data.
This role requires a working understanding of data architecture, data engineering, and data analysis. The ideal candidate is a skilled data engineer with experience creating data products supporting analytic solutions. They are able to identify and implement solutions in a highly technical environment and work as part of a technical, cross-functional team. Strong problem-solving and troubleshooting skills are a must.
This role focuses on designing, developing, and maintaining datasets within AWS with oversight and support from Lead Developers. Day-to-day responsibilities include:
- Coordinating, building, and managing new data ingests
- Implementing updates, fixes, and optimizations across suite of production jobs
- Providing feedback on and enacting changes for improvements across the team including both technical and process updates
- Learning about and becoming familiar with data assets, processing jobs and pipelines, and tools
- Partnering with data analysts and data scientists to design, build, and deploy aggregation processes
- Hadoop/Hive experience
- Strong SQL
- AWS experience (EMR, Lambda, Glue, Step Functions)
- Experience working with large data sets (billions of records per day)
- Write and review code
- Python scripting (PySpark, control scripts)
- Building and managing data pipelines
- Query and data pipeline optimization
- Strong communication and collaboration skills
- Ability to learn new technologies and skills to incorporate into existing work
- Spark
- Scala
- Git
- Shell scripting
- Linux
Required Skills : MUST HAVE: • ETL development experience with large amounts of data • Very strong SQL and/or HQL • End to end development, performance tuning, etc. • AWS experience: S3, Athena, EMR, Lambda
Basic Qualification : 10/10 COMMUNICATION
Additional Skills : 10/10 COMMUNICATIONLONG TERM, GROWTH
Background Check :Yes
Notes
Selling points for candidate :LONG TERM, GROWTH
Project Verification Info
Candidate must be your W2 Employee :Yes
Exclusive to Apex :Yes
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set :Yes
Type of project :Development/Engineering
Master Job Title :ETL Developer
Branch Code :Denver
Interested in this role?
