Mid Level
- Similar to previous reqs. Looking for someone that is more mid-level. Someone that can come in and be heads down and deliver on user stories.
- Knowledge of Kafka would be helpful. Uses Kafka to stream on-prem data to azure.
- Azure
- Python/Pyspark for the ETL
- This person is ingesting the data, some data curation.

Required

Azure
Databricks
Kafka
Python/Pyspark

All under this project

Project: Marketing Data Platform (used to enable real time campaigns and data for other teams). Building new cloud data warehouse solution, that is built in SnowFlake. Consume real time data through Kafka (coming from multiple sources). Data gets uploaded to SnowFlake. Framework is built, but they are in the initial stages.

What are the top 5-10 responsibilities for this position (please be detailed as to what the candidate is expected to do or complete on a daily basis)?

Should have prior experience managing Data lake and data warehouse type application
Should have prior experience managing big data platform to ingest / transform time series, batch data for real time access
1 to 3 years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark.
Should have experience with data security and governance guideline
Should have experience managing such application on cloud (preferably Azure) platform and also understand native cloud concept such as eventHub, ADLS, Azure data factory.
Should have experience managing various kind of BI tools for reporting like tableau

What does the ideal candidate background look like (ex: healthcare specific background specific industry experience etc.)?

ETL, Data warehousing, Python experience

What skills/attributes are required (please be detailed as to number of years of experience for each skill)?

Undergraduate degree or equivalent experience
5 + year of IT experience
1 to 3 years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark. [required]

What skills/attributes are preferred (what will set a candidate apart)?

1 to 3 or more years of experience with Snowflake/synapse, Databricks, Kafka, eventHub, Spark.

Required Skills : Azure Databricks Kafka Python/Pyspark

Basic Qualification :

Additional Skills :

Background Check :Yes

Drug Screen :Yes

Notes

Selling points for candidate :

Project Verification Info :UHGJP00069563/ UHGJP00069564

Exclusive to Apex :No

Face to face interview required :No

Candidate must be local :No

Candidate must be authorized to work without sponsorship :Yes

Interview times set :Yes

Type of project :Development/Engineering

Master Job Title :Dev: Java

Databrick Engineer

Job description