Job description
Experian
Big Data Engineer
12+ month contract
Remote - HQ in Costa Mesa, CA
- BS degree in computer science, computer engineering or equivalent
- 5 – 6 years of experience delivering enterprise software solutions
- Proficient in Spark, Scala, Python, AWS Cloud technologies
- 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala
- Flair for data, schema, data model, how to bring efficiency in big data related life cycle • Must be able to quickly understand technical and business requirements and can translate them into technical implementations
- Experience with Agile Development methodologies
- Experience with data ingestion and transformation
- Solid understanding of secure application development methodologies
- Experienced in developing microservices using spring framework is a plus
- Experience in with Airflow and Python will be preferred
- Understanding of automated QA needs related to Big data
- Strong object-oriented design and analysis skills
- Excellent written and verbal communication skills Responsibilities
- Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services
- Integrate new data sources and tools
- Implement scalable and reliable distributed data replication strategies
- Ability to mentor and provide direction in architecture and design to onsite/offshore developers
- Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases
- Perform analysis of large data sets using components from the Hadoop ecosystem
- Own product features from the development, testing through to production deployment
- Evaluate big data technologies and prototype solutions to improve our data processing architecture
- Automate everything
Required Skills : Big Data Engineer Amazon Web Services (AWS),Scala, Spark, Python OR Java GOOD Communication Reliable
Basic Qualification :
Additional Skills :
Background Check :Yes
Drug Screen :Yes
Notes
Selling points for candidate :
Project Verification Info
Candidate must be your W2 Employee :No
Exclusive to Apex :No
Face to face interview required :No
Candidate must be local :No
Candidate must be authorized to work without sponsorship ::No
Interview times set : :No
Type of project :Development/Engineering
Master Job Title :Big Data: Dev
Branch Code :Orange County
Interested in this role?
