Skip to main content

Big Data Engineer - Ascend Ops

Technology
1 week ago
Service contract

Job description

Experian

Big Data Engineer

12+ month contract

Remote - HQ in Costa Mesa, CA

  • BS degree in computer science, computer engineering or equivalent
  • 5 – 6 years of experience delivering enterprise software solutions
  • Proficient in Spark, Scala, Python, AWS Cloud technologies
  • 3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, Scala
  • Flair for data, schema, data model, how to bring efficiency in big data related life cycle • Must be able to quickly understand technical and business requirements and can translate them into technical implementations
  • Experience with Agile Development methodologies
  • Experience with data ingestion and transformation
  • Solid understanding of secure application development methodologies
  • Experienced in developing microservices using spring framework is a plus
  • Experience in with Airflow and Python will be preferred
  • Understanding of automated QA needs related to Big data
  • Strong object-oriented design and analysis skills
  • Excellent written and verbal communication skills Responsibilities
  • Utilize your software engineering skills including Java, Spark, Python, Scala to Analyze disparate, complex systems and collaboratively design new products and services
  • Integrate new data sources and tools
  • Implement scalable and reliable distributed data replication strategies
  • Ability to mentor and provide direction in architecture and design to onsite/offshore developers
  • Collaborate with other teams to design and develop and deploy data tools that support both operations and product use cases
  • Perform analysis of large data sets using components from the Hadoop ecosystem
  • Own product features from the development, testing through to production deployment
  • Evaluate big data technologies and prototype solutions to improve our data processing architecture
  • Automate everything

Required Skills : Big Data Engineer Amazon Web Services (AWS),Scala, Spark, Python OR Java GOOD Communication Reliable

Basic Qualification :

Additional Skills :

Background Check :Yes

Drug Screen :Yes

Notes

Selling points for candidate :

Project Verification Info

Candidate must be your W2 Employee :No

Exclusive to Apex :No

Face to face interview required :No

Candidate must be local :No

Candidate must be authorized to work without sponsorship ::No

Interview times set : :No

Type of project :Development/Engineering

Master Job Title :Big Data: Dev

Branch Code :Orange County

Interested in this role?