Big Data Engineer - Spark/Python

Job Description :

• 6 Years of in Big Data & Data related technology experience.
• Expert level understanding of distributed computing principles.
• Expert level knowledge and experience in Apache Spark.
• Hands on programming with Python.
• Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop.
• Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming.
• Experience with messaging systems, such as Kafka or RabbitMQ.
• Good understanding of Big Data querying tools, such as Hive, and Impala.
• Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files.
• Good understanding of SQL queries, joins, stored procedures, relational schemas.
• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB.
• Knowledge of ETL techniques and frameworks.
• Performance tuning of Spark Jobs.
• Experience with native Cloud data services Azure databricks OR GCP.
• Ability to lead a team efficiently.
• Experience with designing and implementing Big data solutions.
• Practitioner of AGILE methodology.

We Offer :

• Opportunity to work on technical challenges that may impact across geographies.
• Vast opportunities for self-development : online university, knowledge sharing opportunities globally, learning opportunities through external certifications.
• Opportunity to share your ideas on international platforms.
• Sponsored Tech Talks & Hackathons.
• Possibility to relocate to any EPAM office for short and long-term projects.
• Focused individual development.

Benefit package :

• Health benefits, Medical Benefits.
• Retirement benefits.
• Paid time off.
• Flexible benefits.