We are seeking a skilled Python Data Engineer with 5-9 years of experience to join our dynamic team in India. The ideal candidate will be responsible for designing and implementing robust data pipelines and ensuring the efficient flow of data across various platforms.
Responsibilities
Design, develop, and maintain data pipelines and ETL processes using Python.
Collaborate with data scientists and analysts to understand data needs and deliver high-quality datasets.
Optimize and improve data processing workflows for efficiency and scalability.
Monitor and troubleshoot data pipeline issues to ensure data integrity and availability.
Implement data quality checks and validation to maintain data standards.
Skills and Qualifications
Proficient in Python programming with a strong understanding of data structures and algorithms.
Experience with data warehousing solutions and ETL tools.
Solid understanding of databases (SQL and NoSQL) and data modeling concepts.
Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
Knowledge of data visualization tools and libraries (e.g., Matplotlib, Seaborn).
Understanding of big data technologies like Hadoop, Spark, or Kafka is a plus.
Strong analytical and problem-solving skills.
Keywords
AirflowPythonSqlEtlData WarehousingApache SparkData ModelingBigQueryNosqlDockerApache KafkaApache HadoopScalabilityHadoopApache LicenseApache Http ServerBig data
**********