Job Title: Data Engineer
Experience: 7+ Years
Location: Remote
Employment Type: Full-time
About the Role:
We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and data platforms. The ideal candidate has strong expertise in PySpark, Python, and complex SQL, with a proven track record of developing high-performance data processing solutions in enterprise environments.
Key Responsibilities:
- Design, develop, and maintain scalable ETL/ELT pipelines using PySpark and Python.
- Build and optimize large-scale data processing workflows for structured and semi-structured data.
- Write, optimize, and troubleshoot complex SQL queries for data transformation, reporting, and analytics.
- Develop reusable data engineering frameworks and best practices.
- Ensure data quality, integrity, and reliability across the data platform.
- Collaborate with data analysts, data scientists, product teams, and business stakeholders to deliver data solutions.
- Monitor, troubleshoot, and optimize data pipeline performance.
- Implement data validation, logging, error handling, and monitoring mechanisms.
- Participate in code reviews and contribute to engineering standards and documentation.
Mandatory Skills:
- 7+ years of experience in Data Engineering.
- Strong hands-on expertise in PySpark.
- Advanced proficiency in Python.
- Strong experience writing and optimizing complex SQL queries.
- Experience building scalable ETL/ELT pipelines.
- Strong understanding of data modeling and data warehousing concepts.
- Experience working with large datasets and distributed data processing.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
Preferred Skills:
- Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Familiarity with orchestration tools such as Apache Airflow.
- Experience with Delta Lake, Apache Spark optimization, or Databricks.
- Knowledge of CI/CD pipelines and version control using Git.
- Experience with data lakes and modern data architectures.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Strong understanding of software engineering best practices and agile development methodologies.
What We Offer:
- Fully remote work environment.
- Opportunity to work on large-scale, data-intensive projects.
- Collaborative and innovative engineering culture.
- Competitive compensation and benefits.
- Career growth and continuous learning opportunities.
FUNIC TECH PRIVATE LIMITED