Data Engineer
Techwave TechnologiesJob description
About Techwave Technologies
Techwave Technologies is a technology consulting company delivering innovative IT solutions, data engineering, cloud modernization, and digital transformation services. We work with organizations across multiple industries to build scalable technology solutions, modernize data infrastructure, and enable data-driven business decisions.We are looking for a skilled Data Engineer to join our growing team and contribute to enterprise-level data engineering and analytics projects.
Position Overview The Data Engineer will be responsible for designing, developing, implementing, and maintaining scalable data pipelines and data infrastructure. The ideal candidate should have strong hands-on experience with Python, SQL, ETL/ELT development, cloud platforms, data warehousing, and big data technologies.
The candidate will collaborate with data architects, business analysts, data scientists, and cross-functional engineering teams to build reliable data solutions that support business intelligence, analytics, and enterprise applications.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines to process structured and unstructured data from multiple sources.
- Build automated data ingestion and transformation workflows using Python, SQL, PySpark, and other data engineering technologies.
- Develop and optimize data pipelines using Apache Spark, PySpark, and distributed computing frameworks.
- Implement data integration solutions using REST APIs, databases, flat files, and cloud-based data sources.
- Design and maintain data warehouses, data lakes, and lakehouse architectures.
- Work with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP).
- Develop data workflows using Apache Airflow, Azure Data Factory, AWS Glue, or similar orchestration tools.
- Implement data modeling techniques, including dimensional modeling, star schema, snowflake schema, and data marts.
- Work with Snowflake, Amazon Redshift, Google BigQuery, or Azure Synapse Analytics.
- Implement data quality checks, data validation, reconciliation, and error-handling mechanisms.
- Optimize SQL queries, database performance, and data processing workflows.
- Implement real-time data processing and streaming solutions using Apache Kafka or similar technologies.
- Collaborate with BI developers, data analysts, and data scientists to provide reliable and business-ready datasets.
- Implement version control, CI/CD pipelines, and automated deployment practices using Git, GitHub, Jenkins, or Azure DevOps.
- Monitor production data pipelines, troubleshoot failures, and perform root cause analysis.
- Maintain technical documentation, data mappings, pipeline specifications, and operational procedures.
Interested in this role?