Data Engineer
Technology
Toronto, Canada2 weeks ago
Full time
Job description
- Build Kafka-based streaming and event-driven solutions.
- Write complex SQL queries for data transformation and validation.
- Implement data ingestion from databases, APIs, files, and streaming sources.
- Monitor performance, troubleshoot issues, and ensure data quality, security, and governance.
- Support deployments, testing, upgrades, and production releases.
- PySpark and Apache Spark (Spark SQL, DataFrames)
- Apache Kafka
- Hadoop Ecosystem (HDFS, Hive, YARN)
- Apache NiFi
- SQL
Keywords
Apache HadoopApache KafkaApache SparkSqlHiveHadoopApache Http Server
Interested in this role?