Skip to main content

Data Engineer

Technology
J&M Group
Toronto, Canada2 weeks ago
Full time

Job description

  • Build Kafka-based streaming and event-driven solutions.
  • Write complex SQL queries for data transformation and validation.
  • Implement data ingestion from databases, APIs, files, and streaming sources.
  • Monitor performance, troubleshoot issues, and ensure data quality, security, and governance.
  • Support deployments, testing, upgrades, and production releases.

Mandatory Skills

  • PySpark and Apache Spark (Spark SQL, DataFrames)
  • Apache Kafka
  • Hadoop Ecosystem (HDFS, Hive, YARN)
  • Apache NiFi
  • SQL

Keywords
Apache HadoopApache KafkaApache SparkSqlHiveHadoopApache Http Server

Interested in this role?