メインコンテンツへスキップ

Big Data Engineer

Technology
Egotechworld
宇佐市, 日本2ヶ月前
正社員フルリモート

職務内容

Company Description EgoTECHworld is a technology-focused organization that serves as a trusted partner for clients seeking innovative IT solutions. The company provides opportunities to gain practical industry experience through real-world projects and collaborations. EgoTECHworld also offers insightful tech articles and resources to help professionals stay current with emerging trends and tools.

Team members work in a dynamic environment that values curiosity, continuous learning, and practical problem-solving. The organization is committed to empowering both clients and staff with modern, scalable technology capabilities.

Role Description The Big Data Engineer is a full-time, remote role responsible for designing, building, and maintaining data platforms that support analytics and business intelligence. Day-to-day responsibilities include developing and optimizing data pipelines, implementing Extract Transform Load (ETL) processes, and managing large-scale data processing workflows. The role involves working with big data frameworks, integrating data from multiple sources, and ensuring data quality, reliability, and security.

The Big Data

Engineer will collaborate with software developers, data analysts, and other stakeholders to translate business requirements into robust data solutions. The position also includes monitoring system performance, troubleshooting issues, and contributing to continuous improvement of data infrastructure.

Qualifications

  • Strong Data Engineering skills, including building and maintaining scalable data pipelines and workflows.
  • Hands-on experience with Extract Transform Load (ETL) processes and tools to integrate and transform data from diverse sources.
  • Proficiency in Big Data technologies and frameworks (e.g., Hadoop, Spark, Kafka, or similar) for large-scale data processing.
  • Experience with Data Warehousing concepts and solutions, including schema design and performance optimization.
  • Software Development skills using modern programming languages (e.g., Python, Java, or Scala) and version control tools.
  • Knowledge of SQL and NoSQL databases, data modeling, and data governance best practices.
  • Ability to work independently in a remote setting, manage priorities, and communicate clearly with cross-functional teams.
  • Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related field, or equivalent practical experience.
  • Experience in cloud platforms (e.g., AWS, Azure, or GCP) and their data services is highly beneficial.

Keywords
ScalaApache KafkaApache HadoopSCHEMAApache SparkPythonSqlHadoopJavaBig dataAWS

この求人に興味がありますか?