Skip to main content

AI Data Engineer

Technology
Haystack
1 month ago
Full timeOn-site

Job description

A global technology powerhouse specializing in industrial automation and digital infrastructure is seeking a highly skilled professional to join their innovative team. This organization is at the forefront of leveraging cutting-edge AI and cloud technologies to transform complex data into actionable insights.

The Role

  • Design, develop, and optimize advanced Python applications for data and AI use cases.
  • Build and integrate OpenAI-based solutions, including LLMs, prompt engineering, APIs, and embeddings.
  • Develop and maintain large-scale ETL/data pipelines and production-grade ETL systems.
  • Implement workflow orchestration using Apache Airflow.
  • Work with AWS services, ensuring best practices for performance, security, scalability, and reliability.
  • Manage CI/CD pipelines using Harness and collaborate with data scientists and business teams.

What You'll Need

  • Strong and advanced Python development expertise.
  • Hands-on experience with OpenAI / Generative AI APIs.
  • Solid experience with AWS cloud services.
  • Proven expertise in Apache Airflow for orchestration.
  • Experience with Harness for CI/CD.
  • Strong ETL and data engineering skills, including data modeling and transformations.

What's On Offer

  • Opportunity to work with cutting-edge AI and cloud technologies.
  • Contribute to scalable data pipelines and AI-driven solutions.
  • Collaborate with a talented team of data scientists and engineers.

Apply via Haystack today!

Keywords
artificial-intelligenceinsurance-consulting-and-technologyindustrial-automationclubs-organizationsmicrosoft-forefrontactionable-insightsplanning-and-designvisual-art-designproduct-development-and-designpythonuse-caseopenaiprompt-engineeringextract-transform-and-load-etldata-pipelineworkflowservice-management-and-orchestration-smoairflowapache-airflowamazon-web-services

Interested in this role?