AI Data Engineer
Technology
Haystack1 month ago
Full timeOn-site
Job description
A global technology powerhouse specializing in industrial automation and digital infrastructure is seeking a highly skilled professional to join their innovative team. This organization is at the forefront of leveraging cutting-edge AI and cloud technologies to transform complex data into actionable insights.
The Role
- Design, develop, and optimize advanced Python applications for data and AI use cases.
- Build and integrate OpenAI-based solutions, including LLMs, prompt engineering, APIs, and embeddings.
- Develop and maintain large-scale ETL/data pipelines and production-grade ETL systems.
- Implement workflow orchestration using Apache Airflow.
- Work with AWS services, ensuring best practices for performance, security, scalability, and reliability.
- Manage CI/CD pipelines using Harness and collaborate with data scientists and business teams.
What You'll Need
- Strong and advanced Python development expertise.
- Hands-on experience with OpenAI / Generative AI APIs.
- Solid experience with AWS cloud services.
- Proven expertise in Apache Airflow for orchestration.
- Experience with Harness for CI/CD.
- Strong ETL and data engineering skills, including data modeling and transformations.
What's On Offer
- Opportunity to work with cutting-edge AI and cloud technologies.
- Contribute to scalable data pipelines and AI-driven solutions.
- Collaborate with a talented team of data scientists and engineers.
Apply via Haystack today!
Keywords
artificial-intelligenceinsurance-consulting-and-technologyindustrial-automationclubs-organizationsmicrosoft-forefrontactionable-insightsplanning-and-designvisual-art-designproduct-development-and-designpythonuse-caseopenaiprompt-engineeringextract-transform-and-load-etldata-pipelineworkflowservice-management-and-orchestration-smoairflowapache-airflowamazon-web-services
Interested in this role?