Data Engineer - Python/SQL

Job profile and Role: Data Engineer

Job description

• Strong experience with Postgres and SQL and experience working with, supporting and maintaining relational databases.
• Experience building and optimizing 'big data' data pipelines, architectures, and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience with AWS cloud services
• Experience in migrating data across the database/environments with zero downtime.
• Experience with AWS integration tool, AWS Glue.
• Experience supporting complex ETL & ; Integration Projects
• Create and maintain comprehensive documentation for advanced analytics models, data dictionaries, and data flows.
• Hands on engineering of solutions and data pipelines utilizing CI/CD and automation.
• Design and maintain testing processes and automation workflows for data feature changes, upgrades, and releases.
• Strong analytic skills related to working with semi structured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large, disconnected datasets.
• Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.

Required Skills

• Bachelor's degree in Computer Science or equivalent degree.
• 5 years of software experience
• Experience with Machine learning frameworks and models. Pytorch experience preferred
• Strong understanding of statistical analysis and mathematical data manipulation
• Work with web technology including Java, Python, JavaScript, React/Redux, Kotlin.
• Follow best practices for software development and deployment
• Understanding of relational database, big data, and experience in SQL
• Proficient at using GIT, GitFlow, JIRA, Gitlab and Confluence.
• Strong analytical and problem solving skills.
• Open-minded and passionate to learn and grow technology skills
• Strong sense of accountability
• Solution-focused and ability to drive change within the organization
• Experience in writing unit/integration tests including test automation.
• Strong testing and debugging abilities, functional, analytical and technical abilities, ability to find bugs, attention to detail, troubleshooting