Senior Data Engineer - Python, SQL

Requirements

Must have:

- Bachelors degree in Computer Science, Information Systems, Data Science, Mathematics, Physics, Engineering, Statistics, Economics, or a related field required. - Masters degree in Computer Science, Information Systems, Data Science, Mathematics, Physics, Engineering, Statistics, Economics, or a related field preferred. - At least eight (8) years of experience as a data engineer with full-stack capabilities. - Minimum of ten (10) years of programming experience. - Minimum of five (5) years in cloud technologies such as Azure, AWS, or Google. - Proficient in SQL. - Experience in Machine Learning and ML Pipeline is a plus. - Familiarity with real-time integration and developing intelligent applications and data products. - Strong proficiency in Python and knowledge of CI/CD practices. - Solid background in IaaS platforms and infrastructure. - Hands-on experience with Databricks, Spark, Fabric, or similar technologies. - Knowledge of Agile methodologies. - Practical experience in designing and developing data pipelines and data products. - Experience in developing data ingestion, processing, and analytical pipelines for big data, NoSQL, and data warehouse solutions. - Hands-on experience implementing data migration and processing using Azure services including ADLS, Azure Data Factory, Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, HDInsight, Databricks, Azure Data Catalog, Cosmos DB, ML Studio, AI/ML, etc. - Extensive experience in Big Data technologies such as Apache Spark and streaming technologies like Kafka, EventHub, etc. - Significant experience in designing data applications in a cloud environment. - Intermediate experience with RESTful APIs and messaging systems, as well as either AWS or Microsoft Azure. - Extensive experience in Data Architecture and modeling. - Expert in data analysis and quality frameworks. - Knowledgeable in BI tools such as Power BI and Tableau. - May occasionally require working evenings and/or weekends.

Responsibilities:

- Design, develop, and maintain real-time and batch data pipelines for processing and analyzing large data sets. - Develop programs and tools to support the ingestion, curation, and provisioning of complex first-party and third-party data for analytics, reporting, and data science. - Create advanced data products and intelligent APIs, while monitoring system performance through regular tests, troubleshooting issues, and integrating new features. - Lead the analysis of data and the architectural design required to support BI, AI/ML, and data products. - Design and implement a data platform architecture that fulfills organizational analytical requirements, ensuring the solution is scalable, maintainable, extensible, and reliable. - Provide technical guidance and mentorship to team members, leading peer development and code reviews with an emphasis on test-driven development and CI/CD practices.

Company:

At AMH, we have been recognized as one of the leading single-family rental companies and homebuilders since 2012, earning accolades as a top employer by Fortune and Great Place to Work®. Our mission is to simplify the home leasing experience through professional management and maintenance support, allowing our residents to focus on what truly matters in their lives. We offer competitive compensation, an annual discretionary bonus, and a comprehensive benefits package that includes medical, dental, and vision insurance, a 401(k) plan with company matching, paid time off, flexible spending accounts, and tuition reimbursement. We look forward to adding a Senior Data Engineer to our dynamic team!