Principal Data Engineer (Cortex)

As a Principal Data Engineer, you will be integral to the security research group, designing, building, and maintaining the data pipelines and data frameworks that are the backbone of our cyber attack detection capabilities. You will work closely with top security and AI researchers, enabling their work and seeing the direct impact of your contributions on our services and the day-to-day effectiveness of the research team.Key ResponsibilitiesLead the design and implementation of end-to-end, complex data pipelines and data platforms in cloud environment.Collect, analyze, and translate complex data requirements from various stakeholders including data analysts, developers, and Cyber security researchers.Develop robust, scalable Cloud based data solutions using Python and distributed processing frameworks such as Apache Beam (Dataflow) , GKE , Spark , etc.Utilize AI as part of the development cycle, including generating, reviewing, and testing code via prompts.Model and manage data within cloud MPP databases and data lakes such as BigQuery, Redshift, or Snowflake.Requirements: 4 years experience as a Senior Data Engineer / Data engineer lead (Hands-On) / Data architect - working with Cloud environments Experience in leading and implementing end to end complex Data pipelines and data platformsExperience with collecting , analyzing and syncing complex data requirements from various data users such as: Data Analysts , Developers , Researchers and Managers4 years Experience with Data Modeling using various Data platforms and databases4 years Python experience - focused on Data related areas and distributed processing (Experience with at least one of the following:Spark, GCP DataFlow (Apache Beam), GKE , etc)Experience with Docker & Kubernetes / GKE4 Years experience with Cloud MPP Databases / Data Lakes such as: BigQuery , Redshift , Snowflake , Azure SQL DWH , Azure KustoFluent with SQLAI:Using AI as part of the development cycle is second nature for you.Experience generating code via Prompts and closing the loop by reviewing and testingExperience writing MCPs , Skills and mdsSoft skills:Collaborative Mindset: A team-first leader who believes that the best data products are built through collective genius and open communication.Bridge Builder: Naturally connects the dots between diverse teams-from DevOps to Data Science-to break down silos and streamline data delivery.Growth-Minded: Approaches feedback as a tool for evolution; possesses the grit to pivot and find the "silver lining" in complex technical setbacks.Execution Passionate: Genuinely loves the "how" as much as the "what," finding joy in the pursuit of clean code and the deployment of mission-critical pipelines.Preferred QualificationsGCP experienceData science backgroundCyber security knowledge.This position is open to all candidates.