Job description
Location Washington DC 100 Onsite Clearance Top SecretSCI Job Type Full time Target Salary Range 175000 200000 This represents the potential salary range for this position depending on education level years of experience andor certifications in addition to other position specific requirements which may impact salary Position OverviewThe Data Engineering Software Developer Mid designs builds integrates and maintains scalable data systems and pipelines that support analytics reporting and operational insight across complex enterprise environments This role focuses on ingesting processing transforming and unifying large and disparate data sources while ensuring data quality security performance and compliance with DoD and DISA requirements The Data Engineering Software Developer Mid develops solutions using Confluent Kafka Elastic Stack AWS Red Hat OpenShiftKubernetes data warehouses and data lakes The position also supports automation CICD platform optimization visualization capabilities and collaboration across software data analytics and network operations teams Key ResponsibilitiesData Pipeline Development and IntegrationDesign build and maintain scalable and reliable data systems and pipelines to ingest process and transform large complex and disparate data sources for analytics and reportingUnify and integrate data from multiple network operations systems into a consistent and accessible platformDevelop and maintain ETLELT processes supporting data ingestion transformation validation and cleansingCreate and maintain Kafka Elastic and Logstash pipelines supporting enterprise data processing requirementsAutomate data related processing and monitoring activitiesData Platforms and Software DevelopmentImplement data solutions using Confluent Kafka Elastic Stack AWS and Red Hat OpenShiftKubernetesDevelop and manage data warehouses and data lakes supporting analytics reporting and operational dashboardsDevelop data engineering capabilities using Python Java SQL shell scripting and related technologiesSupport Kibana visualizations and dashboards using React JavaScript and HTMLApply software engineering and automation practices to improve the maintainability and scalability of data solutionsPerformance and Platform OptimizationAnalyze and optimize data ingestion throughput query performance indexing strategies and storage efficiency across Elastic and Kafka platformsOptimize infrastructure for performance scalability reliability and cost effectivenessTroubleshoot and resolve issues related to data ingestion processing storage memory utilization partitioning and cluster performanceIdentify and resolve performance bottlenecks affecting data availability and downstream analyticsSecurity Compliance and DevOpsEnsure data quality accuracy security and compliance with applicable DoD and DISA requirementsApply appropriate data security and access control practicesSupport CICD pipelines for automated build test and deployment activitiesApply version control and DevOps practices to data engineering and software development workflowsCollaboration and DocumentationCollaborate with data analysts visualization engineers software developers and other stakeholders to deliver integrated and actionable data solutionsDocument data architecture integration patterns configurations and operational proceduresDevelop and maintain technical documentation and runbooks supporting data platforms pipelines and applicationsQualificationsEducationBachelors degree in Computer Science Engineering or a related technical discipline with 4 7 years of relevant experience Required ExperienceHands on experience designing building and maintaining ETLELT data pipelines and integrating multiple disparate data sources RequiredExperience with data warehouse andor data lake technologies such as AWS Redshift Amazon S3 Hadoop Snowflake or similar platforms RequiredExperience with Elastic Stack including Elasticsearch Logstash and Kibana andor Kafka for data ingestion and processing RequiredExperience with LinuxUNIX system administration and automation RequiredExperience with CICD pipelines containerized pipelines version control technologies such as Git and Bitbucket and DevOps practices RequiredFamiliarity with network operations data including logs metrics events ticketing CMDB data and related data modelsSkillsProficiency with data engineering and software development technologies and languages such as Python Java SQL and shell scripting RequiredKnowledge of data security access controls and compliance frameworks including DoD DISA RMF and STIG requirements RequiredStrong communication and documentation skills supporting collaboration and knowledge sharing RequiredCertificationsCurrent Security certification or higherequivalent certification Required ClearanceActive TSSCI security clearance Required Other RequirementsWillingness and ability to complete and maintain additional customer suitability screenings throughout employment Required Preferred QualificationsExperience supporting DISA DISN or other DoD network environmentsExperience developing and deploying software applications that meet DoD security standards including applicable STIGsKnowledge of network security encryption and access controls within classified environmentsExperience with big data technologies and platforms such as Kafka Spark NiFi Hadoop Elasticsearch Logstash Databricks and ELK StackExperience applying big data technologies to text mining summarization search and entity extractionExperience with cloud based data platforms including AWS Azure GCP or AWS GovCloudExperience with cloud integrated platforms and Infrastructure as Code including networking and security policiesFamiliarity with Kubernetes deployment platform upgrades and patchingExperience with configuration management technologies such as Ansible Puppet or ChefExperience with monitoring alerting and observability technologies such as Prometheus Grafana and ElasticExperience with business intelligence and visualization tools such as KibanaExperience developing and maintaining technical documentation and operational runbooksStrong understanding and practical experience with Agile methodologies including Scrum and SAFeExperience with Atlassian Jira and ConfluenceConfluent Developer certificationElastic Certified Engineer certificationExperience working remotely with geographically dispersed teams and within matrixed organizationsExperience combining software development integration and data engineering practicesExperience applying knowledge of system architecture networking and centralized logging using ELK to support data transformation initiatives
Interested in this role?