Data Engineer

Data Engineer

Client: Dragos

Remote

Duration: 6-9 months

Bill Rate: $75/hr C2C

Open to USC & GC

Overview

We're seeking a motivated Senior Data Engineer to ensure the processing of third-party data into a usable and scalable format. In this role, the Senior Software Engineer will:

• Construct data pipelines using Python to meet business requirements.
• Perform ad-hoc analysis to troubleshoot stakeholder issues surrounding data and provide insights into feature usage.
• Develop parsers and workflows to integrate with data partners to expand our data capabilities.
• Document data architecture and integration efforts to provide a clear understanding of the data platform to other team members.
• Tune long running jobs to improve system throughput and create API's for delivering the data to end users.
• Design data schemas and structures to create data abstraction layers between systems.
• Help maintain, develop, and set up testing frameworks to aid in the robustification of existing systems.
• Aid in the creation of development environments to better aid in bringing younger developers onboard

Qualifications

• Software development experience in ELT/ETL, NLP or API development
• Recent professional development experience with the following languages and technologies:

o Python for natural language processing and API development o Non-relational databases (Redis or NoSQL)

o XML, JSON, CSV data formats

• Agile / scrum processes using Jira and Git
• Networking concepts such as VLAN, NAT, VPN and network device configuration
• Familiarity with the configuration of firewalls, routers, and switches from major networking manufacturers (e.g. Cisco, Palo Alto, Fortinet, etc.)