Skip to main content

Lead Data Engineer

Technology
Logicbroker
New York, United States2 months ago
Full timeFully remote

Job description

Job Summary

Logicbroker is hiring a Lead Data Engineer to drive delivery across our analytics and data platform. This is a hands-on technical lead role: you’ll lead a small team of full-time and contract engineers, own the hardest modeling and transformation work yourself, and turn engineering specifications into well-scoped, well-sequenced work. The models you build serve analytics today and increasingly feed AI-powered features in our product.

Why this Role

You’ll lead the build of a modern Databricks platform and shape the Gold-layer models the business and our AI features run on. The team combines full-time and contract engineers and is still taking shape, so you’ll help decide how it works, who joins it, and what it builds next. It’s a chance to grow your leadership scope alongside the team.

Work Authorization: Applicants must be legally authorized to work in the United States. Logicbroker is unable to provide employment visa sponsorship for this position, now or in the future.

What You'll Do:

Lead delivery

  • Turn engineering specifications into scoped tickets, sprint plans, and sequenced workstreams, and refine incomplete requirements with the Engineering Manager.
  • Assign work across full-time and contract engineers based on skill level and complexity.
  • Keep work unblocked and on track without unnecessary process, and surface risks, dependencies, and sequencing concerns early.
  • Review pull requests and hold a consistent quality bar across everything the team ships.
  • Communicate progress, blockers, and open questions clearly and proactively with stakeholders.
  • Set the team’s norms for AI-assisted development: what engineers verify, what needs closer review, and where AI tools help or add risk.
Build the data platform
  • Own the most complex transformation and modeling work yourself, implementing directly in Spark and Databricks.
  • Design and implement Medallion architecture transformations (Bronze → Silver → Gold).
  • Build Gold-layer data models that are performant and easy for BI and analytics tools to consume.
  • Modernize our data warehouse across multiple Databricks instances as part of a GDPR-first data strategy.
  • Improve the reliability, performance, and cost-efficiency of existing pipelines, from Spark job tuning to Databricks compute spend.
  • Make Gold-layer data well-documented and reliable enough for AI and agentic product features to use, not just dashboards.
What We Need:
  • 4+ years in data engineering, with strong hands-on experience in Spark (PySpark and Spark SQL). Databricks experience is preferred.
  • Proven experience implementing Medallion or a similar layered data architecture.
  • Strong data modeling skills, especially for analytics and reporting.
  • Experience leading delivery for a small engineering team. Formal management experience isn’t required.
  • AI fluency: AI-assisted development is part of your daily work, and you understand what AI features need from data.
  • Comfort working with partially defined requirements and refining them collaboratively.
  • Clear written and verbal communication with engineers and non-technical stakeholders.
Nice to Have:
  • Tuning Spark performance and managing Databricks compute costs at scale.
  • Supporting GDPR-compliant data strategies.
  • Multi-region or multi-tenant data platforms.
  • BI and analytics tools that consume warehouse data.
  • Data sources across Azure, AWS, GCP, and others.
Why Logicbroker:

Mission-Driven Culture: Be part of a company transforming digital commerce through innovation and agility—your work directly shapes how global brands connect with customers.

Collaborative, No-Ego Environment: We believe the best ideas win, not the loudest voices. You’ll work alongside teammates who challenge and support each other.

Flexibility with High-Performance Energy: Whether remote or in-office, we foster autonomy and accountability—because we trust you to own your success.

Leadership That Listens: Our executives are not just accessible—they’re invested in your growth, open to your ideas, and committed to building a company where people thrive.

Celebrated Wins, Shared Learnings: From team offsites to Slack shoutouts, we celebrate progress and learn from setbacks together

Interested in this role?