Technical Architect-Analytics

Primary Skills: Azure Databricks/ Fabric Strong SQL, ETL processes Azure Data Lake, Azure Synapse, Azure Data Factory

Experience Range: 12+ years

Location: Japan

Language: Bilingual (Japanese and English)

We’re looking for a highly skilled professional with 8+ years of experience in building advanced analytics solutions using Azure Databricks, Microsoft Fabric, and other Azure services. The ideal candidate will have strong technical expertise in big data, data engineering, and cloud computing, along with excellent leadership and communication skills.

Responsibilities

Lead the architecture, design, and implementation of analytics solutions using Azure Databricks and Microsoft Fabric.

Work closely with business and IT stakeholders to understand requirements and deliver effective solutions.

Manage end-to-end implementation of data solutions aligned with business needs and best practices.

Develop data pipelines and ETL processes using Azure Databricks, PySpark, and related tools.

Integrate Databricks with Azure services like Data Lake, Synapse, and Data Factory, as well as on-prem systems.

Provide technical leadership and mentorship to the data engineering team.

Ensure proper documentation and compliance with security and governance standards.

Promote best practices in code quality, data security, and scalability.

Stay updated with the latest developments in Databricks and related technologies.

Essential Skills

Strong hands-on experience with Azure Databricks (cluster management, notebooks, Delta Lake).

Proficiency in big data technologies like Hadoop and Spark, especially PySpark.

Deep knowledge of Azure services: Data Lake, Synapse, Data Factory.

Experience with ETL/ELT, data warehousing, and building data lakes.

Strong SQL skills and familiarity with NoSQL databases.

Experience with CI/CD pipelines and Git.

Understanding of cloud security best practices.

Soft Skills

Excellent communication and stakeholder management.

Strong problem-solving and proactive issue resolution.

Leadership and mentoring capabilities.

Nice to Have

Experience with Power BI for reporting and dashboarding.

Familiarity with Microsoft Fabric for analytics and integration.

Knowledge of Spark Streaming for real-time data processing.

Experience with Azure Resource Manager (ARM) templates for IaC.

Experience Highlights

8+ years of experience in data ingestion and transformation using Databricks/Synapse notebooks and Azure Data Factory.

Hands-on with Delta Lake, Delta tables, and ADLS Gen2.

Experience using Auto Loader and Delta Live Tables.

Skilled in Databricks SQL for query optimization.

Integrated Databricks with Synapse, ADLS Gen2, and Power BI.

Experience developing and deploying Power BI reports.

Familiarity with modern CI/CD practices in cloud-native environments.