Data Architect
Technology
東京都, 日本1ヶ月前
正社員
職務内容
Job Description
- Total of 10+ years of development/design/architecting experience with a minimum of 5 years’ experience in Big Data technologies on-prem and on cloud.
- Experience with architecting, building, implementing and managing Big Data platforms On Prem or On Cloud, covering ingestion (Batch and Real time), processing (Batch and Realtime), Polyglot Storage, Data Analytics and Data Access
- Good understanding of Data Governance, Data Security, Data Compliance, Data Quality, Meta Data Management, Master Data Management, Data Catalog
- Proven understanding and demonstrable implementation experience of big data platform technologies on cloud (AWS, Azure or GCP) including surrounding services like IAM, SSO, Cluster monitoring, Log Analytics etc.
- Experience working with Enterprise Data Warehouse technologies, Multi-Dimensional Data Modeling, Data Architectures or other work related to the construction of enterprise data assets.
- Strong Experience implementing ETL/ELT processes and building data pipelines including workflow management, job scheduling and monitoring.
- Experience building stream-processing systems, using solutions such as Apache Spark Streaming, Apache Kafka etc.
- Experience with Spark technology is a must.
- Good experience with any Cloud datastores such as Snowflake, AWS Redshift, Azure Synapse, Google BigQuery, etc.
- Experience with Big Data querying tools.
- Experience in other related technologies (such as Airflow, Nifi, Elastic Search, etc.) is a plus.
- Strong experience with data modeling and schema design
- Strong SQL programming background
- Excellent interpersonal and teamwork skills
- Experience to drive solution/enterprise level architecture, collaborate with other tech leads.
- Strong problem solving, troubleshooting and analysis skills.
- Experience working in a geographically distributed team.
- Experience with leading and mentoring other team members.
- Good knowledge of Agile Scrum
- Good communication skills
- Total of 10+ years of development/design/architecting experience with a minimum of 3
- years’ experience in Data technologies on-prem and on cloud.
- Experience with architecting, building, implementing and managing Data platforms On
- Prem or On Cloud, covering ingestion, processing, Polyglot Storage, Data Analytics and Data Access
- Good understanding of Data Lineage, Data Security, Data Compliance, Data Quality, Data Governance, Metadata Management, Master Data Management, Data Catalog capabilities
- Proven understanding and demonstrable implementation experience of big data
- platform technologies on Azure cloud including surrounding services like IAM, SSO,
- Cluster monitoring, Log Analytics etc.
- Experience working with Data Architectures related to the construction of enterprise data assets across database/data lake/data warehouse (e.g. PostgreSQL)
- Strong Experience implementing ETL/ELT processes and building data pipelines including workflow management, job scheduling and monitoring (e.g. using Talend)
- Must have demonstrated capability of Architecting scalable SAAS based platform.
- Should have experience in enterprise applications on cloud or on-premise environments.
- Should have experience in multi tenancy.
Desired Skills
- Excellent interpersonal and teamwork skills
- Experience to drive solution/enterprise-level architecture, collaborating with other leads.
- Strong problem-solving, troubleshooting and analysis skills.
- Good knowledge of Agile Scrum
- Good communications and presentation capabilities
- Good understanding of secure product development
- Create solution architecture documents on a good level with deep technical details.
- Work closely with Lead Solution Architect in identifying solution requirements and key case-studies/scenarios for the future solution.
- Maintain a strong understanding of industry trends and best practices.
- Bilingual with Japanese proficiency N2 must have.
Keywords
monthsOfExperience: 120Apache KafkaSCHEMAApache SparkRedshiftMetadataElasticsearchAirflowCluster analysisPostgresqlScrumSqlApache SynapseApache LicenseApache Http ServerBig dataData managementData clusterBigQueryAWS
この求人に興味がありますか?