Principal Data Engineer - Python/SQL/Kafka

Description :

• Strong understanding of best practices and standards for GCP application design and implementation.
• Three Year of hands-on experience with GCP platform and experience with many of the following components :

a. GCS, Cloud Run, Cloud Functions b. Bigtable, Cloud SQL c. Kafka, Pub/Sub d. Python, Golang, Spark, Scala or Java e. BigQuery, Dataflow, Data Fusion f. GKE, CI/CD and Logging & Monitoring

• Understanding of Lambda Design Architectures and Real-Time Streaming
• Experience with Unstructured Data, Real-Time Streaming with GCP
• Ability to multitask and to balance competing priorities.
• Requires strong practical experience in agile application development, file systems management, and DevOps discipline and practice using short-cycle iterations to deliver continuous business value.
• Knowledge of all facets of GCP ecosystem development including ideation, design, implementation, tuning, and operational support.
• Ability to define and utilize best practice techniques and to impose order in a fast-changing environment. Must have strong critical thinking skills.
• Strong verbal, written, and interpersonal skills, including a desire to work within a highly matrixed, collaborative environment.
• A successful candidate may have :

a. Experience in Healthcare Domain b. Experience in Patient Data c. Experience with Natural Language Processing (NLP)

Hardware/Operating Systems :

• Linux, UNIX
• GCP
• Distributed, highly scalable processing environments.

Databases :

• NoSQL, Hbase, Cassandra, MongoDB, Cosmos, In-memory, Columnar, other emerging technologies
• Other Languages Java, Python, Scala, R
• Build Systems TFS, Github
• Ability to integrate tools outside of the core GCP ecosystem.

Certifications :

• GCP Cloud Professional Data Engineer
• GCP Cloud Professional Data Architect