Senior Bigdata Engineer
Request a quote with no obligation
● Supervised team to design, build and implement a comprehensive data analysis platform from scratch, featuring various layers such as data acquisition,storage,central analysis and presentation layers.
● Responsible for hiring fresh minds and provide mentorship, guidance and training on best practices, techniques, and technologies for big data engineering
● Act as a liaison between various teams including data engineering, data science, and business operations to guarantee that data products align with the general business objectives.
● Redesigned client’s Elasticsearch cluster and data indexing strategies such as denormalization,source filtering which resulted in massive search-time reduction from nearly 45 seconds for 3-layer nesting aggregation to about 8 seconds.
● Led team to work with IT and administration team of a insurance company to help them create various campaigns by analyzing their policyholder data to raise retention rate to approx 3.45% and multiple policy acquisition probability by nearly
66.38%
I have a strong background in mathematics, with a passion for using data to drive business insights and decision-making. With experience in data warehousing, ETL development, and data modeling, I have the skills and knowledge to design and build efficient and reliable data pipelines that can handle large and complex data sets. I have a track record of successfully implementing data solutions for a variety of industries, and am comfortable working with cross-functional teams to identify and prioritize data needs.
I am constantly seeking to improve my skills and stay up-to-date on the latest technologies and best practices in the field.
2.
Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
3.
Experience with data modelling, ETL (extract, transform, load) process design, and data warehousing.
4.
Experience with cloud computing platforms such as AWS or Azure.
7.
Experience with version control systems such as Git.
8.
Experience with data security and privacy best practices.
Completed Bachelor of science majoring in physics