Data Engineer
Stuur een vacature direct naar deze kandidaat
Skilled Data Engineer with about 15+ years of experience in IT field. With a deep understanding of Data & Big Data concepts & Azure Cloud and great experience of industry-standard on-premises tools, Strong team player, deep creative thinker, fast learner and motivated engineer, Proficient in utilizing a wide variety of programs and tools to provide high-quality and cost-effective solutions to boost organizational efficiency and productivity
Data Engineer | Supreme Audit Court Nov 2017 – Jan 2023
▪ Make Big Data Infrastructure from the scratch. (Docker, Kubernetes, YAML, Hadoop, Spark, Zookeeper, Zeppelin, Hive, Kafka, NIFI, Airflow)
▪ Use and leverage DMBOK and data policy for gathering bank account information and publishing our reports. (DBBOK)
▪ Create a database of bank accounts information for more than 3000 organizations with more than 30000 payable and receivable accounts
(SQL, PLSQL, MSSQL, Oracle)
▪ Receive some of account balance information in the form of streams and batch. (Kafka, Zeppelin, Pyspark, SQL, Oracle service bus)
▪ Clean and import needed Data in related databases and Datawarehouse (ETL, SSIS, Airflow, NIFI)
▪ Create a dashboard based on the information received from the balance of accounts and other data sources. (Power BI, DAX, MDX)
▪ Design a HTML generator based on the DOCX templates received from auditing department. We had more than thousands of report templates that auditors had to fill out according to their audited organizations in each province. Before that, everything had to be done manually, so by doing this automation, in addition to increasing the speed of creating reporting forms about 75%, it reduced the amount of labor cost required to do this by 60%. (SQL, C#, HTML)
▪ Design and write Needed protocols for gathering data and their related DDL command for creating static data from and store all definition in tables. (SQL, PLSQL)
▪ Create bank of quires and stored them in tables for compare received data and running them manually or automatically for creating alerts. The use of this method made auditors' activities more targeted and 8% increase in the detection of violations. (SQL, Tuning)
▪ By using different data science and analytical process, data scientists help businesses identify different Areas of violation and detect or predict related violations. (Scikit-learn, TensorFlow, NumPy, Pandas)
▪ Use ADF and Synapse Analytics for creating data pipeline to create Datawarehouse in 3 different environments (DEV, QA, Production)
▪ Build and maintenance our SQL databases on Azure cloud.
Database Administrator | Supreme Audit Court Dec 2015 - Jul 2017
▪ Install and maintenance of more than 10 Databases in operation, development and test Environment. (Oracle, PostgreSQL, MongoDB)
▪ Install some databases for Monitoring tools like SolarWinds, Zabbix, OCC 13c and etc. and Supportive programs like SharePoint, Jira ... (Oracle,
MSSQL, PostgreSQL)
▪ Install relational and non-relational Databases (MSSQL, Oracle, PostgreSQL MongoDB)
▪ Responsible to install, configure and maintenance our web servers (WebLogic, IIS, Jboss, Docker, Kubernetes)
▪ Design and managing backup policies and creating a disaster recovery site in another province. (Bash script)
▪ By Monitoring slow queries and optimizing resources, indexing and tuning queries we obtained same efficiency with less resource. (tuning)
BI Developer | Saman Salamat Pajouh Jan 2013 - Dec 2015
▪ Integrate Data and build our ETL for using information from drug distribution companies across the country based on ATC code. (MSSQL,
SSIS, SQL)
▪ Obtain the rate of exchange acceleration in the last twenty years in order to arrive at the real rate of value of imported goods with web crawling. (Python, Unit test)
▪ Build a data warehouse for drug usage and drug disposal for creating BI dashboard based on ATC drug coding. (Tableau · Qlikview, ARC GIS)
▪ The analyzed data showed on which cities we had drug smuggling as a result the distribution of drugs turned to be smarter in those area, in addition by estimating the future needs of drugs in each category we could reduce 4% drug disposal compared to previous year. (R
Computer Software Engineering (Azad University)
Sep 2007 - Feb 2011
Computer Software Engineering (Azad University)
Sep 2001 - Aug 2007
