Job Details (10+ years of experience Lead(3 years)):
Knowledge of Azure Data Factory is a must and good to have knowledge on other tools as well like SSIS , Talend etc.
Hands on experience in migration projects on Azure Cloud.
Should be able to evaluate and provide the best ETL tool as per data migration requirement
Hands on experience in migration project using Azure Data Factory from SQL Server,DB2 (LUW or Mainframe), Mainframe database( VSAM, Flat files , DB2) to Oracle ( If do not have experience in this , should have exp from any relational source to cloud database using ADF)
experience on validating Data migration
Experience in writing Python scripts and Azure DataBricks .
Hands on experience in data extraction ( Full data + Incremental data) strategies from source systems. Source systems like relational database SQL Server , DB2 , mainframe database VSAM files / flat files / Sequential files
Hands on experience in implementing bi-directional synchronization and what database configurations need to be done in the database to enable bi-directional sync
Documents all technical and system specifications documents for all ETL processes and perform unit tests on all processes and prepare required
programs and scripts.
Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities
Gather requirements and business process knowledge in order to transform the data in a way thats geared towards the needs of end users
Maintain and improve already existing processes
Ensure that the data architecture is scalable and maintainable
Work with the business in designing and delivering correct, high quality data
Investigate data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
•
Last updated on Feb 10, 2023