Data Engineer ETL

This role will be part of a team focused on cloud transformation, modernizing analytics platforms and improving agility.
The role requires hands-on experience in building and managing analytics solutions in Snowflake, Provide direction on adoption of Cloud technologies (Snowflake) and industry best practices in the field of Data Engineering architecture and Development.

Primary duties and responsibilities:
Must Haves:- 5+ years of experience within data engineering- Python experience- Snowflake experience

Good understanding in Snowflake platform:
External tables, materialized views, stored procedures, tasks, row-based access policy and role-based access policy, time-travel, fail-safe, connectors, Micro-partitions & Data Clustering in snowflake, query pruning.
Establish Data Engineering architecture strategy, best practices, standards, and roadmapExperience developing ETL Pipeline using Python, Snowflake and IDMC.Experience with loading batch data and streaming data via KafkaBuild Data Flows mapping Source systems and Process flows.
Assemble large, complex data sets that meet non-functional and functional business requirements.
Perform code reviews and assist developers in optimization and troubleshooting.
Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, zero copy clone, time travel and understand how to use these features.
Knowledge in AWS and management technologies such as S3.
Strong written communication skills- Is effective and persuasive in both written and oral communication

Last updated on Nov 21, 2023