Principal Data Engineer

JOB INFORMATION
Job Title: Principal Data Engineer (100% Remote)
Role: Full time / Direct Placement

Need consultants with min 12+ years of experience

Responsibilities/What You'll Do:

• Architect, design, and build large-scale data operations at Zscaler with a focus on scalability, latency, efficiency, standardization, interoperability and fault-tolerance
• Work closely with senior leadership, business analysts, & engineering team to strategize and implement data initiatives
• Drive technical architecture to accelerate solutions designs. Comprehensive understanding of data integration models, master data management, enterprise data assets and products.
• Explore, learn, & recommend new tools & technologies that help the data platform to stay up to date and operate in an efficient way.
• Improve, and implement data engineering & analytics engineering best practices. Expert in CICD pipelines, able to mentor and guide others to adoption and use.
• Collaborate with Data Engineering, Analytic engineering & BI teams and perform complex data analysis to design physical data models and mappings from business requirements.
• Hands on in designing & developing key initiative data pipelines to integrate various applications using supported APIs & model the data in cloud data warehouse to support the reporting requirements.
• Perform code reviews, manage code performance improvements, and teach standards for code maintainability.
• Solve technical problems of the highest scope and complexity.
• Propose ideas to improve the scale, performance, and capabilities of the Data Platform

Qualifications/Your Background:

• 12+ years of experience in data warehouse design & development
• Proficiency in building data pipelines to integrate business applications (salesforce, Netsuite, Google Analytics etc) with Snowflake
• Extensive experience in generating architecture recommendations with the ability to implement them
• Strong hands-on experience in modern data stack tools like Matillion, DBT
• Completely proficient in advanced SQL, Python/Snowpark/PySpark/Scala (any Object Oriented language Concepts), Client libraries.
• Must have hands-on experience in Python to extract data from APIs, build data pipelines.
• Solid understanding of advanced snowflake concepts like Streams, tasks, warehouse optimizations, SQL tuning/pruning, snowpark
• Must have the knowledge of data visualization tools such as Tableau, and/or Power BI
• Familiarity with data mesh style architecture
• Experience in using data orchestration workflows using open-source tools Apache Airflow, Prefect is a plus

•

Last updated on Nov 15, 2023