Lead Data Engineer, Databricks

Company Overview:  

About us  

 We turn customer challenges into growth opportunities.  

Material is a global strategy partner to the world’s most recognizable brands and innovative companies. Our people around the globe thrive by helping organizations design and deliver rewarding customer experiences.  

We use deep human insights, design innovation and data to create experiences powered by modern technology. Our approaches speed engagement and growth for the companies we work with and transform relationships between businesses and the people they serve.  

Srijan, a Material company, is a renowned global digital engineering firm with a reputation for solving complex technology problems using their deep technology expertise and leveraging strategic partnerships with top-tier technology partners. Be a part of an Awesome Tribe  

As a Sr Data Engineer within the product team, you serve as a seasoned member of an agile team to design, build, and maintain scalable and efficient data pipelines leveraging Databricks platform, SQL, and Python. You will work closely with data scientists, software developers, analysts, and other stakeholders to ensure the delivery of high-quality data solutions that meet the needs of the business. You will report to the Principal/Lead Data Engineer.  

What We Look For  

• 6+ years’ experience with Big Data Technologies such as Apache Spark™, Cloud Native and Data Lakes, Databricks.  

• Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration and data management.  

• Implemented batch ingestion pipelines.  

• Strong Python skills - automate tasks, write unit test using frameworks like Nutter, Unittest, Pytest.  

• Experience with version control systems, such as Git and CI/CD process.  

• Strong knowledge of SQL, including complex queries and performance tuning  

• Familiarity with data modeling, data warehousing, and data integration concepts and best practices.  

• Documentation and white-boarding skills.  

• Strong problem-solving skills.  

• Proven ability to work with large cross functional teams with good communication skills.  

GOOD TO HAVE  

• Experience in retail domain – Aware about entities such as POS (Transaction), Products, Customer, Inventory.  

• Experience with Build-Operate-Transfer (BOT) model.  

• Familiarity with the Azure cloud platform.  

• Experience with data visualization tools, such as Power BI.  

• Experience with near real time data processing.  

• Experience on Cloud migration methodologies and processes.  

• Azure/AWS/Databricks Certified Data Engineer.  

Why work for Material?  

In addition to fulfilling, high-impact work, company culture and benefits are integral to determining if a job is a right fit for you.  

Here’s a bit about who we are and highlights of what we offer.  

Who We Are & What We Care About  

Material is a global company and we work with best-of-class brands worldwide. We also create and launch new brands and products, putting innovation and value creation at the center of our practice. Our clients are in the top of their class, across industry sectors from technology to retail, transportation, finance and healthcare.  

Material employees join a peer group of exceptionally talented colleagues across the company, the country, and even the world. We develop capabilities, craft and leading-edge market offerings across seven global practices including strategy and insights, design, data & analytics, technology and tracking. Our engagement management team makes it all hum for clients.   

We prize inclusion and interconnectedness. We amplify our impact through the people, perspectives, and expertise we engage in our work. Our commitment to deep human understanding combined with a science & systems approach uniquely equips us to bring a rich frame of reference to our work.  

A community focused on learning and making an impact. Material is an outcomes focused company. We create experiences that matter, create new value and make a difference in people's lives.  

What We Offer  

1. Competitive Salaries with flexi benefits  

2. Group Mediclaim Insurance and Personal Accidental Policy 

3. 40+ Paid Leaves in a year  

4. Learning and Development of quarterly budgets for certification