Have Copilot read job descriptions and extract out key info you want to know. Click "Analyze All" to try it out. Click on the Copilot's gear icon to customize the prompt.

R

Director of Data Infrastructure Engineering

rapidai · 30+ days ago

Bangalore, India

Negotiable

Full-time

Continue

By pressing the button above, you agree to our Terms and Privacy Policy, and agree to receive email job alerts. You can unsubscribe anytime.

Key Responsibilities:

Design and implement scalable, reliable, and efficient data infrastructure solutions to support the organization's data processing, storage, and analytics needs.
Collaborate with data engineers, software engineers, and data scientists to understand data requirements and translate them into technical specifications and architecture designs.
Develop and maintain data pipelines for ingesting, processing, and transforming large volumes of data from various sources, ensuring data quality and integrity.
Optimize data storage and retrieval processes, including database schema design, indexing strategies, and query optimization, to enhance performance and reduce latency.
Implement monitoring, alerting, and logging mechanisms to proactively identify and troubleshoot issues in the data infrastructure, ensuring high availability and reliability.
Stay updated on emerging technologies, tools, and best practices in data engineering and infrastructure management, and recommend adoption as appropriate.
Provide technical leadership and mentorship to junior members of the team, fostering a culture of collaboration, learning, and continuous improvement.
Work closely with stakeholders to understand business requirements and priorities,

Qualifications:

Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
12-15 years of overall experience with atleast 5+ years in data engineering or infrastructure roles, with a focus on designing and building scalable data platforms.
Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks such as Apache Spark, Snowflake, Apache Flink, or Hadoop.
Strong understanding of distributed systems, cloud computing platforms (e.g., AWS, GCP, Azure), and containerization technologies (e.g., Docker, Kubernetes).
Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Cassandra, MongoDB).
Hands-on experience with data pipeline orchestration tools such as Apache Airflow, Luigi, or Prefect.
Excellent problem-solving skills and the ability to troubleshoot complex issues in a distributed environment.
Strong communication skills and the ability to collaborate effectively with cross-functional teams.
Experience with Agile methodologies and DevOps practices is a plus

•

Last updated on Jun 25, 2024

About the company

R

rapidai

More jobs at rapidai

Analyzing

Senior Software Engineer-Golang

Bengaluru, Karnataka

·

30+ days ago

Senior Software Automation Engineer

Bengaluru, Karnataka

·

30+ days ago

Solution Test and Automation Engineer

Bengaluru, Karnataka

·

30+ days ago

Staff Software Engineer DICOM

Bengaluru, Karnataka

·

30+ days ago

Staff Software Engineer Backend

Bengaluru, Karnataka

·

30+ days ago

For job seekers

Job searchSearch millions of jobs

LaunchpadNew

Resume to business

Cover Letter StudioGenerate a cover letter

Add to ChatGPTFind and discuss jobs

For employers and recruiters

Resume ScreenerOrganize and rank candidates

Talent PipelinePre-order

Source top talent

Promote a jobReach more candidates

For everyone

Referral programEarn 30% commission

Get mobile appBrowse anywhere

Jobs API

Become a partner

Developed by Blake and Linh in the US and Vietnam.

We're interested in hearing what you like and don't like! Live chat with our founder or join our Discord

Changelog

🚀 LaunchpadNov 27

Create a site and sell services based on your CV.

🔥 Job search dashboardNov 13

Revamped job search UI with a sortable grid, live filtering, bookmarks, and application tracking.

🫡 Cover letter instructionsSep 27

New Studio settings give you control over AI output.

✨ Cover Letter StudioAug 9

Automatically generate cover letters for any job.

🎯 Suggested filtersAug 6

Copilot suggests additional filters above the results.

⚡️ Quick applicationsAug 2

Apply to jobs using info from your CV. Initial coverage of ~200k jobs in Spain, Germany, Austria, Switzerland, France, and the Netherlands.

🧠 Job AnalysisJul 12

Have Copilot read job descriptions and extract out key info you want to know. Click "Analyze All" to try it out. Click on the Copilot's gear icon to customize the prompt.