Have Copilot read job descriptions and extract out key info you want to know. Click "Analyze All" to try it out. Click on the Copilot's gear icon to customize the prompt.

G

Lead Hadoop Admin-Foster City, CA, (Onsite from Day 1)

g9jdnwzjhnvto4vaplg752gwru3na902d0vak4s37zofm0lm6v3p80meq1rg0f08 · 30+ days ago

Foster City, CA, US

Negotiable

Full-time

Continue

By pressing the button above, you agree to our Terms and Privacy Policy, and agree to receive email job alerts. You can unsubscribe anytime.

Lead Hadoop Admin
Foster City, CA, (Onsite from Day 1)
Max Rate: DOE
Interview Process: 3 Rounds of Zoom Video Interview

USC & GC Preferred. No Third-party C2C available for this job

Job Description

Responsible for implementation and ongoing administration of Hadoop infrastructure.
Responsible for Cluster maintenance, trouble shooting, Monitoring and followed proper backup & Recovery strategies.
Provisioning and managing the life cycle of multiple clusters like EMR & EKS. Infrastructure monitoring, logging & alerting with Prometheus/Grafana/Splunk.
Performance tuning of Hadoop clusters and Hadoop workloads and capacity planning at application/queue level. Responsible for Memory management, Queue allocation, distribution experience in Hadoop/Cloud era environments.
Should be able to scale clusters in production and have experience with 18/5 or 24/5 production environments. Monitor Hadoop cluster connectivity and security, File system (HDFS) management and monitoring.
Investigates and analyzes new technical possibilities, tools, and techniques that reduce complexity, create a more efficient and productive delivery process, or create better technical solutions that increase business value. Involved in fixing issues, RCA, suggesting solutions for infrastructure/service components.
Responsible for meeting Service Level Agreement (SLA) targets, and collaboratively ensuring team targets are met.
Ensure all changes to the Production systems are planned and approved in accordance with the Change Management process.
Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.
Maintain central dashboards for all System, Data, Utilization, and availability metrics.

Required Skills:

8-12 years of Total experience with at least 5 years of work experience in developing, maintaining, optimization, issue resolution of Hadoop clusters, supporting Business users. Experience in Linux / Unix OS Services, Administration, Shell, awk scripting
Strong knowledge of anyone programming language Python/Scala/Java/R with Debugging skills.
Experience in Hadoop (Map Reduce, Hive, Pig, Spark, Kafka, HBase, HDFS, H-catalog, Zookeeper and Oozie/Airflow) Experience in Hadoop security (Kerberos, Knox, TLS). Hands-on Experience in SQL and No SQL Databases (HBASE) with performance optimization.
Experience in tool Integration, automation, configuration management in GIT, Jira platforms.
Excellent oral and written communication and presentation skills, analytical and problem-solving skills

•

Last updated on Aug 21, 2023

About the company

G

g9jdnwzjhnvto4vaplg752gwru3na902d0vak4s37zofm0lm6v3p80meq1rg0f08

More jobs at g9jdnwzjhnvto4vaplg752gwru3na902d0vak4s37zofm0lm6v3p80meq1rg0f08

Analyzing

Azure Full Stack Developer - Remote

·

30+ days ago

Technical Project Manager-Whitehouse station, NJ

Readington Township, New Jersey

·

30+ days ago

Core Teradata Developer -100% Remote

San Jose, California

·

30+ days ago

Senior Business Analyst - Greater Boston, MA$73k+

·

30+ days ago

Systems Security Engineer-Santa Barbara, CA

Santa Barbara, California

·

30+ days ago

More jobs like this

Analyzing

Solutions Engineer - Commercial/GOV

wallaroo

Remote

·

30+ days ago

SAP Business Analyst with Order Management

C

crjdnwsnowo2i4nz45b1teboszrxlg0351vr73gpqw7yanury9u287prckhdnkww

Eagan, Minnesota

·

30+ days ago

Network Control Specialist 1

9

9xjdnwf8nt489qdiu4ab0qq7clsnet01f27n6pjaxju02yq1u697ou3dvfougsq9

Melbourne, Florida

·

30+ days ago

IT Quality Assurance Summer Intern

PA

Power Auctions · Power grid optimization software

Washington, District of Columbia

·

30+ days ago

GIS Systems Analyst

B

b6jdnwcpcemgg8el3r9winlpunj8hc038b1vkhowrzxn9gitznreodi38t7rirkp

Tampa, Florida

·

30+ days ago

Freelance Marketer Using AI Expert

F

fud

Remote

·

30+ days ago

Senior Solutions Engineer (Remote, New York)$166-240k

G

grafanalabs

Remote, Oregon

·

30+ days ago

Web Application Scanning (WAS) Product Owner

6

6481

Burlington, Massachusetts

·

30+ days ago

Machine Learning Engineer -Large Language Model & Reinforcement Learning

H

hireio-inc

San Jose, California

·

30+ days ago

For job seekers

Job searchSearch millions of jobs

LaunchpadNew

Resume to business

Cover Letter StudioGenerate a cover letter

Add to ChatGPTFind and discuss jobs

For employers and recruiters

Resume ScreenerOrganize and rank candidates

Talent PipelinePre-order

Source top talent

Promote a jobReach more candidates

For everyone

Referral programEarn 30% commission

Get mobile appBrowse anywhere

Jobs API

Become a partner

Developed by Blake and Linh in the US and Vietnam.

We're interested in hearing what you like and don't like! Live chat with our founder or join our Discord

Changelog

🚀 LaunchpadNov 27

Create a site and sell services based on your resume.

🔥 Job search dashboardNov 13

Revamped job search UI with a sortable grid, live filtering, bookmarks, and application tracking.

🫡 Cover letter instructionsSep 27

New Studio settings give you control over AI output.

✨ Cover Letter StudioAug 9

Automatically generate cover letters for any job.

🎯 Suggested filtersAug 6

Copilot suggests additional filters above the results.

⚡️ Quick applicationsAug 2

Apply to jobs using info from your resume. Initial coverage of ~200k jobs in Spain, Germany, Austria, Switzerland, France, and the Netherlands.

🧠 Job AnalysisJul 12

Have Copilot read job descriptions and extract out key info you want to know. Click "Analyze All" to try it out. Click on the Copilot's gear icon to customize the prompt.