Browse
Employers / Recruiters

Big Data Engineer (Scala)

ascendingdc · 21 days ago
Negotiable
Full-time
Remote
Apply

Location: Remote, Anywhere within the US

Key Responsibilities:

  • Design, build, and maintain scalable and high-performing data pipelines and architectures.
  • Implement complex big data projects with a focus on collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into insights using Spark and SQL.
  • Utilize AWS cloud services, primarily S3 and EMR, to build and maintain an efficient big data ecosystem.
  • Develop and optimize ETL processes to integrate data from various sources, ensuring data quality and accessibility.
  • Leverage coding skills in Scala to implement robust, scalable code that supports data processing and analytics applications.
  • Work within the Hadoop ecosystem, utilizing tools such as Hive and Presto for data querying and manipulation.
  • Collaborate with cross-functional teams to understand data needs and deliver solutions that meet business requirements.
  • Ensure best practices in data management and security are followed within the big data infrastructure.

Required Qualifications:

  • Minimum of 5 years of experience in big data engineering, with a proven track record of implementing large-scale data solutions.
  • Expert knowledge of Spark and SQL, with extensive experience in data processing and analytics.
  • Strong experience with AWS cloud services related to big data, including S3 and EMR.
  • Proficient in coding with Scala, with the ability to develop high-quality, maintainable code.
  • Solid understanding of the Hadoop ecosystem, including Hive and Presto.
  • Experience in designing and developing ETL pipelines to support data transformation, loading, and extraction.
  • Excellent problem-solving skills and the ability to work in a fast-paced environment.

Nice to Have:

  • Experience with Athena and Lambda for data querying and serverless computing.
  • Familiarity with other big data technologies and frameworks.
  • Strong communication skills and the ability to work as part of a team or independently.

Last updated on Feb 5, 2024

See more

About the company

More jobs at ascendingdc

Analyzing

Fairfax, Virginia

 · 

30+ days ago

Remote

 · 

30+ days ago

Rockville, Maryland

 · 

30+ days ago

Rockville, Maryland

 · 

30+ days ago

Rockville, Maryland

 · 

30+ days ago

More jobs like this

Analyzing
Network Control
3
3djdnw5yqdh8wl3frr5t6561tvvokq01affwpxt3lcutzo4f8yt1aeiy3msk02or

Melbourne, Florida

 · 

30+ days ago

Data Engineer (with NIKE exp.)
A
atjdnw2s7bs9ixn3syxicb6lo3i6p309225p0sn85jt6hn8a2nd1lz60q1ugarb5

Dearborn, Michigan

 · 

30+ days ago

Big Fix Engineer
C
crjdnwsnowo2i4nz45b1teboszrxlg0351vr73gpqw7yanury9u287prckhdnkww

New York, New York

 · 

30+ days ago

Chicago, Illinois

 · 

30+ days ago

Seattle, Washington

 · 

30+ days ago

DPOR - Data Warehouse/BI Developer - IN PERSON IVS ONLY!
B
b6jdnwcpcemgg8el3r9winlpunj8hc038b1vkhowrzxn9gitznreodi38t7rirkp

Richmond, Virginia

 · 

30+ days ago

Staff GIS Specialist
C
c4jdnwc7x3stjcj6zixxnwiepq2dyk03b8lddp27c7hr98p88sagx6olnglsveeo

Kansas City, Missouri

 · 

30+ days ago

SAS/ Mirth Developer
R
rsjdnwc9jel4i3xyjsm3m8vnhrmayk037bphn44zg3i1bl3dcjtqhqlclsisinpr

Cary, North Carolina

 · 

30+ days ago

SSIS Integration Engineer
D
d1jdnwvhbdgegwtuivnn7ap9pt7oxh03c5khec0dlwfqm0mxseydguueduceafch

Hoboken, New Jersey

 · 

30+ days ago

Developed by Blake and Linh in the US and Vietnam.
We're interested in hearing what you like and don't like! Live chat with our founder or join our Discord
Changelog
🚀 LaunchpadNov 27
Create a site and sell services based on your CV.
🔥 Job search dashboardNov 13
Revamped job search UI with a sortable grid, live filtering, bookmarks, and application tracking.
🫡 Cover letter instructionsSep 27
New Studio settings give you control over AI output.
✨ Cover Letter StudioAug 9
Automatically generate cover letters for any job.
🎯 Suggested filtersAug 6
Copilot suggests additional filters above the results.
⚡️ Quick applicationsAug 2
Apply to jobs using info from your CV. Initial coverage of ~200k jobs in Spain, Germany, Austria, Switzerland, France, and the Netherlands.
🧠 Job AnalysisJul 12
Have Copilot read job descriptions and extract out key info you want to know. Click "Analyze All" to try it out. Click on the Copilot's gear icon to customize the prompt.
© 2024 RemoteAmbitionAffiliate · Privacy · Terms · Sitemap · Status