Browse
Employers / Recruiters
Negotiable
Full-time
Continue
By pressing the button above, you agree to our Terms and Privacy Policy, and agree to receive email job alerts. You can unsubscribe anytime.
Senior Data Engineer, Data Engineering
The Senior Data Engineer is the lead role in Data Engineering responsible for development platform of client's data management platform development. Reporting to the head of Data Engineering, this lead will manage a team of developers to build out the integration jobs using Spark and other Big Data/Hadoop framework. This role will be key to the rollout of client's Data platform and will partner with Data Analytics and other technology teams. Our environment is dynamic, fast-paced, and lots of fun.

Requirements / Responsibilities:
  • 8+ years of experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL and Data Warehouse methodologies and technologies.
  • 3+ years of experience in any combination of the following: SQL, Hadoop, Hive, Linux, APIs, Spark, Python, Scala
  • 2+ years of experience in implementing data warehousing solutions on AWS Cloud using services such as Redshift, S3, Lambda etc.
  • Experience in writing queries for moving data from HDFS to Hive and analyzing data
  • Understanding Partitions, Hive Query optimization, Bucketing etc.
  • Strong understanding of programming paradigms such as distributed architectures and multi-threaded program design
  • Should be very strong in algorithms, collection framework and build high performance engine to handle large amount of data
  • Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions
  • Design & build data pipeline using big data technologies
  • Leverage prototyping methodologies to propose and design creative business solutions that exploit our broad toolset of technologies (Python, Spark, Redshift, Hive, AWS services)
  • Educate and inform business partners on architecture, capabilities, best practices and solutions to build out future enhancements
  • Assist in analyzing business requirements, source systems, understand underlying data sources, transformation requirements, data mapping, data model and metadata for reporting solutions
  • Self-driven/self-initiator and resourceful to achieve goals independently as well as in teams and promotes an open flow of information so that all stakeholders are well informed.
  • Ability and desire to work within a cross-functional team environment with people from multiple business units, vendors, countries and cultures.
  • Ability to work independently under minimum supervision and proactive in solving issues
  • BS in Computer Science or similar technical degree

Last updated on Jul 11, 2018

See more

More jobs at ipjdnw7f5napvetweqr2ziz9mno8hm0423sbqrczl5q6rasimprbblk5rouuuujo

Analyzing

Stamford, Connecticut

 · 

30+ days ago

Dallas, Texas

 · 

30+ days ago

Atlanta, Georgia

 · 

30+ days ago

Hanover, New Jersey

 · 

30+ days ago

New Hartford, New York

 · 

30+ days ago

More jobs like this

Analyzing

New York, New York

 · 

30+ days ago

San Francisco, California

 · 

30+ days ago

Web Engineer
U
Upworthy ·  Viral content for social good

 · 

30+ days ago

Remote

 · 

30+ days ago

Remote

 · 

30+ days ago

Des Moines, Iowa

 · 

30+ days ago

South Jordan, Utah

 · 

30+ days ago

Tampa, Florida

 · 

30+ days ago

Web Site Designer
TT
The Talently ·  AI recruitment platform

California

 · 

30+ days ago

Apttus CPQ Developer
C
crjdnwsnowo2i4nz45b1teboszrxlg0351vr73gpqw7yanury9u287prckhdnkww

Minneapolis, Minnesota

 · 

30+ days ago

Developed by Blake and Linh in the US and Vietnam.
We're interested in hearing what you like and don't like! Live chat with our founder or join our Discord
Changelog
🚀 LaunchpadNov 27
Create a site and sell services based on your resume.
🔥 Job search dashboardNov 13
Revamped job search UI with a sortable grid, live filtering, bookmarks, and application tracking.
🫡 Cover letter instructionsSep 27
New Studio settings give you control over AI output.
✨ Cover Letter StudioAug 9
Automatically generate cover letters for any job.
🎯 Suggested filtersAug 6
Copilot suggests additional filters above the results.
⚡️ Quick applicationsAug 2
Apply to jobs using info from your resume. Initial coverage of ~200k jobs in Spain, Germany, Austria, Switzerland, France, and the Netherlands.
🧠 Job AnalysisJul 12
Have Copilot read job descriptions and extract out key info you want to know. Click "Analyze All" to try it out. Click on the Copilot's gear icon to customize the prompt.
© 2024 RemoteAmbitionAffiliate · Privacy · Terms · Sitemap · Status