Browse
Employers / Recruiters
Negotiable
Full-time
Continue
By pressing the button above, you agree to our Terms and Privacy Policy, and agree to receive email job alerts. You can unsubscribe anytime.
Big Data Engineer
80 C2C
NYC, NY
6+ Months
Any VISA
F2F
 
Job Description
 
Our client is seeking a highly motivated Senior Software Engineer with Big Data to join a small, highly collaborative team and help create the next generation of data products for trading and investing.
 
Responsibilities:
 
• Develop production-grade data pipelines and ETL processes to support leading-edge analytics and big data processing.
• Curate massive amounts of data and make it accessible via state-of-the-art technologies.
• Review internal and external technological techniques, processes, and tools - to improve efficiency and better serve clients worldwide.
 
• Gather new product requirements from business stakeholders.
• Design new production workflows and architectures to support those products.
• Collaborate with Data Scientists and Software Developers to develop experiments and deploy solutions to production.
• Rapidly integrate new content sets (financial and non-financial) into big data ecosystem.
• Contribute ideas and constructive feedback to the tech and business teams.
• Stay current on technological trends.
• Take ownership of new projects and initiatives.
• Stay current on technological and analytical trends.
• Be passionate about data and big data tech.
• Maintain positive attitude.
• Motivate and coach other members of the team.
 
Example Projects:
Develop data ingestion and normalization framework that can collect and process data from hundreds of sources daily (and in real-time).
"Productionalize” the analytical processes developed by the Data Science team.
Productionalize – (verb) Performance tune models, automate data processing workflow, deploy in a highly-available and scalable way.
Develop analytical libraries and tools that allow the Data Science team to take full advantage of Data Platform.
 
Background:
 
We will consider candidates from a wide range of backgrounds, however, the many of the problems the candidate would be tasked with solving will require writing complex programs, designing systems, and analyzing data. Therefore, candidates with a computer science or engineering background are preferred.
 
Successful candidates will have:
• 5-8 Yeas professional experience in engineering or other technical role.
• Experience deploying applications in a production or mission-critical environment.
• Experience in financial services is a plus.
 
Education:
 
Bachelor's Degree from top tier university in Computer Science, Engineering, Physics, Mathematics, or similar quantitative discipline. Master's Degree a plus.
 
 
 
Skills Required:
 
• Good Programming Skills: Python, Java, Scala, R, SQL.
• Knowledge of cloud platforms and common architectures: AWS, Google.
• Strong Familiarity with Big Data technologies and architectures: Hadoop, Spark, Kafka, etc.
• Experience with containers and scalable computing platforms: Docker (ECS), Mesos, Kubernetes.
• Good verbal and written communication.
 
Preferred:
 
• Familiarity with Apache Spark: tuning and maintaining clusters, optimizing jobs, etc.
• Familiarity with analytical techniques and machine learning workflows.
• Familiarity with financial data sets and use cases.
• Strong familiarity with AWS.
• Knowledge of Lambda architectures.
• Requires conceptual and practical expertise in own discipline and basic knowledge of related disciplines.
• Is fully self-sufficient and competent in regards to output quality and quantity.
• Requires little or no supervision on a day to day basis.
• Has basic or good knowledge of best practices and how own area of expertise integrates with others.
• Understands key business drivers and is aware of the competition and the factors that differentiate them in the market.
• Provides informal guidance for colleagues with less experience.
• Is accountable for contributing with a competent standard and delivers every time.
• Plans and prioritizes work using resources in the best possible way to complete tasks on time and with high quality.
• Solves problems using existing solutions; exercises judgment based on the analysis of multiple sources of information.
• Is starting to look at 'best practice'.
• Provides creative insights and / or solutions to address client / organizational challenges.
• Impacts a range of activities within own team and other related teams; works within broad guidelines and policies.
• Works quickly and is able to assist other team members where appropriate. Works independently.
• Is able to explain difficult information; works to build consensus.
• Generates healthy debate within team, influencing team to look for a 'better approach'.
• Shares knowledge and expertise across organizational boundaries and endorses "best practices".
• Synthesizes information from various sources by breaking it down into relevant components and generating new data when needed; considers a broad range of issues when determining relevance of data.
• Integrates complex information and concepts and organizes analysis efforts into a systematic framework; verifies logic of others and challenges ideas, assumptions and conclusions.
• Evaluates current situation based on previous experience; identifies advanced implications/ conclusions from the logical analysis of a complex situation or issue; weighs options critically.
• Utilizes knowledge of the organization's business model and operations to drive projects and analyses that support the organization's mission.
• Applies extensive understanding of the policies, practices, trends and information that impact the organization and its customers to anticipate and plan for each step of a complex project.
• Demonstrates understanding of the financial impact of decisions/solutions to drive projects and analyses that support the organization's mission.
 
• Conducts a deep review of data and issues to quickly reveal the root cause of complex problems; anticipates and prepares for potential problems.
• Researches, recommends and reviews solutions to complex problems; guides the analysis of a problem all the way to a successful resolution.
• Develops interim and long-term solutions to complex problems to ensure successful project completion.
• Tests and maintains software applications and related programs and procedures creatively using a variety of software development tools following design requirements of customer.
• Ensures that system applications and tests are successfully completed and documented and all problems are resolved.
 

Last updated on Jan 19, 2017

See more

More jobs at ipjdnw7f5napvetweqr2ziz9mno8hm0423sbqrczl5q6rasimprbblk5rouuuujo

Analyzing

Stamford, Connecticut

 · 

30+ days ago

Dallas, Texas

 · 

30+ days ago

Atlanta, Georgia

 · 

30+ days ago

Hanover, New Jersey

 · 

30+ days ago

New Hartford, New York

 · 

30+ days ago

More jobs like this

Analyzing

New York, New York

 · 

30+ days ago

San Francisco, California

 · 

30+ days ago

Web Engineer
U
Upworthy ·  Viral content for social good

 · 

30+ days ago

Remote

 · 

30+ days ago

Remote

 · 

30+ days ago

Des Moines, Iowa

 · 

30+ days ago

South Jordan, Utah

 · 

30+ days ago

Tampa, Florida

 · 

30+ days ago

Web Site Designer
TT
The Talently ·  AI recruitment platform

California

 · 

30+ days ago

Apttus CPQ Developer
C
crjdnwsnowo2i4nz45b1teboszrxlg0351vr73gpqw7yanury9u287prckhdnkww

Minneapolis, Minnesota

 · 

30+ days ago

Developed by Blake and Linh in the US and Vietnam.
We're interested in hearing what you like and don't like! Live chat with our founder or join our Discord
Changelog
🚀 LaunchpadNov 27
Create a site and sell services based on your CV.
🔥 Job search dashboardNov 13
Revamped job search UI with a sortable grid, live filtering, bookmarks, and application tracking.
🫡 Cover letter instructionsSep 27
New Studio settings give you control over AI output.
✨ Cover Letter StudioAug 9
Automatically generate cover letters for any job.
🎯 Suggested filtersAug 6
Copilot suggests additional filters above the results.
⚡️ Quick applicationsAug 2
Apply to jobs using info from your CV. Initial coverage of ~200k jobs in Spain, Germany, Austria, Switzerland, France, and the Netherlands.
🧠 Job AnalysisJul 12
Have Copilot read job descriptions and extract out key info you want to know. Click "Analyze All" to try it out. Click on the Copilot's gear icon to customize the prompt.
© 2024 RemoteAmbitionAffiliate · Privacy · Terms · Sitemap · Status