Data Engineer

• Develop and maintain efficient data pipeline architecture.
• Construct intricate data sets that align with functional and non-functional business requirements.
• Identify, plan, and implement internal process enhancements, such as automation of manual processes, data delivery optimization, and infrastructure redesign for improved scalability.
• Establish the necessary infrastructure for efficient data extraction, transformation, and loading from diverse data sources using SQL and AWS 'big data' technologies.
• Design analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other crucial business performance metrics.
• Collaborate with stakeholders including Executives, Product Managers, Data and Design teams to address data-related technical challenges and fulfill data infrastructure needs.
• Maintain data security and separation across national boundaries, encompassing multiple data centers and AWS regions.
• Develop data tools for the analytics and data science teams, assisting them in optimizing our product's position as an innovative industry leader.
• Collaborate with data and analytics experts to enhance functionality within our data systems.
• Communicate with clients to elucidate task requirements.
• Conceptualize and create infrastructure to facilitate access and analysis of big data.
• Refine existing frameworks to enhance their functionality.
• Test and validate structures to ensure their suitability.
• Prepare raw data for manipulation by data scientists.
• Detect and rectify errors in work.
• Ensure that work remains backed up and accessible.
• Stay current with industry standards and technological advancements that enhance the quality of outputs.

Requirements

• Bachelor's degree in data engineering, big data analytics, computer engineering, or a related field.
• 5 years of proven experience as a data engineer, software developer, or in a similar role.
• Proficiency in Python, C++, Java, R, and SQL.
• Familiarity with Hadoop or equivalent technologies.
• Strong analytical and problem-solving skills.
• Ability to work independently and collaboratively.
• Detail-oriented and conscientious approach to tasks.
• Capacity to manage a pipeline of responsibilities with minimal supervision.

Last updated on Jun 26, 2024