We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with specific experience using Informatica Intelligent Cloud Services (IICS) and developing machine learning models using Python. This role involves designing, building, and managing our data infrastructure and pipelines, ensuring the efficient handling of data from various sources, and supporting our analytics and machine learning initiatives.
Data Pipeline Development and Management:
- Design, construct, install, test, and maintain highly scalable data management systems.
- Develop and manage data pipelines using Informatica Intelligent Cloud Services (IICS), ensuring seamless data integration and transformation across various platforms and systems.
- Implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes.
Machine Learning Model Development:
- Utilize Python to develop and implement machine learning models, integrating them into data pipelines to automate and improve business processes.
- Collaborate with data scientists and analysts to understand business requirements and translate them into technical specifications for model development.
- Perform data preprocessing, cleaning, and wrangling to prepare data for use in analytics and machine learning applications.
Data Architecture and Strategy:
- Contribute to the design and implementation of an effective data architecture that supports the organization's goals.
- Work closely with IT and business teams to identify and execute on opportunities to leverage data for business insights and decisions.
- Stay abreast of industry trends and advancements in data engineering and machine learning technologies, and recommend ways to improve our capabilities.
Collaboration and Communication:
- Collaborate with data analysts, scientists, and business teams to understand data needs and deliver solutions that meet these needs.
- Clearly communicate complex technical concepts to non-technical stakeholders to facilitate informed decision-making.
- Document data engineering processes, systems, and their outcomes for future reference and compliance.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- Proven experience as a Data Engineer, with specific experience in Informatica Intelligent Cloud Services (IICS) and Python for machine learning.
- Strong expertise in SQL and experience with relational databases, as well as familiarity with NoSQL databases.
- Solid understanding of data structures, algorithms, and system design.
- Experience with cloud services (AWS, Azure, Google Cloud) is highly desirable.
- Excellent problem-solving skills and the ability to work independently or as part of a team.
- Strong communication skills, with the ability to explain technical concepts to non-technical stakeholders.
•
Last updated on Jul 1, 2024