Data Engineer
DESCRIPTION
Seeking an experienced Data Engineer with a proven record of developing advanced data models and SQL Queries on complex, disparate systems, preferably in a Big Data warehouse environments like Snowflake. The candidate will be a member of a team developing and evolving an internal business intelligence reporting, building data model getting data from various source systems in to one single source infrastructure AKA Common Data Foundation (CDF). The data models/objects developed by this team will supply information to multiple applications and teams across the organization groups to consume data either in standard reporting or for ad-hoc data needs.
RESPONSIBILITIES
The specific responsibilities of the Data Engineer position include, but are not limited to, the development and deployment of data models and reports that provide business intelligence to engineering and operations groups.
Development of data models using Teradata/Snowflake that summarize complex data into usable, digestible datasets, dashboards, and reports.
Development of algorithms, routines, and jobs to extract, transform and normalize, and load the databases with operational data in preparation for reporting and analysis.
Develop, test, and implement scheduled and ad hoc reports that enable data driven decisions
Investigation, profiling, and resolution of performance bottlenecks attendant to usage of the databases, either when loading or extracting. This will likely involve interaction with key users to ensure that performance is suited to their particular needs.
Implementation of extracts and reports from the production databases, in support of repeated, periodic, automated requests, as well as ad-hoc requests as needed by key stakeholders.
Working with multiple data source owners to understand the process and align with CDF requirements
Basic documentation of data dictionary and process around data attributes and measures
REQUIRED SKILLS
Strong experience writing SQL on Teradata/Snowflake/SingleStore (MemSql)
Strong experience writing Stored Procedures/Performance Tuning
Experience reverse engineering tableau dashboards to get custom calculations and replicate the same in SQL queries
Skilled in advanced SQL performance tuning, particularly involving complex data model, capable of re-writing SQL to reduce execution time.
Build ETL pipelines using keystone/Airflow and Strong understanding of AWS/Big data architecture
Experience with Python ETL/Scripting is definitely a plus
Ability to document and communicate Project status, issues, and risks in a timely manner to team and senior management.
Minimum of 5 years developing SQL queries
Experience with Tableau to build dashboards for prototyping •
Last updated on Jul 19, 2022