Browse
Employers / Recruiters
Negotiable
Full-time
Continue
By pressing the button above, you agree to our Terms and Privacy Policy, and agree to receive email job alerts. You can unsubscribe anytime.
Hybrid Position (80% Remote - 20% On-site Critical Meetings as needed) Location - Brooklyn, NY

The Senior Data Engineer will assist the Application Engineering team in building a robust, secure, and modern data pipelines to ingest, process, transform applications data using Informatica Intelligent Cloud Services or a comparable ETL/ELT tool employing modern data movement strategies and methodologies. The data needs to be store in an Azure Data Lake and eventually brought into a cloud-based data store such as Snowflake or a similar data store. Then, the Analytics reporting solution needs to be built either using cloud-based Google Looker or Microsoft Power BI or another similar tool.

The Senior Data Engineer will also build highly available, robust, concrete data pipelines and reporting solutions following industry best practices, adhering to internal security guidelines, modifying, and running automated CI/CD pipelines used for releasing code, and modifying and executing terraform modules for deploying infrastructure components, working collaboratively under the direction of the data engineering management and leads. The resource will be a person with integrity who is dependable and is fully focused on delivering optimal solutions with little to no maintenance and operations overhead.

RESPONSIBILITIES:
  • Be experienced in Data Engineering best practices, technologies, tools and processes.
  • Bring s ound knowledge of Data Warehouses and Lake House concepts and practical implementation experience.
  • Build a framework of repeatable solutions and playbooks enabling efficient and predictable data pipelines.
  • Have hands-on development experience in the implementation of an agile, cloud centric data warehousing and reporting platform with team members of various experience level.
  • Interact with clients, both technical and non-technical stakeholders.
  • Handle relationships with end users. Interact regularly to gather feedback, listen to their issues and concerns, and recommend solutions.
  • Meet critical deadlines and deliver in short sprints.
  • Ensure successful delivery of new reports and dashboards as needed.
  • Maintain and curate data documentation including Architectural Decision Records (ADR), how-to guides, data lineage and ownership using Azure DevOps or similar tool.
  • Maintain query performance and tuning to ensure cost optimization.
  • Participate in joint application development sessions with co-engineers and end users and be willing to brainstorm.
  • Complete technical documentation and be willing to transfer knowledge as needed.
REQUIRED SKILLS:
  • 12+ years developing Data Pipelines / Flows using ETL/ELT tools and technologies.
  • 10+ years of strong SQL fluency (query optimization, windowing functions, aggregation, etc.).
  • 5+ years building complex Analytics and Reporting solutions.
  • 3+ years' experience with a cloud data lake/warehouse solution (Snowflake, Redshift, GCP etc.).
  • Hands on experience working with data integration tools like Informatica Intelligent Cloud Services, Informatica Power Center or SSIS or a similar tool.
  • Extensive experience developing production grade, large scale data solutions.
  • Experience performing conceptual, logical, and physical data modeling using data modeling tools in complex, large-scale environments.
  • Experience working with Microsoft Azure cloud computing platform and services.
  • Experience managing data orchestration at scale using tools such as Airflow, Prefect and Dagster.
  • Experience with traditional RDMS platforms (Oracle and SQL Server).
  • Experience working with version control systems (e.g., Git)
  • Good understanding of CI/CD principles.
  • Experience developing dashboards and reports in applications such as Oracle Analytics Server (OAS), Microsoft Power BI and Google Looker.

DESIRABLE SKILLS/EXPERIENCE:
  • Experience using Azure services for Security, Blob Storage, Data Lake, Databricks, Data Factory etc.
  • Programming experience with Python or Java
  • Experience with Azure Monitoring services
  • Microsoft Certified Azure Solutions Architect Expert or a Snowpro Certification or a similar one

Last updated on May 9, 2023

See more

More jobs at amjdnw15p95g8ldf0geyr79slacvm809a1mxnh9g1melow00bl73oxnim8pgv0xx

Analyzing

New York

 · 

30+ days ago

New York, New York

 · 

30+ days ago

New York

 · 

30+ days ago

New York, New York

 · 

30+ days ago

New York, New York

 · 

30+ days ago

More jobs like this

Analyzing

Dallas, Texas

 · 

30+ days ago

Senior Cloud Database Architect
B
b6jdnwcpcemgg8el3r9winlpunj8hc038b1vkhowrzxn9gitznreodi38t7rirkp

Atlanta, Georgia

 · 

30+ days ago

Consulting Software Engineer (715669)
R
rsjdnwc9jel4i3xyjsm3m8vnhrmayk037bphn44zg3i1bl3dcjtqhqlclsisinpr

Cambridge, Massachusetts

 · 

30+ days ago

Database Architect
TT
The Talently ·  AI recruitment platform

San Jose, California

 · 

30+ days ago

Front End Developer
G
Grapevine ·  Influencer marketing platform for YouTube

Boston, Massachusetts

 · 

30+ days ago

Salesforce Developer
B
b8jdnwfetm91aeh4xxktytk2xff310011dbi7c94iwf3w4g8qka7cjkc4daepyd7

 · 

30+ days ago

Senior Software Engineer, Infrastructure Security$202-316k
Asana ·  Collaboration software for teams

San Francisco, California

 · 

30+ days ago

San Francisco, California

 · 

30+ days ago

JDA Developer
C
crjdnwsnowo2i4nz45b1teboszrxlg0351vr73gpqw7yanury9u287prckhdnkww

Alpharetta, Georgia

 · 

30+ days ago

Developed by Blake and Linh in the US and Vietnam.
We're interested in hearing what you like and don't like! Live chat with our founder or join our Discord
Changelog
🚀 LaunchpadNov 27
Create a site and sell services based on your resume.
🔥 Job search dashboardNov 13
Revamped job search UI with a sortable grid, live filtering, bookmarks, and application tracking.
🫡 Cover letter instructionsSep 27
New Studio settings give you control over AI output.
✨ Cover Letter StudioAug 9
Automatically generate cover letters for any job.
🎯 Suggested filtersAug 6
Copilot suggests additional filters above the results.
⚡️ Quick applicationsAug 2
Apply to jobs using info from your resume. Initial coverage of ~200k jobs in Spain, Germany, Austria, Switzerland, France, and the Netherlands.
🧠 Job AnalysisJul 12
Have Copilot read job descriptions and extract out key info you want to know. Click "Analyze All" to try it out. Click on the Copilot's gear icon to customize the prompt.
© 2024 RemoteAmbitionAffiliate · Privacy · Terms · Sitemap · Status