Title: GCP Data Engineer Location: Dallas, TX / Remote Till CovidLong Term ContractLocal Preferred Number of Positions: 4 Job Description & Responsibilities: Top Skills:- As a Data engineer (successfully lead the delivery of projects including end-to-end requirements, data analysis, perform data engineeringactivities and work with the users for data validation.
- 5+ years of experience in Datawarehouse or Data Analytics
- 5+ years of Hands on experience in setting up Google Cloud Data Engineering
- 5+ years of Strong Hands on experience in any programming (Python, Spark)
- Professional Cloud Data Engineer Certification is a plus
Requisite Abilities and/or Skills- Perform requirement gathering with the business users and SME and build a plan
- Perform ETL and data engineering work by leveraging multiple google cloud components using Cloud Dataflow, Cloud Data Proc, Google BigQuery
- Knowledge on Data Modelling and reporting using Google Cloud BigQuery
- Knowledge on building data pipelines leveraging GCP best methodologies
- Strong understanding towards Kubernetes, docker containers and to deploy GCP services
- Experience in writing code to extract, transform data from multiple data sources including
- Experience in ETL tools like Informatica or any ETL tools
- Experience in scheduling like Airflow, Cloud Composer etc.
- Experience in CI/CD automation pipeline facilitating automated deployment and testing
- Excellent verbal and written communication, problem solving and interpersonal skills.
- Experience in data catalog and metadata management.
- Experience with JIRA or any other Project Management Tools
- Deliver end to end comprehensive documentation along with code samples
- Experience in one or multiple scripting languages / Cloud solutionsis a plus
Key Accountabilities and Priorities:- Build a and operationalize pipelines to include data acquisition, staging, integration of new data sources, cataloging, cleansing, batch and stream processing, transformation, and consumption
- Independently work on assigned projects and foster a collaborative environment for a high-performing team
- Gather Business requirements, Review business priorities, Analyze options & risks
- Quickly Understand and formulate application level requirements pertaining to complex workflows, or integration with external applications
Additional Information: - Bachelor's Degree. Masters is a plus.
- 8+ years' experience in Information Technology and/or in IT Professional Services.
•
Last updated on Jan 19, 2021