Browse
Employers / Recruiters

Pyspark Azure Synapse Data Engineer - Bangalore/ Chennai/ Pune

capco · 30+ days ago
Negotiable
Full-time
Continue
By pressing the button above, you agree to our Terms and Privacy Policy, and agree to receive email job alerts. You can unsubscribe anytime.

Job Title: Data Engineer with Pyspark, Azure Synapse

About Us

“Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the  British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities across globe, we support 100+ clients across banking, financial and Energy sectors. We are recognized for our deep transformation execution and delivery. 

WHY JOIN CAPCO?

You will work on engaging projects with the largest international and local banks, insurance companies, payment service providers and other key players in the industry. The projects that will transform the financial services industry.

MAKE AN IMPACT

Innovative thinking, delivery excellence and thought leadership to help our clients transform their business. Together with our clients and industry partners, we deliver disruptive work that is changing energy and financial services.

#BEYOURSELFATWORK

Capco has a tolerant, open culture that values diversity, inclusivity, and creativity.

CAREER ADVANCEMENT

With no forced hierarchy at Capco, everyone has the opportunity to grow as we grow, taking their career into their own hands.

DIVERSITY & INCLUSION

We believe that diversity of people and perspective gives us a competitive advantage.

Location- Sarjapur, Bangalore/ Sholinganallur, Chennai - Hybrid/ Pune

Key Skills: Data Engineering, Pyspark, ADLS, Synapse, Hadoop, CI/CD

Technical Requirement:

Role: Data Engineer / Azure Data Engineer

Exp: 4+ Years

Responsibilities

  • Responsible for designing, building, and maintaining data pipelines and infrastructure on Microsoft Azure
  • Extract, transform, and load data from various sources including databases, APIs, and flat files.
  • Stay up to date with the latest advancements in Azure data technologies and best practices.
  • Propose suitable data migration sets to the relevant stakeholders.
  • Assist teams with processing the data migration sets as required.
  • Assist with the planning, tracking and coordination of the data migration team and with the migration run book and the scope for each customer.

Role Requirements

  • Strong Data Analysis experience in Financial Services
  • Knowledge of and experience using data models and data dictionaries in a Banking and Financial Markets context
  • Demonstrate a continual desire to implement “strategic” or “optimal” solutions and where possible, avoid workarounds or short-term tactical solutions.
  • Working with stakeholders to ensure that negative customer and business impacts are avoided.
  • Manage stakeholder expectations and ensure that robust communication and escalation mechanisms are in place across the project portfolio.
  • Good understanding of the control requirement surrounding data handling

Experience/Skillset

  • Proven experience working with Microsoft Azure Data Services, including Data Factory, Data Lake Storage, Synapse Analytics, and Azure SQL Database.
  • Strong knowledge of data warehousing, data modeling, and ETL/ELT principles.
  • Hands-on experience in Airflow, Elastic
  • Perform data cleansing, transformation, and integration tasks to ensure data quality and consistency.
  • Develop and maintain data models for data warehousing, data lakes, and other data storage solutions.
  • Proficiency in programming languages like Python, PySpark, Scala, or SQL.
  • Knowledge of and experience using data models and data dictionaries in a Banking and Financial Markets context
  • Knowledge of CI/CD processes for application software integration and deployment, including Maven, Git, and Jenkins
  • Implement and maintain security best practices for data storage and access.
  • Monitor and troubleshoot data pipelines and data quality issues.
  • Knowledge of COBOL copy book is preferable to migrate the COBOL copy book solution to Azure data solution.
  • Document and communicate technical solutions effectively.
  • Enthusiastic and energetic problem solver to join an ambitious team.
  • Business analysis skills, defining and understanding requirements.
  • Attention to detail.
  • Good knowledge of SDLC and formal Agile processes, a bias towards TDD and a willingness to test products as part of the delivery cycle.
  • Ability to communicate effectively in a multi-program environment across a range of stakeholders.
  • Strong verbal and written communication skills

If you are keen to join us, you will be part of an organization that values your contributions, recognizes your potential, and provides ample opportunities for growth. For more information, visit www.capco.com. Follow us on Twitter, Facebook, LinkedIn, and YouTube.

Last updated on Feb 15, 2024

See more

About the company

More jobs at capco

Analyzing

London, England

 · 

30+ days ago

São Paulo, State of São Paulo

 · 

30+ days ago

Bengaluru, Karnataka

 · 

30+ days ago

 · 

30+ days ago

More jobs like this

Analyzing
SAP Finance| Remote| Fulltime
T
two95-international-inc-3

Remote

 · 

30+ days ago

Hyperion Financial Management (HFM) B2_PAN INDIA
E
e5jdnwg7ia5nmpidkgm0x86zidegds023flk1ol79g88672m82f3rk6vbddcyss8

Gurugram, Haryana

 · 

30+ days ago

Program Analyst - L2
G
g6jdnw8nip4bx2tar9us2dx9tkot2005d9fqb82t4c87ph7vimwf7411au20toln

Bengaluru, Karnataka

 · 

30+ days ago

Technical Support Consultant II
T
tjjdnw3gpkwlpmq7qttmi8vox1rmzd09da8sjkc0z5wc5kgw7eewbu75l4yg3o0d

Noida, Uttar Pradesh

 · 

30+ days ago

SYBASE Database
rbjdnweld32246lzg3taqwi54kvozt05179osu5qfv6m4t6jrkzmy95rqih6j9f1

Bengaluru, Karnataka

 · 

30+ days ago

Manager - Big Data (AWS/Scripting (Java, Python)
Nielsen ·  Data analytics and measurement

Bengaluru, Karnataka

 · 

30+ days ago

Gurugram, Haryana

 · 

30+ days ago

Bengaluru, Karnataka

 · 

30+ days ago

Data Architect
L
lrn-corporation

Mumbai, Maharashtra

 · 

30+ days ago

Hyderabad, Telangana

 · 

30+ days ago

Developed by Blake and Linh in the US and Vietnam.
We're interested in hearing what you like and don't like! Live chat with our founder or join our Discord
Changelog
🚀 LaunchpadNov 27
Create a site and sell services based on your resume.
🔥 Job search dashboardNov 13
Revamped job search UI with a sortable grid, live filtering, bookmarks, and application tracking.
🫡 Cover letter instructionsSep 27
New Studio settings give you control over AI output.
✨ Cover Letter StudioAug 9
Automatically generate cover letters for any job.
🎯 Suggested filtersAug 6
Copilot suggests additional filters above the results.
⚡️ Quick applicationsAug 2
Apply to jobs using info from your resume. Initial coverage of ~200k jobs in Spain, Germany, Austria, Switzerland, France, and the Netherlands.
🧠 Job AnalysisJul 12
Have Copilot read job descriptions and extract out key info you want to know. Click "Analyze All" to try it out. Click on the Copilot's gear icon to customize the prompt.
© 2024 RemoteAmbitionAffiliate · Privacy · Terms · Sitemap · Status