Role: Data engineer with Databricks, Python and Spark exp
Duration long term
Start ASAP
Ideal Location Pune India (Remote is okay)
3+ years of related experience with a Bachelor's degree; or equivalent work experience
Good SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Experience creating 'big data' data pipelines and data sets.
Experience with big data tools: Hadoop, Spark, Kafka, Spark & Kafka Streaming, Python, Talend etc for designing , creating and maintaining applications.
Work with/use various external APIs to enhance data
Experience with Azure cloud (or similar cloud like AWS)
Strong SQL skills with commensurate experience in a large database platform
Experience implementing ETL routines with 100M+ datasets in a performant and scalable manner
Setup database tables for analytics users to consume the data collected by the Data Engineering team
Work with big data technologies to improve data availability and data quality in the cloud (Azure or AWS)Experience with building data pipeline from various business applications like SAP, Salesforce, Marketo, Workday etc
Knowledge of Model and Design of DB schemas for read and write performance.
Knowledge with creation of API or Stream based data extraction processes like Salesforce API and Bulk API.
Prior experience supporting and working with cross-functional teams in a dynamic environment.
Knowledge of BI Tools like Tableau, Looker etc
•
Last updated on Nov 1, 2023