We have 5 openings in Bengaluru and 1 opening in Pune.Position: Data Engineer - Databricks
Location : Bangalore
Salary: DOE
Position: 6+ Months Contract
Required Qualifications:
Bachelor's or Master's degree in Computer Science, Engineering, or related field
5+ years of experience in a Data Engineering role
Proficiency with Python programming for data manipulation and processing
Strong experience with Apache PySpark for big data processing
Demonstrated experience with Databricks and its integration with various data sources and sinks
Experience with AWS cloud services such as S3, EC2, EMR, RDS, Redshift, Lambda, and AWS Glue
Familiarity with data pipeline and workflow management tools
Proficiency with SQL and NoSQL databases, including PostgreSQL, Cassandra, and MongoDB
Understanding of stream-processing systems, such as Kafka or Kinesis
Experience with data modeling, ETL development, and data warehousing
Proficiency in building and optimizing 'big data' data pipelines, architectures, and data sets
Strong analytic skills related to working with unstructured datasets
A successful history of manipulating, processing, and extracting value from large disconnected datasets
Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores
Experience with big data tools: Hadoop, Spark, Kafka, etc.
Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.