Spark Developer

• Design & Development Enterprise scale ETL process for doing Data Ingestion, Transformation and Distribution integrating with multiple systems.
• Perform Business analysis along with BA/QA’s to ensure requirements documented, and implemented in Scala language.
• Collaborating with multiple technology teams that are upstream and downstream to the application such as Books & Records System, Pricing System, Data Warehouse
• Working in the Agile development methodologies, collaborating with business and technology teams located globally.

• Self-starter who is proficient in development with Process Development, Headless REST APIs, JAVA, JEE, Spring, Git and other Frameworks with experience in guiding Project teams with full life cycle of development/design and requirements gathering
• Significant programming experience in a structured software development environment
• Build strategic generic tech solutions that can be reused and leveraged across business areas
• Possess framework mindset, in terms of building components/libraries that can be easily ported/integrated/upgraded with minimal effort by various applications
• The candidate will interact with a diverse set of teams, including developers, business analysts, quality assurance, infrastructure, user communities, and senior management
• Must have experience with Java/J2EE with a deep understanding of the language and core API's, web services, multi-threaded/concurrent programming, JSON, design patterns, Service Oriented Architecture
• Must be able to demonstrate significant relevant work experience, or had experience of several major technology implementation projects
• Code, conduct code reviews, participate in design discussions and contribute to the architecture process
  • Must have 8+ Years of experience on Java and related frameworks
  • Must have 3+ Years of Hands-on experience with Spring framework including Spring Boot, Spring Security, Spring Batch
• 3-5 years of hands-on experience of Apache Spark, Hadoop, Hive, and related ecosystem.
• Working Experience on Autosys for scheduling jobs or any other similar scheduling platform.
• Excellent knowledge of Scala EE & Unit/Integration Testing Frameworks for Scala.
• Experience and very good understanding of Design Patterns.
• Good understanding of DevOps practices and tooling.
• Experience in understanding of requirements of large enterprise applications (security, entitlements etc.).
• Experience working in Agile development methodologies.

Last updated on Oct 19, 2023