Data Engineer

Who You Are: A Big Data Engineer is responsible for designing, building, and maintaining the infrastructure that is used to store and process large amounts of data. They have to work with teams of data scientists, analysts, product,Support Engineers and other teams to ensure that the data is easily accessible in a reliable and scalable way. If needed jump on production issues and resolve ASAP. This person should have a strong background in computer science and experience with big data technologies & AWS Services, such as Apache Spark, Athena, S3. You will be an integral part of the development team examining requirements and designing optimal solutions.

What You Will Do: Designing and implementing data pipelines to collect, process, and store large amounts of data from various sources.

Building and maintaining scalable, high-performance data storage systems, such as distributed databases and data warehouses. Developing algorithms and data models to clean, transform, and analyze data, and creating visualizations and reports to communicate findings.

Collaborating with data scientists and analysts to support their data needs and help them develop and test their models. Troubleshooting and optimizing the data infrastructure to improve performance and reliability. 

To be successful in this role, a Big Data Engineer should have a strong understanding of computer science principles, such as algorithms, data structures, and software design. They should also be familiar with big data technologies and have experience working with large datasets. Good communication skills and the ability to work well in a team are also important.

• You are a 5-8 Years experienced professional having in-depth knowledge of  SQL, Scala, Spark, AWS EMR, AWS Athena, AWS S3, AWS Glue and PHP (all skills are required).
• Knowledge of scripting languages including Python, Java, C++, Linux are add ons.
• In-depth Knowledge of NoSQL and RDBMS databases.
• Familiarity with Airflow and Docker tools.
• Understanding of Data Lake, Data warehouse, ETL concepts.
• Ability to solve complex performance, scalability and data consistency issues.
• The role requires candidates to be self-driven and flexible in exploring and working on new technologies and solutions.

Nice to Have: 

• Great learning attitude
• Eagerness to take ownership
• A global mindset
• Good communication skills.

Why Frequence?

Frequence is proud to be certified as a  Great Place to Work, and ranked as one of the USA's fastest-growing private companies by Inc. Magazine. 

Our people-first culture and distinctive mission set us apart from others in the industry. As our company grows, so does our need to add sharp, ambitious, and talented people to our team. We're approachable, and inclusive, and encourage open dialogue within our community. This is a place where your voice matters. Join us and let's see what we can build together.

Some of the industry-leading benefits we offer include:

• Competitive salary 
• Group Health Insurance Policy
• Group Accident/Disability Insurance 
• Hybrid Work Options
• Employee Referral Program
• Food and Beverages
• Stock options

•

Last updated on Dec 20, 2023