Data Quality Assurance Evaluator:
Description:
We are looking for a Data Quality Assurance Evaluator to join our growing team. Our Safety AI Team is responsible for developing core technologies to keep children safe on Client’s devices and services. You will focus on performing in-house quality assurance of internal and outsourced projects. In this role, you will focus on defining and designing QA workflows tailored to the needs of the project while managing all facets of that project. QA may include the review of annotated/categorized data, segmentation (polygons or Photoshop-based matting), bounding boxes around zones of interest, and subjective reaction to visual, text and language related assets. Quality assurance in this context consists of evaluating work performed by internal or external partners and ranking it according to given scoring guidelines.
Responsibilities:
Checking quality of annotated/categorized data (including text). Providing feedback on observed trends in the dataset.
Recommending changes to improve efficiency
Comprehending the overall purpose of an annotation/categorization task based on guidelines and supporting examples
Define and continuously adjust QA methodology (example: types of errors, penalties, QA workflow)
Strong ability to define, design, develop and optimize utilized QA workflows through anticipating potential failure modes, analyzing edge cases, detecting anomalies, and verifying accurate trend and analysis of data.
Functionally responsible for overall QA effort
Identify and communicate observed error trends in the dataset to cross-functional partners
Ability to perform repeating tasks with consistency, quality, and speed
Basic Project management experience
Ability to recognize differences between visual assets
Required Experience and Skills:
Excellent English-language oral and written communications skills
Interest about technology that helps keep children safe
Excellent interpersonal skills and capacity to ask questions when guidelines are not clear enough
Flexibility and adaptability to thrive in a fast-paced, highly-demanding, constantly changing environment
Good critical thinking, with an eye for innovation and for continuous optimization (quality, cost efficiency)
Able to deliver multiple projects of varying lengths, while meeting quality standards and deadlines
Self-motivating with the ability to work independently and with little supervision
Highly organized with strong attention to detail
Ability to independently navigate systems and tools
Experience working with Mac and macOS 10.14 or higher for work
Preferred Experience and Skills:
You can write simple scripts to automate processes, e.g. Python, SQL, scripting languagesMinimum 2 years in a professional environment with much of that time in a data annotation/quality assurance rolePrevious experience working in the domain of child safety is a plus •
Last updated on Jun 27, 2022