Job Title: Computer Vision Quality Analyst UBRJP00028100
Location: New York 10007
Duration: 06 Months
Title:
About Us
We are revolutionizing the grocery shopping experience through innovative technology. We are currently developing a vision intelligence system to monitor grocery shelves using computer vision. To ensure the accuracy and effectiveness of this system, we are seeking a skilled Computer Vision Quality Analyst.
Job Summary
We are looking for a detail-oriented and technically savvy contractor to validate the results generated by our computer vision system, identify any discrepancies, and suggest improvements. The ideal candidate will have a strong understanding of computer vision, data analysis, and quality assurance. This role involves continuous monitoring of the system's performance, ensuring it meets defined thresholds, and contributing to the ongoing enhancement of the vision intelligence system.
Key Responsibilities
- Data Labeling & Training Set Creation
- Create high-quality labeled datasets for training and fine-tuning machine learning models
- Annotate grocery shelf images with precise product locations, boundaries, and classifications
- Follow detailed annotation guidelines to maintain consistency across datasets
- Identify and label edge cases that can improve model robustness
- Participate in calibration exercises to ensure labeling quality and consistency
- Data Validation and Quality Assurance
- Review and validate computer vision system outputs against actual shelf images to ensure accurate inventory detection
- Document and categorize system errors or misidentifications in a structured format
- Create detailed reports on system accuracy, common failure modes, and suggested improvements
- Collaborate with the engineering team to provide insights for model refinement
- Maintain detailed documentation of validation processes and findings
- Dashboard Monitoring & Analysis
- Continuously monitor dashboards to ensure the vision system is operating within defined thresholds and parameters.
- Alert the development team to any issues or anomalies detected during monitoring.
- Analyze performance metrics to identify trends and areas for improvements
- Use data insights to inform improvements to the system and enhance overall performance.
- Help develop and refine labeling guidelines based on common scenarios and edge cases
Requirements
- Experience working with image annotation and data labeling tools (e.g., LabelImg, RectLabel, Roboflow)
- Strong data analysis skills to interpret test results, identify trends, and validate the effectiveness of the computer vision system
- Ability to interpret performance metrics, identify trends, and draw actionable insights
- Proficiency in common office productivity tools (e.g., Google Suite, Microsoft Office)
- Excellent written and verbal communication skills
Preferred Qualifications
- Experience with computer vision systems or machine learning models
- Experience with task automation, scripting, and workflow management
- Familiarity with retail or grocery operations and knowledge of inventory management systems