Company Description
BETSOL is a cloud-first digital transformation and data management company offering products and IT services to enterprises in over 40 countries. BETSOL team holds several engineering patents, is recognized with industry awards, and BETSOL maintains a net promoter score that is 2x the industry average.
BETSOL’s open source backup and recovery product line, Zmanda (Zmanda.com), delivers up to 50% savings in total cost of ownership (TCO) and best-in-class performance.
BETSOL Global IT Services (BETSOL.com) builds and supports end-to-end enterprise solutions, reducing time-to-market for its customers.
BETSOL offices are set against the vibrant backdrops of Broomfield, Colorado and Bangalore, India.
We take pride in being an employee-centric organization, offering comprehensive health insurance, competitive salaries, 401K, volunteer programs, and scholarship opportunities. Office amenities include a fitness center, cafe, and recreational facilities.
Job Description
We are seeking experienced Python developers to join an exciting AI project supporting one of the world's top 15 companies. This role involves reviewing and validating AI-generated code to ensure quality, accuracy, and adherence to industry standards.
As a Python Code Reviewer, you will be responsible for auditing and validating AI-generated Python code evaluations. This critical role ensures that AI outputs meet high standards for functionality, clarity, and correctness while adhering to specific project guidelines.
Key Responsibilities
- Code Review & Validation: Evaluate AI-generated Python code snippets for accuracy, functionality, and adherence to prompt instructions
- Quality Assurance: Review annotator assessments and ensure all evaluations meet internal quality benchmarks
- Feedback & Documentation: Provide clear, actionable feedback on incorrect assessments and document technical issues
- Testing & Validation: Validate code functionality using proof-of-work methodologies and Docker-based sandbox environments
- Process Improvement: Identify patterns in evaluation errors and contribute to continuous quality enhancement
- Compliance: Ensure all reviews align with established project guidelines and frameworks
Qualifications
Required Qualifications
Technical Requirements
- 5-7+ years of hands-on Python development experience
- Deep Python expertise including syntax, testing strategies, debugging, and edge case handling
- Docker experience for containerized testing and isolated code validation environments
- QA background with structured workflows, annotation processes, or similar review pipelines
Professional Requirements
- Excellent written communication skills with ability to document and explain technical concepts clearly
- Professional English fluency (B2+ level or above)
- Independent work capability with strong attention to detail
- Immediate availability to start
Preferred Qualifications
- Experience with AI/ML model evaluation, reinforcement learning (RLHF), or large language model tuning
- Familiarity with annotation tools or data labeling platforms
- Knowledge of secure coding practices and environment replication
- Previous experience in code review or technical auditing roles
