Graphic Design Expert
About HumanSignal Real-world data is the competitive edge in AI. HumanSignal is a human data partner for companies building AI models and products. Our customers ship better AI, faster, because we partner with their researchers from real-world data creation to annotation to delivery. We design and create datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform, Label Studio, the open-source standard for data labeling and evaluation, used by over 1 million practitioners worldwide. We specialize in the operationally complex: real-world data collection, multimodal pipelines, and multi-step workflows. Advanced ML and AI teams use our enterprise platform to run their own data factories, and our services team to extend their reach where in-house capacity runs out. If you want to do work that materially shapes how the next generation of AI products gets built, we'd love to talk.Graphic Design Expert Location: RemoteType: Part-Time Contract (15+ hours per week for 2 weeks | 30 hour minimum commitment)Duration: 2 weeks with potential for ongoing workCompensation: Up to $20/hour for US based candidates About the Project You'll evaluate and rate graphic design elements on standardized quality scales to train AI models that assess design effectiveness—contributing to cutting-edge technology that advances how AI understands and evaluates visual content quality. What You'll Do Review and rate graphic design elements using our Label Studio Enterprise platform across multiple quality dimensions: Typography quality (readability, hierarchy, font pairing appropriateness) Visual hierarchy effectiveness (clarity, balance, focal point strength) Design element execution (icon quality, illustration polish, image selection) Color palette effectiveness (harmony, contrast, accessibility) Layout and composition quality (grid usage, spacing, alignment) Overall design effectiveness and professional polish Apply consistent 1-5 rating scales across hundreds of design examples Provide clear, objective assessments based on established design principles Follow detailed rating guidelines and rubrics to maintain consistency Process high volumes of design samples with sustained attention to detail Participate in weekly calibration sessions to align rating standards Meet quality benchmarks for rating consistency and inter-rater reliability Basic Qualifications Required Experience Formal training in graphic design, visual arts, or related field (degree, certificate, or bootcamp completion) OR 2-3 years of professional graphic design experience Strong proficiency in design principles (composition, color theory, typography, visual hierarchy) Ability to objectively critique and evaluate design work against industry standards Understanding of what constitutes effective vs. ineffective design choices Experience reviewing or providing design feedback Exceptional attention to detail and...