Data Science Specialist

beBee Careers
20, May 2025
IA e Ciência de Dados
Tempo inteiro

Descrição do trabalho

Data Science Specialist

We are seeking a Data Science Specialist to play a crucial role in evaluating and assessing Generative AI systems. As a key member of our GenAI team, you will collaborate with product managers and engineers to define and measure metrics for user engagement and satisfaction.

  • Main Responsibilities:
  • Design and analyze metrics for user engagement and satisfaction;
  • Prepare data for analysis by cleansing, transforming, and performing quality checks;
  • Evaluate and test Generative AI performance using automated evaluation, adversarial testing, human-in-the-loop evaluations, and custom behavioral metrics;
  • Craft templates and instructions to measure system behavior, optimizing for challenging edge cases;
  • Develop monitoring systems to track LLM behavior in production, capturing key metrics around information retrieval and latency;
  • Analyze A/B tests to optimize chatbot interactions and user engagement;
  • Create interactive dashboards for real-time visualization of performance metrics and insights.
  • Main Requirements:
  • Bachelor's degree in Computer Science, Data Science, Machine Learning, Statistics, or a related field;
  • Proficiency in Python for data handling and analysis;
  • Advanced NoSQL and SQL skills for querying large datasets;
  • Strong problem-solving abilities, with a focus on experimental design and data analysis;
  • Ability to work collaboratively in a team environment and communicate effectively across different departments;
  • Excellent verbal and written communication skills, with the ability to explain complex technical concepts;
  • Fluent in English.
  • About this Role

This is an exciting opportunity to join our GenAI team as a Data Science Specialist. You will be working closely with our product managers and engineers to develop and evaluate Generative AI systems. If you have a passion for data analysis and machine learning, we would love to hear from you.

  • What We Offer:
  • A dynamic and collaborative work environment;
  • The opportunity to work on cutting-edge projects in Generative AI;
  • A competitive salary and benefits package.
Voltar para homepage