𝗪𝗘 𝗔𝗥𝗘 𝗛𝗜𝗥𝗜𝗡𝗚 | 𝗣𝗿𝗼𝗷𝗲𝗰𝘁 𝗕𝘂𝗺𝗯𝗹𝗲𝗲𝗕𝗲𝗲 (𝗖𝗼𝗱𝗶𝗻𝗴 𝗗𝗼𝗺𝗮𝗶𝗻) | 𝗨𝗦𝗔

  • Job Reference: 00021509-1
  • Date Posted: 20 September 2023
  • Company: Centific
  • Location: New York City, New York
  • Salary: $40.00 to $45.00 Per Hour
  • Bonus/Benefits: Flexible shift , Work from home
  • Sector: I.T. & Communications
  • Job Type: Permanent

Job Description





𝗪𝗲'𝗿𝗲 𝗹𝗼𝗼𝗸𝗶𝗻𝗴 𝗳𝗼𝗿 𝗗𝗼𝗺𝗮𝗶𝗻-𝗲𝘅𝗽𝗲𝗿𝘁 𝗚𝗿𝗮𝗱𝗲𝗿𝘀 𝘄𝗵𝗼 𝘄𝗶𝗹𝗹:


• Analyse a user request and identify the query intent. 

• Grade the AI-generated responses by answering a set of questions. 

• Compare the responses with each other and rank them. 

• Provide overall confidence in your rating. 



Analyse and grade some AI-generated responses with the purpose of training a chatbot to service its users well.  



• Native in English US: the working and grading language is EN, and the output is expected to be error-free. 

• Currently based in the US 

• This role requires analytical thinking, creativity, empathy, and a deep understanding of the domain and audience requirements. 

• Proven expertise – Academic background and working knowledge in one of the below coding types:

> Python

> C/C++

> JavaScript



> Java Coding



> Swift

• Focus on model improvement. 

• Can work at least 4 hours per day.


𝗢𝘁𝗵𝗲𝗿 𝗿𝗲𝗾𝘂𝗶𝗿𝗲𝗺𝗲𝗻𝘁𝘀:


𝗠𝘂𝘀𝘁 𝗰𝗼𝗺𝗽𝗹𝗲𝘁𝗲 𝗮𝗻𝗱 𝗽𝗮𝘀𝘀 𝗿𝗲𝗾𝘂𝗶𝗿𝗲𝗱 𝗖𝗲𝗿𝘁𝗶𝗳𝗶𝗰𝗮𝘁𝗶𝗼𝗻𝘀:

> Isaac_LLM_English_Audio_Comprehension

> Isaac_LLM_Test of English Language

> Bumblebee Guidelines Certification

> Bumblebee Coding knowledge certification 

> Final test on the client's platform


𝗧𝗵𝗲 𝗴𝗼𝗼𝗱 𝗻𝗲𝘄𝘀 𝗶𝘀 𝘁𝗵𝗮𝘁 𝗶𝗳 𝘆𝗼𝘂 𝗽𝗮𝘀𝘀 𝗮𝗹𝗹 𝘁𝗵𝗲 𝗰𝗲𝗿𝘁𝗶𝗳𝗶𝗰𝗮𝘁𝗶𝗼𝗻𝘀 𝗽𝗿𝗼𝘃𝗶𝗱𝗲𝗱 𝗯𝘆 𝘁𝗵𝗲 𝗰𝗹𝗶𝗲𝗻𝘁, 𝘆𝗼𝘂 𝘄𝗼𝘂𝗹𝗱 𝗯𝗲 𝗲𝗹𝗶𝗴𝗶𝗯𝗹𝗲 𝘁𝗼 𝗴𝗲𝘁 𝗮 𝗰𝗲𝗿𝘁𝗶𝗳𝗶𝗰𝗮𝘁𝗶𝗼𝗻 𝗯𝗼𝗻𝘂𝘀.


Simply go to our website, and do the following steps:


1. Create your OneForma Profile through this link:  https://my.oneforma.com/Account/login

2. Go to "Jobs" Tab

3. Click on "Judging and Grading"

4. Click the View More button on "𝗖𝗵𝗮𝘁𝗯𝗼𝘁 𝗥𝗲𝘀𝗽𝗼𝗻𝘀𝗲 𝗚𝗿𝗮𝗱𝗲𝗿 (𝗖𝗼𝗱𝗶𝗻𝗴 𝗗𝗼𝗺𝗮𝗶𝗻)"