Computational Linguist -Large Language Models Job at SGS Consulting, Remote

ZnhJK3pYT3J2d0psSGtlZEJhMURvK1BEclE9PQ==
  • SGS Consulting
  • Remote

Job Description

Job Responsibilities:

  • Aggregate cross-functional requests and translate requests into actionable, high quality, datasets via synthetic data collections and on live user traffic.
  • Deliver analytics, statistics, and model performance results on datasets.
  • Design and conduct experiments for evaluating rater quality, inter-rater reliability; write summary reports based on findings and speak on those findings in meetings.
  • Develop manual and automated processes for multiple concurrent projects ensuring high-quality labeled data.
  • Create and perfect LLM Quality grading queues and LLM related component quality error attribution grading queues.
  • Build datasets and write guidelines in rapid fashion for new and emergent LLM data rating, creation, and annotation needs.
  • Analyze system metrics such as factuality, brevity, coherence, as well as subcomponent performance, summarize findings, and communicate results.

Skills:

  • Basic Python, basic SQL with strong desire to grow required for this position. Intermediate level preferred.
  • Basic knowledge of linguistics (some of Phonetics, Syntax, Semantics, Dialectology) required.
  • Ability to analyze numerical rating results and draw conclusions based on data.
  • Basic stats / math for data analysis.
  • Written and oral communication skills necessary for communicating on project milestones and for reporting findings

Education/Experience:

  • Bachelor’s degree in Linguistics, Computational Linguistics, Speech Science, or related field OR graduate degree in linguistics OR industry similar experience required.
  • Master’s degree or beyond preferred OR equivalent industry experience.
  • Additional learning via Coursera, Udemy, or other online resources is great too.

Job Tags

Remote job

Similar Jobs

Three Brothers Concrete

Concrete Form Setter Job at Three Brothers Concrete

 ...Brothers Concrete, a well-established and trusted concrete contractor in Denver since 2003, is looking for an experienced Concrete Form Setter to join its growing team. This role is essential in preparing, setting, and finishing concrete forms for a wide range of... 

Daikin U.S. Corporation

HVAC Technician Helper Job at Daikin U.S. Corporation

 ...HVAC Technician HelperDaikin Applied is seeking a HVAC Technician Helper. In this role, you will be assisting in the diagnosing, repairing, and performing preventative maintenance for commercial and industrial HVAC equipment. The responsibilities will increase based on... 

Confidential

Assistant General Manager - Full-service restaurant Job at Confidential

 ...Privately-owned medical device manufacturer in east TN has immediate opening for a Sr. Engineering Manager who can lead a team of EE's and ME's in the development of high-tech electromechanical systems. The Sr. Engineering Manager will support the development, testing... 

Rinvio

Apprentice Electrician Job at Rinvio

 ...This apprentice electrician opening is suited to someone interested in pursuing the electrical trade. Applicants who meet the qualifications will receive further information about the project and work schedule. What you will do Project responsibilities will be... 

Saps America

Office Chair Assembly & Installation Job at Saps America

 ...on the lookout for a reliable and detail-oriented Office Chair Assembly & Installation professional to join our flexible team of...  ...product. If you are mechanically inclined, have experience with furniture assembly, and enjoy a role with variety and direct customer interaction...