In a Machine Learning work, Data Scientists and Data Engineers can adopt the following approaches to label their datasets.
Firstly, the task of labeling could be because of engineers and scientistsÂ
- have a dataset related to a domain but without any labels, or
- they need to enrich the dataset with additional labels
Possible approaches are:
- Public Knowledge bases
- like StackOverflow, Wikipedia, Github
- DevOps teams who know how systems are deployed, interacting, accessible. They do this by creating alerts on systems, observing systems logs and deploying business applications on various global environments
- Of course, subject matter experts (both functional and technical)
- Implicit / Explicit User Behavior
- Look at what the user is searching for i.e.
- explicit user interaction and
- implicit user interaction
- Think that every user thinks themselves as special, so find out what they are accessing and at what time
- Look at what the user is searching for i.e.
- Inter-User similarities
- Heuristics
- cQA sites
- the number of questions answered on social/community QA (cQA) sites
Example Labels:
Some of the example labels in typical log analytics using Machine Learning are:
- Connected Successfully
- Unable to Connect
- Connected
- Error
- Provider Connected
- Becoming an AI Consulting Architect: Ability To Inform When To Use Claude Sonnet and Opus
- Becoming an AI Consulting Architect: Value Calculation Techniques for an AI-enabled Disability Claims Chatbot
- Becoming an AI Consulting Architect: What Is “Value Proposition” & “Business Impact” Differences
- Scaling Intelligent eCommerce: Deploying ADK Agents to Google Cloud Run
- My Hands-On GitHub Copilot CLI Patterns I Use to Build Shopify Apps on Azure