Implement Natural Language Processing Solutions¶
Overview¶
This domain covers text analysis, speech processing, language translation, language understanding, and question answering solutions. It represents 30-35% of the exam and is the largest domain, focusing on extracting meaning from text and speech.
Key Topics¶
Text Analysis with Azure AI Language¶
- Key phrase extraction from text
- Named entity extraction (people, places, organizations)
- Sentiment analysis and opinion mining
- Language detection
- Personally identifiable information (PII) detection
- Text summarization
- Text classification
Speech Processing with Azure AI Speech¶
- Text-to-speech (TTS) implementation
- Speech-to-text (STT) implementation
- Speech Synthesis Markup Language (SSML)
- Custom speech model implementation
- Intent recognition from speech
- Real-time speech translation
- Pronunciation assessment
Language Translation¶
- Text and document translation with Translator service
- Custom translation model implementation
- Speech-to-speech translation
- Speech-to-text translation
- Text-to-speech translation
- Document translation with formatting preservation
Language Understanding Model¶
- Intent creation and utterance examples
- Entity creation (prebuilt, learned, list)
- Model training, testing, and publishing
- Language Understanding model optimization
- Consuming Language model from client apps
- Model backup and recovery
- Batch testing
Question Answering Solution¶
- Knowledge base creation
- Source import to knowledge base (URLs, files)
- Knowledge base editing and curation
- Training and testing knowledge base
- Publishing knowledge base
- Multi-turn conversation implementation
- Alternate phrasing for questions
- Chit-chat personality addition
- Knowledge base export
- Multi-language question answering
Services Reference¶
Core Services¶
- Azure AI Language (formerly Text Analytics)
- Azure AI Speech
- Azure AI Translator
- Azure AI Language Understanding (LUIS)
- Azure AI Question Answering (QnA Maker)
- Azure AI Conversational Language Understanding (CLU)
Supporting Services¶
- Azure Bot Service
- Azure Functions
- Azure Storage (for training data)
- Application Insights (for monitoring)
- Azure OpenAI Service
Best Practices¶
Text Analysis¶
- Send text in appropriate language when possible
- Use batch operations for multiple documents
- Handle multiple languages in content
- Implement PII detection before storing sensitive data
- Monitor confidence scores and act on low scores
- Cache results for repeated analysis
Speech Services¶
- Choose appropriate audio quality for scenarios
- Use SSML for natural-sounding speech
- Implement custom models for domain terminology
- Handle background noise in speech recognition
- Use pronunciation assessment for language learning
- Optimize latency for real-time scenarios
Language Translation¶
- Detect language before translation when needed
- Use custom translators for domain-specific terminology
- Preserve formatting in document translation
- Handle untranslatable content appropriately
- Implement profanity filtering when needed
- Cache common translations
Language Understanding¶
- Provide diverse example utterances
- Use prebuilt entities when available
- Create composite entities for complex extraction
- Balance utterances across intents
- Implement active learning with suggestions
- Version models and test before production
Question Answering¶
- Structure knowledge base logically
- Include variations of questions
- Use multi-turn for guided conversations
- Regularly update based on user feedback
- Test with real user questions
- Implement fallback responses
Common Scenarios¶
Text Analysis Applications¶
- Customer feedback sentiment analysis
- Document classification and routing
- PII detection and redaction
- Key topic extraction from documents
- Multi-language content detection
- Contract entity extraction
Speech Applications¶
- Voice-enabled virtual assistants
- Meeting transcription services
- Voice commands for applications
- Accessibility features for visually impaired
- Language learning with pronunciation assessment
- Call center speech analytics
Translation Use Cases¶
- Multi-language customer support
- Real-time conversation translation
- Document localization
- Multi-language chatbots
- Subtitle generation for videos
- Email translation for global teams
Conversational AI¶
- Customer service chatbot
- FAQ automation bot
- Virtual assistant for scheduling
- Technical support bot
- Order tracking bot
- HR policy information bot
Language Understanding Integration¶
- Smart home voice control
- Calendar and email intent handling
- Restaurant booking from natural language
- Travel booking assistant
- IoT device command processing
Study Tips¶
- Practice using Language service for text analysis
- Understand sentiment analysis scores and interpretation
- Hands-on experience with Speech Studio
- Learn SSML tags for speech customization
- Practice creating and training LUIS apps
- Understand intent and entity design patterns
- Study question answering knowledge base creation
- Learn multi-turn conversation design
- Practice speech translation scenarios
- Understand when to use custom vs prebuilt models