Generated banner for Azure AI
Generated logo for Azure AI

Azure AI

MicrosoftOfficialCreated by Microsoft

  • Skill
  • Tool integration
  • Cloud and DevOps
  • MIT
  • Low risk
  • Has scripts

From the author

Build and troubleshoot Azure AI Search, Speech, OpenAI, and Document Intelligence apps. WHEN: AI Search, query search, vector search, hybrid search, semantic search, speech-to-text, text-to-speech, transcribe, Speech SDK logs, session ID, result ID, OCR, convert text to speech.
— the description by Microsoft

AutoGineer summary

Written by AutoGineer from the skill’s own files, not by the author

This skill provides a centralized reference for integrating and debugging Microsoft Azure AI services. It covers AI Search, Speech, OpenAI, and Document Intelligence, offering guidance on MCP tool usage, CLI commands, and SDK patterns. It includes specific troubleshooting resources for Speech SDK diagnostics and best practices for secure authentication across development and production environments.

What it does

  • Provides MCP tool mappings for Azure AI Search and Speech services.
  • Offers quick-reference guides for various Azure AI SDKs across multiple languages.
  • Outlines best practices for secure authentication using managed identities.
  • Includes troubleshooting patterns for Speech SDK logs and diagnostics.
  • Summarizes capabilities for vector, hybrid, and semantic search.
  • Details patterns for document intelligence and content safety implementations.

When to use it

  • When integrating Azure AI Search, Speech, or OpenAI into an application.
  • When troubleshooting Speech SDK connectivity or transcription issues.
  • When setting up authentication for Azure services in production versus local environments.
  • When looking for language-specific SDK patterns for Azure AI services.
  • When needing to perform OCR or form extraction via Document Intelligence.

Advantages

  • Centralizes documentation for multiple Azure AI services.
  • Provides clear guidance on moving from local development to production security.
  • Includes actionable MCP tool commands for rapid integration.
  • Offers language-specific SDK snippets for quick implementation.
  • Simplifies complex troubleshooting tasks like Speech SDK log analysis.

Usage examples

“List the available search indexes in my Azure AI Search service.”
The agent uses the azure__search MCP tool with the search_index_list command to retrieve and display the indexes.
“How should I authenticate my Azure AI client in a production environment?”
The agent provides the recommended pattern using ManagedIdentityCredential instead of DefaultAzureCredential to ensure secure, deterministic authentication.
“Transcribe this audio file using Azure Speech.”
The agent utilizes the azure__speech tool with the speech_transcribe command to process the audio file.

Install

  1. Download the skill as a ZIP:

    https://mp-staging.autogineer.com/agent-skills/microsoft/azure-ai/download
  2. Unzip it into the cross-client skills folder of your project:

    mkdir -p .agents/skills && unzip azure-ai.zip -d .agents/skills

Documentation by Microsoft

Azure AI Services

Services

ServiceUse WhenMCP ToolsCLI
AI SearchFull-text, vector, hybrid searchazure__searchaz search
SpeechSpeech-to-text, text-to-speech, SDK logsazure__speech-
OpenAIGPT models, embeddings, DALL-E-az cognitiveservices
Document IntelligenceForm extraction, OCR--

MCP Server (Preferred)

When Azure MCP is enabled:

  • azure__search with command search_index_list - List search indexes

  • azure__search with command search_index_get - Get index details

  • azure__search with command search_query - Query search index

Speech
  • azure__speech with command speech_transcribe - Speech to text

  • azure__speech with command speech_synthesize - Text to speech

If Azure MCP is not enabled: In Copilot CLI or Claude Code, ask the user to run /mcp and enable Azure MCP; in other hosts, ask the user to enable Azure MCP through the host's MCP configuration.

AI Search Capabilities

FeatureDescription
Full-text searchLinguistic analysis, stemming
Vector searchSemantic similarity with embeddings
Hybrid searchCombined keyword + vector
AI enrichmentEntity extraction, OCR, sentiment

Speech Capabilities

FeatureDescription
Speech-to-textReal-time and batch transcription
Text-to-speechNeural voices, SSML support
Speaker diarizationIdentify who spoke when
Custom modelsDomain-specific vocabulary
Client SDK diagnosticsSpeech SDK client diagnostics for log collection, offline analysis, features, and session/result IDs (no MCP or login required)

SDK Quick References

For programmatic access to these services, see the condensed SDK guides:

Service Details

For deep documentation on specific services:

Files

references/speech/collection.md

Collect useful client evidence

Confirm SDK language/version and host first. Use the logging APIs by language and platform, or the matching tab in the official Speech SDK logging article, for exact APIs. Do not install or upgrade the SDK just to collect evidence.

Native SDK logging

Prefer the diagnostic logger APIs when the installed binding has them. Their availability differs by binding (see logging APIs), so check the installed version before falling back to the legacy property:

LoggerUse
FileLoggerA short, controlled reproduction to a local file
MemoryLoggerIntermittent failure; dump the bounded ring buffer promptly
EventLoggerIntegrate diagnostics into an existing logging pipeline

Loggers are process-wide; parallel objects interleave in one log. Capture before constructing the affected recognizer/synthesizer and stop after the reproduction. Keep the surrounding events; filters and fragments can remove correlation. Use a new path to avoid overwriting evidence. Stop a logger only if the application owns it; coordinate with existing process-wide logging.

Example for the reviewed C++ API, enclosing the existing reproduction:

#include <speechapi_cxx.h>
#include <speechapi_cxx_file_logger.h>

namespace logging = Microsoft::CognitiveServices::Speech::Diagnostics::Logging;
logging::FileLogger::Start("speech-sdk-diagnostic.log");
try
{
    // Run the existing reproduction here, including SDK object creation.
}
catch (...)
{
    logging::FileLogger::Stop();
    throw;
}
logging::FileLogger::Stop();

This is a fragment, not a standalone program. Use an accessible, nonexisting file in a restricted directory. Check whether other SDK objects are active. Do not translate these C++ method names to other languages or SDK versions.

JavaScript has a separate implementation/log format: JavaScript SDK. The bundled native-format analyzer does not certify JavaScript coverage. Preserve app-level events and follow the matching SDK documentation instead.

Record app events alongside the SDK log

Record UTC with timezone, SDK package/version, OS/runtime, input type, endpoint type, and the customer-observed failure. At the corresponding events record:

  • SessionStarted/SessionStopped: SessionId.

  • Recognizing/Recognized: ResultId and result reason, without recognized text.

  • Canceled: available SessionId/ResultId, reason, error code, and locally reviewed/redacted error details.

  • Synthesis: ResultId, reason and cancellation details when available.

API/event availability varies by binding. Use Speech samples and the installed SDK's API reference, not invented event fields. Correlate app and SDK observations by explicit IDs, not adjacency.

Do not confuse local diagnostics with service-side audio/content logging. Do not enable that feature, record microphone audio, or upload sample audio without explicit agreement about content, destination and retention.

Raw diagnostics may contain transcript, synthesis text/SSML, phrase lists, reference text, URLs, paths and credentials. Keep originals local and restricted. Do not request keys/tokens. Review even redacted output before external sharing; the analyzer is an allowlist summary, not a general-purpose log sanitizer.

Requirements and compatibility

Works with: Claude Code, Claude apps, OpenAI Codex, GitHub Copilot, Cursor, Gemini CLI, Kiro, OpenCode, Goose, Amp, Roo Code, JetBrains Junie, Factory Droid, Devin (ex-Windsurf), Mistral Vibe, OpenHands, Letta

“Works with” means the tool reads the open Agent Skills format; a skill written for one tool may use features others lack.

Needs: Needs an MCP server, Needs Node.js

Security

What our scanner noticed· Low risk

  • Instructions that use the network
  • Scripts that your agent may run

This skill includes scripts that your agent may run. Read them before you use it.

A static scan is not a guarantee. Skills are third-party content: review a skill before you let an agent use it.

Attribution and licence

Created by
Microsoft
Publisher
Microsoft (Official)
Source
microsoft/skills · .github/plugins/azure-skills/skills/azure-ai · commit 0696600
Licence
MIT License (redistribution allowed)
  • LICENSE (added by AutoGineer from .github/plugins/azure-skills/LICENSE)
  • ATTRIBUTION.md (written by AutoGineer)
Synced
Also distributed in
microsoft/azure-skills

AutoGineer is not affiliated with or endorsed by Microsoft.

Download ZIP

The ZIP holds the skill’s files, its licence files and an ATTRIBUTION.md. Download azure-ai.zip