Toolverse
All skills
DevOps

azure-ai-evaluation-py

by openclaw

Azure AI Evaluation SDK for Python. Use for evaluating generative AI applications with quality, safety, and custom evaluators.\nTriggers: \

Installation

Pick a client and clone the repository into its skills directory.

Installation

Quick info

Author
openclaw
Category
DevOps
Views
5
GitHub repo

About this skill

Azure AI Evaluation SDK for Python. Use for evaluating generative AI applications with quality, safety, and custom evaluators.\nTriggers: \

How to use

  1. Zainstaluj pakiet Azure AI Evaluation za pomocą pip install azure-ai-evaluation. Jeśli planujesz używać zdalnych ewaluacji, dodaj opcję [remote]: pip install azure-ai-evaluation[remote].
  2. Skonfiguruj zmienne środowiskowe dla Azure OpenAI: ustaw AZURE_OPENAI_ENDPOINT, AZURE_OPENAI_API_KEY i AZURE_OPENAI_DEPLOYMENT (np. gpt-4o-mini). Jeśli integrujesz się z Foundry, dodaj AIPROJECT_CONNECTION_STRING.
  3. Zaimportuj wybrany ewaluator z azure.ai.evaluation. Dla oceny jakości wspomaganej AI wybierz GroundednessEvaluator, RelevanceEvaluator, CoherenceEvaluator, FluencyEvaluator, SimilarityEvaluator lub RetrievalEvaluator. Dla metryk NLP użyj F1ScoreEvaluator, RougeScoreEvaluator, BleuScoreEvaluator lub innych.
  4. Utwórz konfigurację modelu zawierającą dane dostępu do Azure OpenAI (azure_endpoint, api_key, azure_deployment).
  5. Zainicjalizuj wybrany ewaluator, przekazując konfigurację modelu: groundedness = GroundednessEvaluator(model_config).
  6. Uruchom ewaluację na Twoich danych, przekazując odpowiednie dane wejściowe do metody ewaluatora, aby otrzymać metryki jakości i bezpieczeństwa aplikacji.

Related skills

drawio-diagrams-enhanced

by jgtolentino

Create professional draw.io (diagrams.net) diagrams in XML format (.drawio files) with integrated PMP/PMBOK methodologies, extensive visual asset libraries, and industry-standard professional templates. Use this skill when users ask to create flowcharts, swimlane diagrams,

DevOps
918943

lambda

by itsmostafa

AWS Lambda serverless functions for event-driven compute. Use when creating functions, configuring triggers, debugging invocations, optimizing cold starts, setting up event source mappings, or managing layers.

DevOps
127

unity-developer

by sickn33

Build Unity games with optimized C# scripts, efficient rendering, and proper asset management. Masters Unity 6 LTS, URP/HDRP pipelines, and cross-platform deployment. Handles gameplay systems, UI implementation, and platform optimization. Use PROACTIVELY for Unity performance

DevOps
66164

context7

by mikha08-rgb

Search GitHub issues, pull requests, and discussions across any repository. Activates when researching external dependencies (whisper.cpp, NAudio), looking for similar bugs, or finding implementation examples.

DevOps
51166

macos-cleaner

by daymade

Analyze and reclaim macOS disk space through intelligent cleanup recommendations. This skill should be used when users report disk space issues, need to clean up their Mac, or want to understand what's consuming storage. Focus on safe, interactive analysis with user confirmation

DevOps
1331

cloudflare-manager

by qdhenry

Comprehensive Cloudflare account management for deploying Workers, KV Storage, R2, Pages, DNS, and Routes. Use when deploying cloudflare services, managing worker containers, configuring KV/R2 storage, or setting up DNS/routing. Requires CLOUDFLARE_API_KEY in .env and Bun

DevOps
20122