Zur Navigation springen

Fast LLM service tier

ElevenAgents can now run supported LLMs on a fast service tier, which trades a per-token price premium for higher token throughput and lower latency. Set service_tier to fast in the agent’s prompt configuration with Update agent, and check which tiers a model supports in the available_service_tiers field returned by List LLMs. The default remains standard, and the LLM usage calculator accepts service_tier to estimate the cost difference.

Knowledge base crawl exclusions

ElevenAgents knowledge base website crawls can now skip parts of a site. Pass up to 50 exclude_patterns to Create crawl job, or fill in the Exclude patterns field in the whole-website crawl dialog, and URLs that match any pattern are skipped even when they match the crawl pattern. Crawl job responses return the patterns that were used. See Knowledge base for crawl setup.

Clone strength for v4 voices

Text to Speech and Text to Dialogue requests now accept clone_strength, a value from 0 to 1 that controls how closely a Professional Voice Clone fine-tuned for a v4 model follows its training samples. Set it in voice_settings on Create speech or in settings on Create dialogue. The recommended value for most use cases is 0. On the Text to Dialogue endpoints, clone_strength now decides whether a v4 PVC runs as a PVC or an IVC, and use_pvc_as_ivc is deprecated.

Expiring service account API keys

Workspaces service account API keys can now expire. Pass expires_at_unix when you create or update a key, or pick an Expire after value in the dashboard, and the key stops working after that time. Expiries must be between 15 minutes and 90 days in the future; omit the field for a key that never expires. See Service accounts.

All changes

  • Fast LLM service tier: Agents and workflow overrides accept service_tier (standard or fast) on supported models. List LLMs returns available_service_tiers for each model, and the LLM usage calculator accepts service_tier.
  • Knowledge base crawl exclusions: Create crawl job accepts exclude_patterns, and the whole-website crawl dialog adds an Exclude patterns field. Matching URLs are skipped.
  • Procedures analytics: The Procedures tab on the agent analytics dashboard is available to every workspace. Its Procedure invocations chart shows how often each procedure runs over time, grouped by procedure or by agent, and its tooltip shows whether a procedure is structured or free-form.
  • Start procedures at conversation start: Conversation initiation client data accepts start_procedure_ids, up to five free-form procedures that start when the conversation starts. The agent must have enable_procedure_ids_from_client enabled; structured procedures and unknown IDs fail the conversation start.
  • Structured procedure steps: Structured procedures can use the end_procedure system tool as a step, and the End step is relabeled End conversation. Sub-procedure and end steps now compile to system tool nodes, so agents start and end the intended procedure more reliably.
  • Channel integrations out of alpha: The Slack, Telegram, Custom Channel and Intercom integrations are no longer in alpha. Freshdesk remains in alpha.
  • Slack thread replies: The Slack Channel Message trigger adds a Respond to setting (response_mode), so an agent can keep replying in a thread after a single mention. Mentioning the agent with only stop, mute or quiet silences it in that thread until it is mentioned again, and events that Slack delivers twice get one reply.
  • Test run names: Run tests accepts an optional name, which test invocations and their summaries return. PATCH /v1/convai/test-invocations/{test_invocation_id} renames a run, and setting name to null restores the generated title.
  • Branch descriptions: Branch descriptions can be edited from the branches table with Update branch (description, up to 4,096 characters) and appear in the version tooltip and version graph.
  • Agent duplication keeps traffic splits: Duplicating an agent copies its live traffic split across the copied branches. The resulting deployment records duplicate as its deployment source.
  • Delete environment variables: DELETE /v1/convai/environment-variables/{env_var_id} deletes an environment variable.
  • Widget fullscreen on mobile: Widget configuration adds mobile_fullscreen (default true), with a Fullscreen on mobile switch in the dashboard. Set it to false to keep the compact layout on phones. See Widget.
  • Issues: Triage is renamed Issues in the agents dashboard, and triage tickets are now called issues. Every QA comment and flag_issue_for_review call opens its own issue, and an issue can be reopened while the conversation has another open issue. The API endpoints keep their triage-tickets paths. See Triage.
  • Prompt caching guidance: The system prompt editor flags system variables that change on every turn and prevent prompt caching, and Spotlight adds an Improve prompt caching recommendation for affected agents.
  • Realtime voice mode: Switching an agent to Realtime voice mode in the dashboard now selects Eleven Realtime v1 Max. Realtime agents always run tool calls in parallel, so the Parallel tool calling toggle is removed from Realtime model settings. See Realtime models.
  • Analytics: Workflow analytics can be filtered by channel, and the Guardrails tab is shown to all users.
  • Analysis LLMs: claude-sonnet-5-5 can be selected as the analysis LLM for evaluation criteria and data collection, both for the agent and per item. Agents on Claude Sonnet 5.5 can also set reasoning effort to none.
  • Conversation cost: Conversation charging adds voice_surcharge_charge, the credits charged as the voice actor reward for the Voice Library voices a conversation used. It is not included in cost.
  • Call duration and billing: Call charges and stored call duration stop when the call ends, so teardown time after the call is no longer billed or counted. Calls no longer continue for up to 50 seconds after ending when a knowledge base lookup is in progress.
  • Telephony: SIP trunk calls forward the User-To-User (UUI) header to the conversation initiation webhook. API keys with an IP allowlist now authenticate on the Genesys, Avaya, AudioCodes and Amazon Connect connector WebSockets. Batch call recipients whose call cannot be placed are marked failed instead of staying dispatched.
  • Observability: OpenTelemetry post-call webhook agent turn spans add elevenlabs.rag.chunks and elevenlabs.rag.used_chunk_ids, matching the JSON post-call webhook. See OpenTelemetry traces.
  • Guardrails: In voice conversations, the prompt injection guardrail now evaluates the user turn being answered instead of the agent’s previous message. Conversations on asynchronous channels such as Zendesk, Intercom and Custom Channel that a guardrail blocks now report the guardrail as the termination reason.
  • Zero Retention Mode: Synthetic voice detection is skipped for conversations in Zero Retention Mode.
  • WhatsApp: WhatsApp conversations resumed by a reply to a batch call template keep their batch_call metadata and batch ID.
  • Phone number secrets: Workspace secrets used as a Twilio auth token or an Exotel API token on a phone number show as in use and cannot be deleted while the number depends on them.
  • Fixes: Text conversations end as soon as the end_call tool runs instead of waiting for the next user message. Voice agents no longer go silent when a turn is cancelled before any audio is sent. The soft timeout no longer fires right after the first message or after tool calls on Eleven v4 voices. Realtime agents with sub-agent, agent tool or prompt say nodes that inherit the LLM can be saved and published. Agent tools that use OAuth2 connections no longer fail with expired tokens when the provider rotates refresh tokens. The nemotron-35-super-vl-nvfp4 context limit is raised from 64,000 to 131,072 tokens.
  • Clone strength: clone_strength (0 to 1) in Text to Speech voice_settings and Text to Dialogue settings controls how closely a Professional Voice Clone fine-tuned for a v4 model follows its samples. The recommended value for most use cases is 0. Edit voice settings stores clone_strength and Get voice settings returns it.
  • PVC and IVC on v4 dialogue: On the Text to Dialogue endpoints, clone_strength now decides whether a v4 PVC runs as a PVC or an IVC, and use_pvc_as_ivc is deprecated.
  • New endpoint paths: Voice Changer is documented at POST /v1/voice-changer/{voice_id} and POST /v1/voice-changer/{voice_id}/stream. The /v1/speech-to-speech/{voice_id} paths keep working but are deprecated and removed from the API reference. The Python and JavaScript SDKs call the new paths from v2.75.0, and the SDK method names are unchanged for now. In the next major SDK version, client.speechToSpeech will be deprecated in favor of client.voiceChanger to match the endpoint. See Voice changer.
  • Expiring service account API keys: Service account API keys accept expires_at_unix on create and update, between 15 minutes and 90 days in the future. Later expiries are rejected with 400 invalid_api_key_expiry. On update, pass "clear" to remove an expiry.
  • Group concurrency limits enforced: The workspace group concurrency limits (group_concurrency_limit, group_dubbing_concurrency_limit and group_music_concurrency_limit) are enforced for Text to Speech, Voice Changer, Music and Dubbing requests.
  • Voice cloning permissions: Members without the Create instant voice clone or Create professional voice clone permission can no longer create clones, even with general voice access.
  • SCIM group seat types: Workspaces that use SCIM without SCIM routing can assign a seat type to SCIM-synced groups from the Groups page.
  • Fixes: Delete invite returns 404 invite_not_found for an invite that does not exist, instead of a 500 error.
  • Shorter realtime silence thresholds: Realtime Speech to Text honors vad_silence_threshold_secs values below 0.5 seconds, which were previously treated as 0.5. The minimum accepted value is lowered from 0.3 to about 0.19 seconds.
  • Webhook retries: Transcription and error webhooks are retried on failure when the webhook’s retry setting is on. See Speech to Text webhooks.
  • Legacy endpoints deprecated: The /v1/dubbing endpoints outside /v1/dubbing/project, including Dub a video or an audio file and List dubs, are marked deprecated in the API reference.
  • Transcript downloads: The dubbing project menu can download target language transcripts as JSON, and as WebVTT subtitles for recent dubs.
  • Media folders: Workspace library files can be organized into folders in the Studio media browser.
  • Video clip actions: Video clips offer voice changer and voice isolator actions.
  • Video to music: Studio’s video to music workflow uses Music v2.5 by default.
  • Retired models: Image & Video and Flows requests for a retired model fail before generation with a 410 model_retired error that names the replacement model. Flows preflight reports the error on the affected node.
  • Fixes: Generations wait for a just-uploaded reference asset to finish processing instead of failing.
  • Fixes: Cantonese Professional Voice Clone samples are no longer rejected when language detection reports Chinese, and adding PVC samples no longer fails with a 500 error when language detection is unavailable.
  • Minimum charge: Text to Speech and Speech to Text requests priced below one credit are charged one credit, and refunds return exactly the credits that were charged.
  • Business plan image and video pricing: Business plans on the current pricing pay the same image and video credit rate as other self-serve plans, about 17% fewer credits per image and per video second than before.
  • OAuth scope: OAuth clients can request the realtime_translation scope.

JavaScript SDK

  • v2.75.0 - client.speechToSpeech.convert and client.speechToSpeech.stream now call POST /v1/voice-changer/{voice_id} and its /stream path. Added client.environmentVariables.delete, client.conversationalAi.tests.invocations.update for renaming a test invocation, and an optional name on client.conversationalAi.agents.runTests. Also adds serviceTier on the LLM usage calculators, excludePatterns on knowledge base crawl jobs, expiresAtUnix on service account API keys, cloneStrength in voice settings, startProcedureIds in conversation initiation client data and the widget mobileFullscreen setting. The legacy dubbing list, create, get and delete methods are marked deprecated, and the branch rebase request type BranchesRebaseRequest is renamed to BodyRebaseABranchOntoMainV1ConvaiAgentsAgentIdBranchesBranchIdRebasePost.

Python SDK

  • v2.75.0 - Added the callback_disconnect option to Conversation and AsyncConversation. It receives a DisconnectionDetails with a reason of "user", "agent" or "error", plus the WebSocket close code and reason when available, and replaces the deprecated callback_end_session. The regenerated client moves client.speech_to_speech to the /v1/voice-changer paths and adds client.environment_variables.delete, client.conversational_ai.tests.invocations.update and the same new parameters as JavaScript SDK v2.75.0.

Android SDK

  • v0.13.0 - agent_tool_request is now handled as a notification event instead of a client tool call, so client tools no longer run twice, the first time without parameters. The SDK also no longer crashes when a client tool answers after the connection has closed.

ElevenLabs CLI

  • v1.7.1 - say uses eleven_v4 and new agent templates use eleven_v4_turbo by default. Fixes onboard sign-in on Windows and when the token cannot be saved to the keychain.

Packages

  • @elevenlabs/client@1.29.0 and @elevenlabs/react@1.19.0 - Added the onAudioAlignmentPlayback callback, called with { event_id, alignment } when an aligned audio chunk starts playing, for syncing text with speech. It is not called on WebRTC connections.
  • @elevenlabs/client@1.30.0 - Added the opt-in stripAudioTags session option, which removes audio tags such as [laughs] from agent messages passed to onMessage and onAgentResponseCorrection, and exports the stripAudioTags helper. Stripped text no longer lines up with onAudioAlignment timings.
  • @elevenlabs/client@1.31.0, @elevenlabs/types@0.26.0 and @elevenlabs/react@1.20.0 - Added overrides.tts.modelId for a per-conversation TTS model override. Realtime Speech to Text emits RealtimeEvents.AUDIO_STARTED once the first microphone audio frame is sent, and useScribe in microphone mode reports connected only from that point.
  • @elevenlabs/convai-widget-core@0.21.0 and @elevenlabs/convai-widget-embed@0.21.0 - Voice call transcripts are revealed in step with the agent’s speech, and an interrupted reply keeps only what was said. Resuming a persistent text conversation no longer asks the user to accept the terms again.
  • @elevenlabs/convai-widget-core@0.21.1, 0.21.3 and 0.21.4 - Text chat shows typing dots while the agent prepares its reply. Rich content carousels show a page indicator, stay clickable after the conversation moves on, and appear in voice calls while the agent is still speaking. On screens narrower than 768px the chat opens fullscreen; add mobile-fullscreen="false" to the embed to keep the compact layout.
  • @elevenlabs/react-native@1.2.31, 1.2.32 and 1.2.33 - Updated to the latest @elevenlabs/client and @elevenlabs/react releases.

New endpoints

ElevenAgents

  • DELETE /v1/convai/environment-variables/{env_var_id} - Delete an environment variable. Returns 204.
  • PATCH /v1/convai/test-invocations/{test_invocation_id} - Rename a test invocation with required name (string, 1 to 256 characters, or null to restore the generated title).

Voice Changer

  • Voice changer - POST /v1/voice-changer/{voice_id} and Voice changer stream - POST /v1/voice-changer/{voice_id}/stream - The documented paths for Voice Changer. POST /v1/speech-to-speech/{voice_id} and POST /v1/speech-to-speech/{voice_id}/stream are removed from the API reference and deprecated.

Updated endpoints

ElevenAgents

  • Create agent, Get agent and Update agent
    • Prompt configuration adds service_tier (standard or fast, default standard). Workflow node prompt overrides add nullable service_tier.
    • Widget configuration adds mobile_fullscreen (boolean, default true).
  • List LLMs - Each model adds required available_service_tiers (array of standard or fast).
  • Calculate LLM usage and Calculate expected LLM usage for an agent - Added optional service_tier.
  • Get widget - Widget configuration adds mobile_fullscreen (boolean, default true).
  • Create crawl job - Added optional exclude_patterns (array of strings, up to 50 items of up to 2,048 characters each).
  • Get crawl job and List crawl jobs - Crawl jobs add exclude_patterns (array of strings).
  • Knowledge base document responses - auto_sync_info removes the deprecated auto_discover field.
  • Run tests - Added optional name (string, 1 to 256 characters). Get test invocation and List test invocations return nullable name.
  • Update branch - Added optional description (string, up to 4,096 characters). Pass an empty string to clear it.
  • Get conversation details
    • Conversation charging adds nullable voice_surcharge_charge (integer).
    • Agent definition source enum adds architect.
  • Agent deployments (GET /v1/convai/agents/{agent_id}/deployments) - Deployment source enum adds duplicate.
  • Conversation initiation client data, including the conversation_initiation_client_data WebSocket event and Submit batch call - Added optional start_procedure_ids (array of strings).
  • Tool type enum removes api_integration_mcp.

Text to Speech and Text to Dialogue

Dubbing

  • List dubs, Dub a video or an audio file, GET /v1/dubbing/{dubbing_id}, DELETE /v1/dubbing/{dubbing_id}, GET /v1/dubbing/{dubbing_id}/audio/{language_code} and GET /v1/dubbing/{dubbing_id}/transcripts/{language_code}/format/{format_type} - Marked deprecated.

Workspaces


Eleven Realtime

Eleven Realtime is a new family of models for ElevenAgents voice agents, rolling out gradually across workspaces. Each one is a complete voice agent configuration. You pick one model, and ElevenLabs handles the LLM, Speech to Text and Text to Speech settings behind it. Your agent’s system prompt, voice, tools and knowledge base work the same as before.

There are two to choose from. Eleven Realtime v1 Mini (eleven_realtime_v1_mini) is the default, and it’s the fastest and cheapest. Eleven Realtime v1 Max (eleven_realtime_v1_max) reasons before it answers, so use it when your agent has complex instructions or multi-step tool calls.

If you’ve already built on OpenAI’s Realtime API, you don’t need to rewrite your client. The events and the WebSocket transport are the same, so you change the endpoint and the session configuration. Your backend calls Create realtime client secret to get a short-lived secret, and the browser uses it to connect directly.

Realtime Translation

Realtime Translation turns speech in one language into speech in another while the speaker is still talking. It’s a WebSocket API, available now for enterprise workspaces.

You open a connection with a target_language and a voice_id, then stream audio in. You get translated speech back in that voice. You don’t have to say which language the speaker is using, because it’s detected automatically, but you can set source_language if you know it. Along the way, the server also sends live transcripts of the original speech and the translated text, for example to show captions.

eagerness controls the tradeoff between speed and quality. high starts translating soonest, and low waits for more of the sentence. The translated voice uses Eleven v4 Turbo by default, and you can switch to eleven_v3 or eleven_flash_v2_5 with tts_model_id. For sensitive conversations, set enable_zrm=true to use Zero Retention Mode.

Video to Music

Video to Music writes a soundtrack for your video. The Video to music API is now available: you upload a video and get back music that fits it, without writing a music prompt from scratch. Use it to score product videos, ads and social clips.

You can send up to 10 video files (200 MB combined). They’re joined in order and scored as one video. To steer the result, add a text description and up to 10 style tags.

Three options are worth knowing. use_audio_as_reference takes the genre, BPM, instruments and mood from the video’s own audio. add_sfx adds sound effects that match the video. separate_tracks returns the music and the sound effects as separate files in a ZIP, so you can mix them yourself.

ElevenAgents

  • Alerts: Alerts notify a workspace when agent error rates exceed a threshold or rise sharply above their recent baseline. Monitors cover conversation failures, tool failures, webhook errors, guardrail triggers, call initiation errors and evaluation success scores, and run with default thresholds without any setup. Agent-level thresholds and notifiers can be set through platform_settings.alerting on Update agent. Notifications can be delivered as webhooks, to Slack or to PagerDuty.
  • Guardrails generally available: Guardrails are no longer in alpha.
  • Workspace environments: Environments for environment variables can now be managed through the API with List environments, Create environment and Delete environment. A variable without a value for an environment falls back to its production value. Deleting an environment removes its values from all variables, and production cannot be deleted.
  • Answering machine detection actions: Twilio answering machine detection settings on Outbound call and Submit batch call accept actions, a list of rules that pair an action (hang_up) with the answered_by verdicts that trigger it, such as machine_start or fax. Verdicts without a rule leave the call running.
  • New LLMs: Agents can use gemini-4-argon, claude-opus-4-6 and the ElevenLabs-hosted nemotron-35-super-vl-nvfp4. See Models.
  • Authored-only workflow reads: Get agent and Update agent accept include_procedure_generated_workflow_elements. Set it to false to receive only the workflow nodes and edges you authored, excluding the ones compiled from structured procedures. Defaults to true, so existing callers are unchanged.
  • Branch rebasing from any branch: Rebase branch and Preview rebase accept an optional source_branch_id to pull changes from a branch other than main.
  • Delete agents used as subagents: Delete agent accepts force. When true, the agent is deleted even if other agents use it as a subagent, and it is removed from those agents and their branches.
  • Sort agents by last update: List agents accepts sort_by=updated_at, and each agent summary includes updated_at_unix_secs, the last time the main branch or agent-level settings changed.
  • Google Calendar event updates: The Google Calendar integration adds google_calendar_update_event and google_calendar_delete_event tools. Both are privileged tools that can change or cancel any event on the connected calendar.

Music and Sound Effects

  • Zero Retention Mode: Music generation, composition plan, stem separation and video to music endpoints, plus Sound Effects, accept enable_logging=false to use Zero Retention Mode. Zero Retention Mode is available to enterprise customers. Music requests that set store_for_inpainting=true are rejected in this mode.
  • WAV output for sound effects: Sound Effects accepts wav_8000, wav_16000, wav_22050, wav_24000, wav_32000, wav_44100 and wav_48000 output formats.

Speech Engine

  • 40-minute conversations: Speech Engine supports conversations of up to 40 minutes. The default limit remains 10 minutes. Raise conversation.max_duration_seconds to allow longer conversations.
  • Sort by last update: List Speech Engines accepts sort_by=updated_at, and each summary includes updated_at_unix_secs.

Dubbing

  • Subtitles for dubbed languages: Dubbing project language outputs (GET /v1/dubbing/project/{project_id}/language/{language_id}) include subtitles, a signed URL to the translated lines as WebVTT subtitles timed to the source speech. The URL expires one hour after it is issued.

Voices

  • Resubmittable voice reviews: Voice sharing review_status adds declined_resubmittable for declined voices that can be resubmitted for review.

Workspaces

  • Disable service account API keys: Disable service account API key disables a service account API key without changing its other settings. It remains available after a workspace downgrades from a plan that includes service accounts.
  • Group concurrency limits: List workspace groups and List service accounts return group_concurrency_limit, group_dubbing_concurrency_limit and group_music_concurrency_limit for each group, and group permissions add all_resources_access.

SDK releases

JavaScript SDK

  • v2.74.0 - Added client.conversationalAi.realtime.createClientSecret for the Realtime API, with the RealtimeModel and OpenAI-compatible session configuration types, and an environments client with list, create and delete. Also adds force on agent deletion, sourceBranchId on branch rebase and rebase preview, includeProcedureGeneratedWorkflowElements on agent reads, enableLogging on Music and Sound Effects methods, WAV output formats for Sound Effects, service account API key disable, and Twilio answering machine detection actions.
  • v2.73.0 - Added createAndWait helpers for Flows image, video and Text to Speech generations and template runs (client.flows.templates.runs.createAndWait). They create the request and poll until it completes or fails, pacing requests with the server’s Retry-After header. A failed result is returned rather than thrown, and waitTimeoutInSeconds throws FlowsWaitTimeoutError if the work is not finished in time. The regenerated client adds the Video to music add_sfx, separate_tracks and use_audio_as_reference options.

Python SDK

  • v2.74.1 - music.compose_detailed now accepts and forwards enable_logging, which the custom wrapper previously dropped, so Zero Retention Mode works with this method.
  • v2.74.0 - Added client.conversational_ai.realtime.create_client_secret for the Realtime API and an environments client, with the same regenerated API changes as JavaScript SDK v2.74.0.
  • v2.73.0 - Added create_and_wait helpers for Flows image, video and Text to Speech generations and template runs, for both sync and async clients, with wait_timeout_in_seconds and min_poll_interval_in_seconds options and a FlowsWaitTimeoutError exported from elevenlabs.flows_custom. Type checkers such as pyright now resolve client.webhooks.construct_event, client.speech_to_text.realtime, client.text_to_speech.convert_realtime and the custom Music methods. Includes the same regenerated API changes as the JavaScript SDK.
  • v2.73.1 - Fixed the test suite on Python 3.13 and later, and added Python 3.13 and 3.14 to CI.

ElevenLabs CLI

  • v1.7.0 - Regenerated API commands, adding environments, realtime client secrets and service account API key disabling.
  • v1.6.0 - Added create-and-wait commands for flows image, flows video, flows text-to-speech and flows templates runs. Each command returns a finished result, with --wait-timeout and --min-poll-interval options.
  • v1.5.1, v1.5.2, v1.5.3 and v1.6.1 - Bug fixes for onboarding, including Windows support.

Packages

API

New endpoints

ElevenAgents

  • Create realtime client secret - POST /v1/convai/realtime/client_secrets - Create an ephemeral client secret for browser-based Realtime API sessions. Accepts an optional session (OpenAI-compatible session configuration with model of eleven_realtime_v1_mini (default) or eleven_realtime_v1_max, instructions, audio, tools, turn_detection and max_duration_seconds from 60 to 7,200, default 600) and optional expires_after with required seconds (integer). Returns value (string), expires_at (integer) and the echoed session.

  • List environments - GET /v1/convai/environments - List the workspace environments, including production. Each environment has name, nullable updated_at_unix_secs and nullable created_by_user_id.

  • Create environment - POST /v1/convai/environments - Create an environment with a required, unique name (string). Returns 409 if the name is taken.

  • Delete environment - DELETE /v1/convai/environments/{environment} - Delete an environment and remove its values from all environment variables. Returns 204.

Workspaces

  • Disable service account API key - POST /v1/service-accounts/{service_account_user_id}/api-keys/{api_key_id}/disable - Disable a service account API key without changing its other settings.

Updated endpoints

ElevenAgents

  • Get agent, Update agent, Preview rebase and Preview merge
    • Added optional include_procedure_generated_workflow_elements (boolean, default true). When false, the returned workflow contains only authored nodes and edges, without those generated from structured procedures.
  • Create agent, Get agent and Update agent
    • The llm enum adds gemini-4-argon, claude-opus-4-6 and nemotron-35-super-vl-nvfp4.
    • TTS configuration effects removes the deprecated seed field.
  • Delete agent - Added optional force (boolean, default false).
  • List agents - sort_by adds updated_at. Agent summaries add required updated_at_unix_secs (integer).
  • Rebase branch and Preview rebase - Added optional source_branch_id (string). Defaults to the agent’s main branch.
  • Outbound call, Submit batch call and Get batch call
    • Twilio machine detection configuration adds actions, an array of rules with required action (hang_up) and required answered_by (array of human, fax, unknown, machine_start, machine_end_beep, machine_end_silence or machine_end_other). Each action can appear in at most one rule.
  • Get conversation details
    • Transcript tool calls add nullable tool_id (string). It is not set for tools without an ID, such as system tools.
    • Turn metrics add nullable voice_id (string).
    • Tool results add nullable to_agent and to_node (string).
    • WhatsApp conversation info adds nullable recipient with nullable phone and bsuid (string), and nullable call_permission_request with required state (blocked, sent, accepted or declined) and nullable requested_at_unix (integer).
    • The platform charge category enum adds v3_addon, v4_addon and rag_addon.
  • Get ticket, List tickets and List workspace tickets
    • Ticket responses add required status_changes, an array of objects with status, nullable changed_by_user_id (string) and changed_at_unix_secs (integer).

Text to Speech and Text to Dialogue

Music

Sound Effects

  • Create sound effect
    • Added optional enable_logging query parameter (boolean, default true).
    • output_format adds wav_8000, wav_16000, wav_22050, wav_24000, wav_32000, wav_44100 and wav_48000.

Speech Engine

  • List Speech Engines - sort_by adds updated_at. Summaries add required updated_at_unix_secs (integer).

Speech to Text

  • Create transcript and Get transcript - Edited transcripts add required, read-only edited_text (string), matching text and the edited_text field of the realtime edited_transcript event.

Dubbing

  • GET /v1/dubbing/project/{project_id}/language and GET /v1/dubbing/project/{project_id}/language/{language_id} - Language outputs add nullable subtitles (string, signed URL).

Voices

Workspaces

  • List workspace groups and List service accounts
    • Groups add nullable group_concurrency_limit, group_dubbing_concurrency_limit and group_music_concurrency_limit (integer or unlimited).
    • Group permissions add all_resources_access.

ElevenAgents

  • Merge and search triage tickets: Merge tickets folds up to 50 open tickets from the same agent into one target ticket. Merged tickets keep the status merged and reference the target through merged_into_ticket_id. List tickets and List workspace tickets add a case-insensitive search parameter that matches ticket titles, descriptions, comments and turn comments, and each result includes a search_match excerpt showing where the query matched.
  • Workflow End node outcomes: Workflow End nodes accept an outcome of success (default) or failure, so a workflow can record whether a conversation ended successfully. The conversation error type adds workflow_end_failure.
  • Call queueing enabled for new agents: New agents are created with call queueing enabled unless platform_settings.queueing_config.enabled is set explicitly. Existing agents keep their current setting.
  • Post-call audio webhook retries: When Enable retries is on, post_call_audio webhooks are retried on the same schedule as transcription webhooks. Audio payloads over 50 MiB are not retried, and queued audio retries are capped at 400 MiB per webhook.
  • Strict tool overrides: The conversation override tool_ids_strict makes an overridden tool_ids list the complete set of tools available in the conversation, including tools on workflow nodes. It is ignored when set on the agent itself.
  • Widget end confirmation: The widget can ask users to confirm before ending a chat or call. Enable it with end_confirmation_enabled in the widget configuration or the end-confirmation attribute.

Text to Speech

  • Audio effects: Text to Speech and Text to Dialogue requests accept an optional audio_effects object. It applies a filter preset, perceived distance, a reverb environment, a looped background noise bed and stereo panning to the generated audio. List valid preset, environment and background noise IDs with GET /v1/audio-effects/catalog. Reverb and non-zero panning produce stereo audio and are rejected for ulaw_*, alaw_* and pcm_* output formats. Effects do not change the cost of a request.

Speech to Text

  • Turn prediction commit strategy: The realtime Speech to Text WebSocket adds turn_prediction as a commit_strategy value. In addition to silence-based segmentation, it commits a segment as soon as the model predicts the speaker has finished their turn. It is the default for models that predict turns, and partial transcripts from those models include turn_probability. See transcripts and commit strategies.

Voices

  • Voice collections API: Voice collections can now be managed through the API. Create, list, update and delete collections, and add or remove voices. See List voice collections.

Workspaces

  • Basic seat fallback: Update member accepts allow_downgrade_to_basic_seat. When unlocking a user whose original seat type has no seats available, the user is moved to a basic seat instead of the request failing.
  • Workspace ID on user: Get user returns the workspace_id of the workspace the API key belongs to.

SDK releases

JavaScript SDK

  • v2.72.0 - Added clients for voice collections, the audio effects catalog and triage ticket merging. Text to Speech and Text to Dialogue methods accept audio_effects, triage ticket list methods add search and filters, and the realtime Speech to Text client adds the turn_prediction commit strategy.

Python SDK

  • v2.72.0 - Added clients for voice collections, the audio effects catalog and triage ticket merging. Text to Speech and Text to Dialogue methods accept audio_effects, triage ticket list methods add search and filters, and the realtime Speech to Text client adds the turn_prediction commit strategy. play() and save() now accept any iterable of audio chunks, such as a list or tuple. RealtimeEvents.CLOSE handlers receive a dictionary with the WebSocket close code and reason; handlers without parameters continue to work.

ElevenLabs CLI

  • v1.5.0 - Regenerated API commands, adding voice collections, the audio effects catalog, triage ticket merging and agent merge proposals.

Packages

  • @elevenlabs/client@1.27.0 and @elevenlabs/react@1.17.0 - Added a previousText option to Scribe.connect() and useScribe() in microphone mode. The text is sent with the first audio chunk to give the model context, such as existing document text, for casing, punctuation and sentence continuation. MediaDeviceOutput now receives libsampleratePath, so output resampling uses the same custom libsamplerate bundle path as MediaDeviceInput.
  • @elevenlabs/react-native@1.2.29 - Updated to @elevenlabs/client@1.27.0 and @elevenlabs/react@1.17.0.
  • @elevenlabs/convai-widget-core@0.19.0 and @elevenlabs/convai-widget-embed@0.19.0 - Added an optional confirmation dialog before ending a chat or call, enabled with the end-confirmation attribute or end_confirmation_enabled config, with customizable text. Added carousel rich content with scrollable item cards that can include an image, subtitle, description and actions. Carousels remain in the transcript after a reply, without their actions. Rich content is now shown during voice calls when the transcript is visible.

API

New endpoints

ElevenAgents

  • Merge tickets - POST /v1/convai/triage-tickets/{agentqa_ticket_id}/merge - Merge open tickets into the target ticket. Requires source_ticket_ids (string array, 1–50 items) and returns the target ticket.

Voices

  • List voice collections - GET /v1/voices/collections - List the voice collections the caller can access, sorted by title.
  • Create voice collection - POST /v1/voices/collections - Create a collection with required title and icon (string, maximum 1,000 characters each).
  • Get voice collection - GET /v1/voices/collections/{collection_id} - Retrieve a collection with its title, icon and the caller’s permission_on_resource (admin, editor, commenter or viewer).
  • Update voice collection - PATCH /v1/voices/collections/{collection_id} - Update the optional title or icon.
  • Delete voice collection - DELETE /v1/voices/collections/{collection_id}
  • Add voice to collection - POST /v1/voices/collections/{collection_id}/voice/{voice_id}
  • Remove voice from collection - DELETE /v1/voices/collections/{collection_id}/voice/{voice_id}

Audio effects

  • GET /v1/audio-effects/catalog - List the available filter_presets, environments and background_noises. Each entry has an ID, a name and a nullable description.

Updated endpoints

ElevenAgents

  • Create agent, Get agent and Update agent
    • Workflow End nodes add outcome (success or failure, default success). The field is required in responses.
    • Standalone workflow agent nodes and agent transfer configurations add nullable branch_id (string) to target a specific branch of the destination agent. When unset, the transfer follows the target agent’s traffic deployment. Transfer tool results add a configured branch reason.
    • Prompt override configurations add tool_ids_strict (boolean, default false).
    • TTS configuration effects add pan (number, -1 to 1, default 0). The seed field is deprecated and has no effect.
  • Get widget config - Added end_confirmation_enabled (boolean, default false).
  • List tickets
    • Added optional search (string, maximum 200 characters) and merged_into_ticket_id (string) query parameters.
    • Ticket responses add nullable merged_into_ticket_id and nullable search_match with field (title, description, comment or turn_comment), snippet, highlight_start, highlight_end and nullable turn_index.
  • List workspace tickets - Added optional agent_id, sources, priorities, sort_by (created_at or priority, default created_at), owner_user_id, issue_type, label, merged_into_ticket_id and search query parameters.
  • List tests - Added optional created_by_user_id (string). Use @me for the authenticated user.
  • List test invocations - Added optional test_id (string), version_id (string), start_time and end_time (integer, Unix seconds, inclusive) query parameters.
  • Update agent branch - Added optional auto_rebase (boolean). Branch responses add auto_rebase (boolean, default false).
  • Get conversation details
    • Twilio, SIP trunk and Exotel phone call metadata add nullable call_result with answered, voicemail, busy, no_answer and failed values.
    • Batch call metadata adds nullable cold_attempt (integer) and nullable conversation_type (initial, retry, callback or redirect).
    • The conversation error type adds workflow_end_failure.
  • Knowledge base auto-sync auto_discover is deprecated and no longer has any effect.

Text to Speech

  • Create speech, Stream speech, Create speech with timing and Stream speech with timing
    • Added optional nullable audio_effects with filter_preset_id (string), distance (number, 0–1, default 0), environment_id (string), background_noise_id (string), send_level (number, 0–1, default 1) and pan (number, -1 to 1, default 0).
    • Unknown effect IDs return 404. Stereo effects return 400 for ulaw_*, alaw_* and pcm_* output formats.

Text to Dialogue

Speech to Text

  • Realtime Speech to Text
    • The commit_strategy query parameter adds turn_prediction, alongside manual and vad.
    • partial_transcript messages add optional turn_probability (number), sent only for models that predict turns.

Music

  • POST /v1/music/video-to-music - Responses add a song-id header with the ID of the generated song.

History

Workspace and user

  • Update member - Added optional allow_downgrade_to_basic_seat (boolean, default false).
  • Get user - Added required workspace_id (string).
  • Service account API key permissions add voice_collections_read and voice_collections_write.

ElevenAgents

  • Structured procedures compile on save and publish: Update agent and Create agent draft now compile and validate structured procedures automatically. Integrations no longer need to call the compile endpoint or manually update the generated workflow. Invalid procedures return per-procedure errors as 400 procedure_validation_failed. Agents without structured procedures are unaffected.
  • Compile procedures endpoint is legacy: Compile procedures is marked legacy and should not be used by new integrations. It remains available for existing callers.
  • Merge proposals: Merge proposals are available in alpha. Teams can open a proposal for an agent branch, review configuration changes and test results, leave comments or approval decisions, and merge approved changes into a target branch. See Merge proposals.

SDK releases

JavaScript SDK

  • v2.71.0 - Added clients for agent merge proposals, deployment history, test invocation cancellation and Speech Engine duplication. The release also adds triage ticket priorities and sorting, batch call export limits, gpt-6.1-sol, claude-sonnet-5-5, Eleven v4 agent voice models and current agent configuration types.

Python SDK

  • v2.71.0 - Added clients for agent merge proposals, deployment history, test invocation cancellation and Speech Engine duplication. The release also adds triage ticket priorities and sorting, batch call export limits, gpt-6.1-sol, claude-sonnet-5-5, Eleven v4 agent voice models and current agent configuration types.

Swift SDK

  • v3.4.0 - Dynamic variables now preserve native JSON types when sent in conversation initiation data.

Packages

API

New endpoints

ElevenAgents

  • Create a merge proposal - POST /v1/convai/agents/{agent_id}/merge-proposals - Create a proposal with required source_branch_id, target_branch_id and title fields, plus an optional description, reviewer IDs and triage ticket ID.
  • List merge proposals - GET /v1/convai/agents/{agent_id}/merge-proposals - List proposals with status, source branch, target branch and text filters, plus cursor pagination.
  • Get a merge proposal - GET /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id} - Retrieve a proposal and its review, comment and outcome details.
  • Update a merge proposal - PATCH /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id} - Update its title, description or requested reviewers, or close it without merging.
  • Review a merge proposal - POST /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id}/reviews - Submit an approved or changes_requested decision with an optional comment.
  • Comment on a merge proposal - POST /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id}/comments - Add a Markdown comment of up to 4,096 characters.
  • Merge a merge proposal - POST /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id}/merge - Merge the source branch and optionally control forced conflict resolution and source branch archival.
  • List agent deployments - GET /v1/convai/agents/{agent_id}/deployments - List current and historical branch traffic splits with page-based pagination.
  • Cancel a test invocation - POST /v1/convai/test-invocations/{test_invocation_id}/cancel - Cancel a running test invocation.

Speech Engine

  • Duplicate a Speech Engine - POST /v1/speech-engine/{speech_engine_id}/duplicate - Duplicate a Speech Engine and optionally assign the copy a new name.

Updated endpoints

ElevenAgents

  • Create agent, Get agent and Update agent
    • Added gpt-6.1-sol and claude-sonnet-5-5 to the LLM enum.
    • Added eleven_v4 and eleven_v4_turbo to the conversational TTS model options. The default changed from eleven_flash_v2 to eleven_v4_turbo.
    • Agent transfers and standalone workflow agent nodes add optional preserve_voice_settings (boolean, default false) to retain the base voice, TTS model and voice settings after a transfer.
    • Skip-turn tool configurations add optional wait_timeout_secs (number, default -1). A value of -1 keeps the agent silent until the caller speaks.
    • Post-call webhook configurations add optional exclude_transcript (boolean, default false) to omit turn-by-turn transcripts from JSON transcription webhooks.
    • Conversation history redaction configurations add optional excluded_data_collection_ids (string array, maximum 50) to preserve selected extracted values while redacting their rationales.
    • Client tool response_timeout_secs now accepts -1 to wait indefinitely when expects_response is enabled.
  • List tickets
    • Added optional priorities (array) with low, medium, high and urgent values.
    • Added sort_by with created_at and priority values; the default is created_at.
    • Ticket responses now require title, nullable priority, and a priority_changes array. Ticket creation and update requests can set priority, and ticket status adds cancelled.
  • List tools - Added optional nullable used_by_agent_id (string) to return tools referenced by an agent’s main branch.
  • Export batch call results - Added optional nullable limit (integer, minimum 1) to export only the first recipients as a column preview.
  • List test invocations and Get test invocation
    • Test invocation summaries add required cancelled_count (integer) and optional cancelled (boolean, default false).
    • Test run status adds cancelled.
  • Get conversation details - Transcript entries add optional nullable platform_event with user_turn_timeout and skip_turn_wait_elapsed values.
  • Get agent version metadata - Added optional nullable merged_authors, an array describing the people who published changes merged into the main branch.
  • Get crawl job - Removed the deprecated max_depth response field.

Eleven v4 and Eleven v4 Turbo

Eleven v4 and Eleven v4 Turbo are now available. Eleven v4 provides higher-quality, more expressive speech and improved voice cloning across more than 90 languages. Eleven v4 Turbo provides the same model family for real-time applications, with median inference latency of approximately 100 ms.

Use eleven_v4 through the Text to Dialogue API for content creation and long-form audio. Use eleven_v4_turbo through the Text to Dialogue WebSocket for agents and interactive applications.

Speech to Text

  • Transcript editing: Batch and realtime transcription now accept a natural-language edit instruction of up to 2,000 characters. Batch responses return the result in edited_transcript, while realtime sessions emit an edited_transcript event. See the batch and realtime guides for incompatibilities, response handling and pricing.

ElevenAgents

  • Agent models: Added gpt-6-sol, gpt-6-luna, glm-52, deepseek-v41-flash, claude-opus-5 and claude-opus-5-5 to the supported agent LLM options.
  • Agent test usage: Test invocation summaries can include total credits and USD price. Individual test runs can include credits and a charging breakdown.

Flows

  • Template API: Added endpoints to list and retrieve published Flows templates, start template runs and retrieve run results. Runs can target a published version and send their terminal result to a configured webhook.

Text to Dialogue

  • Generation continuity: Text to Dialogue requests can use preceding or following text and request IDs to maintain continuity across generations.
  • Professional voice mode: Text to Dialogue requests can use the Instant Voice Clone version of a Professional Voice Clone to reduce latency or improve expressiveness.

SDK releases

JavaScript SDK

  • v2.70.0 - Added batch and realtime Speech to Text transcript editing types, branchId filtering and cost fields for test invocation summaries, knowledge base auto-discovery, Text to Dialogue usePvcAsIvc and the deepseek-v41-flash agent model.

Python SDK

  • v2.70.0 - Added batch and realtime Speech to Text transcript editing types, branch_id filtering and cost fields for test invocation summaries, knowledge base auto-discovery, Text to Dialogue use_pvc_as_ivc and the deepseek-v41-flash agent model.

ElevenLabs CLI

  • v1.4.0 - Fixed requests with an explicit API key so they no longer also send stored OAuth credentials, which caused authentication failures. Added descriptions for the feedback command group and instructions for reporting missing capabilities to generated agent skills. Regenerated the API client with Flows template endpoints and current schema types.

API

New endpoints

Flows

  • List templates - GET /v1/flows/templates - List published templates and their runnable versions.
  • Get template - GET /v1/flows/templates/{template_id} - Retrieve a template and its runnable versions.
  • Create template run - POST /v1/flows/templates/{template_id}/runs - Start a template run with input values, an optional version and an optional webhook.
  • List template runs - GET /v1/flows/templates/{template_id}/runs - List template runs with cursor pagination and optional version filtering.
  • Get template run - GET /v1/flows/templates/{template_id}/runs/{run_id} - Retrieve a template run and its output status.

Updated endpoints

Speech to Text

  • Convert speech to text - POST /v1/speech-to-text
    • Added optional nullable transcript_edit (string), which accepts a natural-language edit instruction of up to 2,000 characters.
    • Responses add optional nullable edited_transcript. A successful edit contains required kind: "transcript" and text fields. A failed edit contains required kind: "error", error_type: "edit_failed" and message fields.
  • Realtime Speech to Text accepts transcript_edit (string) and emits edited_transcript events with required text and edited_text fields.

ElevenAgents

  • Create agent, Get agent and Update agent
    • Added gpt-6-sol, gpt-6-luna, glm-52, deepseek-v41-flash, claude-opus-5 and claude-opus-5-5 to the LLM enum.
    • Alerting monitors add optional nullable enabled (boolean) to control whether a monitor can send notifications.
  • List conversations and Text search
    • data_collection_params and dynamic_variable_params add neq and in operators. Values for in use a pipe delimiter.
    • evaluation_params accepts success, failure or unknown as the result value.
  • Smart search - GET /v1/convai/conversations/messages/smart-search
    • Added optional nullable branch_id (string).
  • List test invocations - GET /v1/convai/test-invocations
    • Added optional nullable branch_id (string).
    • Test invocation summaries add optional nullable credits_used (integer) and total_price (number).
  • Get test invocation - GET /v1/convai/test-invocations/{test_invocation_id}
    • Individual test runs add optional nullable credits_used (integer) and charging (ConversationChargingCommonModel).
  • Simulate conversation and Simulate conversation stream
    • Changed the optional new_turns_limit default from 10,000 to 100 and set its maximum to 100.
  • Create crawl job and Get crawl job
    • Added optional auto_discover (boolean, default false) to follow links and add newly discovered pages during auto-sync. This requires enable_auto_sync: true.
  • Refresh knowledge base document - POST /v1/convai/knowledge-base/{documentation_id}/refresh
    • AutoSyncInfo adds optional auto_discover (boolean, default false) to indicate whether refreshes crawl and add newly discovered pages.
  • List MCP server tools - GET /v1/convai/mcp-servers/{mcp_server_id}/tools
    • Responses add optional tool_approval_statuses (array). Each item contains required tool_id (string) and state (up_to_date, needs_review or not_approved), with optional approval policy and approved-definition fields.

Text to Dialogue

  • Convert text to dialogue, Stream text to dialogue, Convert with timestamps and Stream with timestamps
    • Added optional use_pvc_as_ivc (boolean, default false) to use the Instant Voice Clone version of a Professional Voice Clone.
    • Added optional nullable previous_text and future_text (strings, maximum 100 characters) and previous_request_ids and next_request_ids (string arrays, maximum 3 IDs) for generation continuity.
    • The optional settings object adds nullable similarity (number, 0–1, default 0.75).

Text to Speech

Flows

Voice Design

Workspaces

  • Create service account API key - POST /v1/service-accounts/{service_account_user_id}/api-keys
    • Added optional nullable tts_concurrency_limit, music_concurrency_limit and dubbing_concurrency_limit (integers) for enterprise service account API keys.
  • Update service account API key - PATCH /v1/service-accounts/{service_account_user_id}/api-keys/{api_key_id}
    • Added optional tts_concurrency_limit, music_concurrency_limit and dubbing_concurrency_limit. Each field accepts an integer, clear, no_update or null and defaults to no_update.

Models

  • List models - GET /v1/models
    • Deprecated required max_characters_request_free_user and max_characters_request_subscribed_user. These fields are not enforced; use maximum_text_length_per_request instead.

Bild & Video

  • Sora 2 und Sora 2 Pro eingestellt: OpenAI stellt die Sora API am 24. September 2026 ein. Beide Modelle wurden aus der Modellauswahl für Bild & Video entfernt und generieren ab diesem Datum nicht mehr. Bestehende Generierungen bleiben in Ihrem Verlauf verfügbar. Flows und Templates, die einen Sora-Knoten verwenden, müssen auf ein anderes Videomodell wie Gemini Omni 1.1 Flash umgestellt werden, bevor sie wieder ausgeführt werden können.
  • Seedance 1.5 Pro veraltet: ByteDance stellt Seedance 1.5 Pro am 11. November 2026 ein. Das Modell wird nicht mehr für neue Generierungen angeboten und funktioniert ab diesem Datum nicht mehr. Verwenden Sie stattdessen ein Seedance 2.0-Modell.

ElevenAgents

  • Parallele Tool-Aufrufe: Die Agent-Prompt-Konfiguration enthält jetzt enable_parallel_tool_calls (Boolean, Standardwert true). Wenn aktiviert, können unterstützte Modelle mehrere Tools in einem Zug ausführen.
  • Agent-Modelle: gpt-6-astra zu den Agent-LLM-Optionen hinzugefügt.
  • Benachrichtigungen: Agent-Benachrichtigungen unterstützen jetzt neben PagerDuty und Webhook-Benachrichtigern auch Slack-Kanäle.
  • Telefonnummernsuche: Einen cursor-paginierten Telefonnummern-Endpunkt mit Filtern für Anbieter, Unterstützung für ausgehende Anrufe, zugewiesenen Agent und Branch, Label und Telefonnummer hinzugefügt.

Bild und Video

  • GPT Image 2.5-Modelle: Bildgenerierung unterstützt jetzt gpt-image-2.5-flare und gpt-image-2.5-sunburst. Beide Modelle akzeptieren bis zu 10 Referenzbilder, Qualitätsstufen bis max, 14 feste Seitenverhältnisse sowie auto und eine Ausgabe in 1K, 2K oder 4K.

Speech Engine

  • Cascade-Timeout: Anfragen zum Erstellen und Aktualisieren der Speech Engine akzeptieren jetzt cascade_timeout_seconds (Zahl, 2–15, Standardwert 4), um zu steuern, wie lange ElevenLabs vor einem erneuten Versuch auf eine übergeordnete Speech Engine wartet.

Text to Speech

  • Turn-Grenzen mit mehreren Kontexten: Der Marker is_final_audio_for_turn wird jetzt nach jedem gepufferten Byte für diesen Turn ausgegeben, einschließlich MP3- und Opus-Ausgabe. Clients können den Marker als exakte Turn-Grenze verwenden, ohne zu PCM wechseln zu müssen.

SDK-Releases

JavaScript SDK

  • v2.69.0 - transcriptEdit zum Echtzeit-Speech-to-Text-Wrapper hinzugefügt; bearbeiteter Text wird über edited_transcript-Ereignisse bereitgestellt. JWT-Verifizierung der Speech Engine für API-Keys mit Data-Residency-Suffixen behoben. phoneNumbers.listV2 und Flows-Template-Methoden zum Auflisten und Abrufen von Templates sowie zum Auflisten, Erstellen und Abrufen von Ausführungen hinzugefügt. Clients und Typen für GPT Image 2.5, Slack-Agent-Benachrichtigungen, parallele Tool-Aufrufe, gpt-6-astra, Parallelitätslimits für API-Keys von Servicekonten, Music Zero Retention, Gesprächsfilter und MCP-Tool-Genehmigungsstatus neu generiert.

Python SDK

  • v2.69.0 - transcript_edit zum Echtzeit-Speech-to-Text-Wrapper hinzugefügt; bearbeiteter Text wird über edited_transcript-Ereignisse bereitgestellt. JWT-Verifizierung der Speech Engine für API-Keys mit Data-Residency-Suffixen behoben und play löst jetzt einen Fehler aus, wenn ffplay fehlschlägt. phone_numbers.list_v2 und Flows-Template-Methoden zum Auflisten und Abrufen von Templates sowie zum Auflisten, Erstellen und Abrufen von Ausführungen hinzugefügt. Clients und Typen für GPT Image 2.5, Slack-Agent-Benachrichtigungen, parallele Tool-Aufrufe, gpt-6-astra, Parallelitätslimits für API-Keys von Servicekonten, Music Zero Retention, Gesprächsfilter und MCP-Tool-Genehmigungsstatus neu generiert.

ElevenLabs CLI

  • v1.3.2 - Optionale --intent-Metadaten hinzugefügt, um Feedback zur CLI-Nutzung zu sammeln. elevenlabs feedback missing-capability hinzugefügt, um Workflows zu melden, die die CLI nicht unterstützt.

API

Neue Endpunkte

ElevenAgents

  • Telefonnummernseite auflisten - GET /v1/convai/v2/phone-numbers
    • Optionale Paginierungsparameter page_size (Ganzzahl, 1–1.000, Standardwert 100) und cursor (nullable String) hinzugefügt.
    • Optionale Filter search, label, phone_number, provider, supports_outbound, agent_id, branch_id, sort_by und sort_direction hinzugefügt. sort_by akzeptiert label oder phone_number; sort_direction hat standardmäßig den Wert asc.
    • Die Antwort enthält die erforderlichen phone_numbers (Array), optional nullable next_cursor (String) und has_more (Boolean, Standardwert false).

Aktualisierte Endpunkte

ElevenAgents

  • Agent erstellen, Agent abrufen und Agent aktualisieren
    • Die Prompt-Konfiguration enthält zusätzlich enable_parallel_tool_calls (Boolean, Standardwert true). Workflow-Überschreibungen akzeptieren einen nullable Boolean.
    • Die Aufzählung LLM enthält zusätzlich gpt-6-astra, einschließlich Überschreibungen für die Gesprächsinitiierung.
    • Benachrichtiger für Alerting-Integrationen verwenden jetzt integration_type, um pagerduty oder slack auszuwählen. Slack-Benachrichtiger erfordern connection_id und channel_id (Strings); channel_id akzeptiert 1–64 Zeichen.
  • Unterhaltungen auflisten und Unterhaltungsreferenz auflösen
    • data_collection_params akzeptiert den Operator missing nicht mehr. Verwenden Sie einen leeren Wert, um Unterhaltungen abzugleichen, bei denen das Feld nicht erfasst wurde.
    • Ein leerer Wert in dynamic_variable_params gleicht Unterhaltungen ab, bei denen die Variable nicht gesetzt wurde.
  • Speech Engine erstellen, Speech Engine abrufen und Speech Engine aktualisieren
    • cascade_timeout_seconds (Zahl, 2–15) hinzugefügt. Erstellungsanfragen haben standardmäßig den Wert 4, Aktualisierungsanfragen akzeptieren einen nullable Wert und Antworten erfordern das Feld.

Bild und Video

  • Bildgenerierung erstellen - POST /v1/flows/image
    • Anfragevarianten für gpt-image-2.5-flare und gpt-image-2.5-sunburst hinzugefügt.
    • Beide Varianten erfordern prompt und model_id, akzeptieren bis zu 10 images und enthalten zusätzlich resolution (1K, 2K oder 4K, Standardwert 1K).
    • quality akzeptiert low, medium, high, xhigh oder max und hat standardmäßig den Wert high. aspect_ratio akzeptiert auto und 14 feste Verhältnisse und hat standardmäßig den Wert 16:9.

Synchronisation

Wissensdatenbank

  • Crawl-Job erstellen - POST /v1/convai/knowledge-base/crawl
    • max_depth (Ganzzahl, Standardwert 3) als veraltet markiert. Das Feld hat jetzt keine Wirkung mehr und unterliegt keinen Mindest- oder Höchstgrenzen.
    • Metadaten des Crawl-Jobs erfordern max_depth nicht mehr.

Benutzer

Schemaänderungen

Text to Speech

  • WebSocket-Nachrichten audio und final mit mehreren Kontexten definieren is_final_audio_for_turn jetzt als nach der Übermittlung aller gepufferten Bytes für den Turn auftretend.

ElevenAgents

  • Anrufwarteschlange und Wartemusik: Anrufwarteschlangen für Agents an ihrem Parallelitätslimit hinzugefügt. Wartende Anrufer hören Wartemusik und erhalten queue_status-Ereignisse, bis sie zugelassen werden oder die Zeit abläuft. Neue API-Methoden laden benutzerdefinierte Wartemusik hoch oder löschen sie.
  • Metadaten zu Testversionen: Agent-Testergebnisse zeigen jetzt die Agent-Version, mit der sie ausgeführt wurden, und ob sie Entwurfsänderungen enthielten. Aufrufzusammenfassungen zeigen auch an, wenn teilweise erneute Einreichungen mit anderen Versionen ausgeführt wurden.
  • Modell- und Kontometadaten: Die Agent-LLM-Konfiguration akzeptiert jetzt gemini-3.8-flash. WhatsApp-Kontoantworten geben an, ob das Konto die Cloud API oder den Coexistence-Anmeldeprozess verwendet.

Musik

  • Unterstützung der Music v2.5 API: Musik-Endpunkte und SDKs akzeptieren jetzt music_v2_5. Chunks für Kompositionspläne unterstützen bis zu 6.132 Zeichen, mit bis zu 30 Zeilen à 200 Zeichen.

SDK-Releases

JavaScript SDK

  • v2.68.0 - Methoden zum Hochladen und Löschen von Wartemusik für Agents hinzugefügt. Typen für Anrufwarteschlangen, Prozedurreferenzen, Erstellung von Entwurfs-Branches, RAG-Abfragelimits, Metadaten zu Testversionen, gemini-3.8-flash und music_v2_5 neu generiert.

Python SDK

  • v2.68.0 - Synchrone und asynchrone Methoden zum Hochladen und Löschen von Wartemusik für Agents hinzugefügt. Typen für Anrufwarteschlangen, Prozeduren, Erstellung von Entwurfs-Branches, RAG-Abfragelimits, Metadaten zu Testversionen, gemini-3.8-flash und music_v2_5 neu generiert. Der Wrapper compose_detailed akzeptiert jetzt jede generierte Musikmodell-ID sowie prompt- und chunkbasierte Kompositionspläne.

iOS SDK

  • v3.3.1 - Gleicht Agent-Nachrichten anhand von response_id statt event_id ab. Dadurch bleiben mehrere Antworten bei Tool-Aufrufen erhalten und gestreamte Teile oder Korrekturen werden nicht der falschen Nachricht zugeordnet.

ElevenLabs CLI

  • v1.3.0 - Optionale --intent-Metadaten zu generierten API-Befehlen hinzugefügt. elevenlabs feedback missing-capability hinzugefügt, um Workflows zu melden, die die CLI nicht unterstützt.

Pakete

  • @elevenlabs/convai-widget-core@0.18.2 und @elevenlabs/convai-widget-embed@0.18.2 - Doppelte Agent-Antworten nach Tool- und Prozeduraufrufen behoben. Gestreamte Textantworten behalten die Markdown-Formatierung bei und Sprachunterhaltungen rendern keine nicht gesprochenen gestreamten Chat-Teile mehr. Das Embed-Paket begrenzt user_activity-Ereignisse außerdem auf einmal pro Sekunde und setzt die Begrenzung zurück, wenn eine Sitzung endet.

API

Neue Endpunkte

ElevenAgents

  • Wartemusik für Agent hochladen - POST /v1/convai/agents/{agent_id}/hold-audio
    • Akzeptiert die erforderliche hold_audio_file (binär) als Multipart-Formulardaten. Die Datei muss MP3 oder WAV sein und darf bis zu 40 MB bzw. 180 Sekunden umfassen.
    • Gibt die erforderliche agent_id (String) und hold_audio (AgentHoldAudioConfig) zurück. Das Wartemusik-Objekt erfordert audio_path, audio_url, original_filename (Strings), duration_secs (Zahl) und size_bytes (Ganzzahl).
  • Wartemusik für Agent löschen - DELETE /v1/convai/agents/{agent_id}/hold-audio
    • Entfernt den benutzerdefinierten Clip, sodass wartende Anrufer den Standard-Warteton hören.
    • Gibt die erforderliche agent_id (String) zurück.

Aktualisierte Endpunkte

ElevenAgents

  • Agent erstellen, Agent abrufen und Agent aktualisieren
    • Optionale platform_settings.queueing_config (AgentQueueingConfig) mit enabled (Boolean, Standardwert false) und wait_timeout_seconds (Ganzzahl, 1–1.800, Standardwert 180) hinzugefügt.
    • Antworten zur Warteschlangenkonfiguration enthalten schreibgeschützte nullable hold_audio (AgentHoldAudioConfig). Agent-Antworten enthalten außerdem optional default_hold_audio_url (String).
  • Unterhaltung abrufen - GET /v1/convai/conversations/{conversation_id}
    • Metadaten enthalten zusätzlich optional nullable queue_wait_secs (Zahl). Die Wartezeit wird nicht in call_duration_secs und die abrechenbare Zeit einbezogen.
  • Agent-Branch erstellen - POST /v1/convai/agents/{agent_id}/branches
    • Optionales include_draft (Boolean, Standardwert false) hinzugefügt. Bei true enthält ein vom Branch-Tipp erstellter Branch den Entwurfs-Prozedursatz des Aufrufers.
  • Prozeduren auflisten sowie Endpunkte zum Erstellen, Abrufen und für Entwürfe von Prozeduren
    • Listenelemente enthalten zusätzlich optionale referenced_tool_ids, referenced_kb_ids, referenced_procedure_ids und referenced_dynamic_variables (String-Arrays).
    • Agent- und Merge-Vorschauantworten enthalten zusätzlich optionale procedures, eine nach Prozedur-ID sortierte Map.
  • Testaufrufe auflisten - GET /v1/convai/test-invocations
    • Optionales nullable search (String) hinzugefügt, um Tests und Ordner nach Namen zu filtern.
  • Tests für Agent ausführen und Testaufruf abrufen
    • Antworten für Test-Suite-Aufrufe und Unit-Test-Ausführungen enthalten zusätzlich optional nullable version_id (String) und optional ran_against_draft (Boolean, Standardwert false).
    • Aufrufzusammenfassungen enthalten außerdem optional runs_diverged_from_version (Boolean, Standardwert false).
  • POST /v1/convai/agents/{agent_id}/knowledge-base/rag-query
    • Der Anfragetext enthält zusätzlich optionale nullable, abfragespezifische Überschreibungen für max_documents_length (Ganzzahl, 1–50.000) und max_retrieved_rag_chunks_count (Ganzzahl, 1–20).
  • WhatsApp-Konto abrufen - GET /v1/convai/whatsapp-accounts/{phone_number_id}
    • Optionales account_type (WhatsAppAccountType, Standardwert cloud_api) hinzugefügt. Werte sind cloud_api und coexistence.
  • Erwartete LLM-Nutzung berechnen - POST /v1/convai/agent/{agent_id}/llm-usage/calculate
    • LLMUsageCalculatorLLMResponseModel enthält zusätzlich das erforderliche price_per_message (Zahl).

Musik

  • MusicModelID enthält zusätzlich music_v2_5 für POST /v1/music/video-to-music, POST /v1/music/plan, Musik komponieren, POST /v1/music/detailed, POST /v1/music/detailed/stream, POST /v1/music/stream, POST /v1/music/upload und POST /v1/music/finetunes.
  • GenerationChunk.text erhöht maxLength von 6.000 auf 6.132 Zeichen für POST /v1/music/plan, POST /v1/music, POST /v1/music/detailed, POST /v1/music/detailed/stream, POST /v1/music/stream und POST /v1/music/upload. Abschnittsnamen können 1–100 Zeichen enthalten und Chunks können bis zu 30 Zeilen mit jeweils 200 Zeichen enthalten.

Schemaänderungen

ElevenAgents

  • Echtzeit-Serverereignisse enthalten zusätzlich queue_status. Das erforderliche queue_status_event.status akzeptiert waiting, admitted oder timed_out; timed_out geht dem WebSocket-Schließcode 4300 voraus. Wartemusik trifft weiterhin als reguläre audio-Ereignisse ein.
  • Die Aufzählung LLM enthält zusätzlich gemini-3.8-flash, einschließlich Überschreibungen für die Gesprächsinitiierung.
  • Vereinigungen für System-Tool-Ergebnisse von Unterhaltungen enthalten zusätzlich start_procedure_success, start_procedure_error, end_procedure_success und end_procedure_error.
  • FeaturesUsageCommonModel enthält zusätzlich optionale Feature-Status für freeform_procedure und structured_procedure.

Scribe v2 Medical

Scribe v2 Medical ist jetzt allgemein verfügbar. Es ist ein Batch-Spracherkennungsmodell für medizinische und klinische Audiodaten, das zum gleichen Preis wie Scribe v2 abgerechnet wird.

Übergeben Sie scribe_v2_medical als model_id bei Transkript erstellen. Keyterm-Prompting, Entitätserkennung, Sprecherdiarisierung und der No-verbatim-Modus funktionieren wie bei Scribe v2.


ElevenAgents

  • Gesprächs-Tickets für den gesamten Workspace: Workspace-Tickets auflisten hinzugefügt, um Gesprächs-Triage-Tickets aller zugänglichen Agenten abzurufen. Filtern Sie nach Status oder Bearbeiter und verwenden Sie Cursor-Paginierung, um bis zu 100 Tickets pro Seite abzurufen.
  • Gesprächsfilter für dynamische Variablen: Gespräche auflisten und Gesprächsnachrichten per Text durchsuchen akzeptieren jetzt wiederholbare Filter dynamic_variable_params. Verwenden Sie name:op:value mit eq, gt, gte, lt oder lte; Vergleichsoperatoren erfordern numerische Werte.
  • Twilio-Anrufbeantwortererkennung: Konfigurationen für ausgehende Telefonie und Batch-Anrufe unterstützen jetzt optional twilio_machine_detection. Wählen Sie enable für eine frühe Entscheidung Mensch oder Maschine oder detect_message_end, um auf das Ende einer Mailboxansage zu warten. Ergebnisse werden über das neue Webhook-Ereignis answering_machine_detection bereitgestellt.
  • Wertbeschränkungen bei der Datenerfassung: Datenerfassungseigenschaften können jetzt allowed_values verwenden, um eine dynamische Variable mit den zulässigen Werten zu benennen. Das bisherige Feld allowed_values_dynamic_variable ist veraltet.
  • Agentenmetadaten: Antworten von Agentenzweige auflisten zeigen jetzt an, wann ein Entwurf erstellt wurde und ob er älter als die Spitze des Zweigs ist. Agenten- und Speech-Engine-Zusammenfassungen erfordern jetzt voice_id.
  • Quell-URLs der Wissensdatenbank: Agent-RAG-Abfrage-Chunks enthalten jetzt das erforderliche nullable source_url mit der nachverfolgten URL für URL-Dokumente.
  • Anhänge in Agentenantworten: WebSocket-Ereignisse agent_response enthalten jetzt optionale attachments. Jeder Anhang erfordert url und name und kann mime_type enthalten.

Workspaces

  • Plattformlimits für API-Schlüssel: Antworten für API-Schlüssel von Servicekonten können jetzt Enterprise-platform_limits für Credits, Professional Voice Clones sowie TTS-, Synchronisations- und Musik-Parallelität enthalten.

SDK-Releases

JavaScript SDK

  • v2.67.0 - dynamicVariableParams zu Anfragen für Gesprächslisten und Textsuche hinzugefügt. Typen für Twilio-Anrufbeantwortererkennung, Wertbeschränkungen bei der Datenerfassung, Plattformlimits für API-Schlüssel, Entwurfsmetadaten von Agentenzweigen und Quell-URLs der Wissensdatenbank neu generiert.

Python SDK

  • v2.67.0 - dynamic_variable_params zu synchronen und asynchronen Methoden für Gesprächslisten und Textsuche hinzugefügt. Typen für Twilio-Anrufbeantwortererkennung, Wertbeschränkungen bei der Datenerfassung, Plattformlimits für API-Schlüssel, Entwurfsmetadaten von Agentenzweigen und Quell-URLs der Wissensdatenbank neu generiert. Der Echtzeit-Text-to-Speech-Client übergibt das interne Omit-Sentinel nicht mehr an die Verbindung.

ElevenLabs CLI

  • v1.2.0 - Den Befehl elevenlabs say und dessen Agenten-Skill hinzugefügt, API-Befehlsbindungen neu generiert und eleven_v3 zum Standard-TTS-Modell gemacht.

Pakete

API

Neue Endpunkte

ElevenAgents

  • Workspace-Tickets auflisten - GET /v1/convai/triage-tickets
    • Listet Gesprächs-Triage-Tickets aller Agenten auf, auf die der Aufrufer Zugriff hat, sortiert nach den zuletzt erstellten zuerst.
    • Optionale Abfrageparameter page_size (Integer, 1–100, Standard 100), status (AgentConversationTicketStatus), assignee_user_id (String oder unassigned) und cursor (String) hinzugefügt.
    • Gibt GetAgentConversationTicketsPageResponseModel zurück.

Aktualisierte Endpunkte

ElevenAgents

  • Gespräche auflisten - GET /v1/convai/conversations
    • Optionales nullable dynamic_variable_params (wiederholbares String-Array) hinzugefügt. Jeder Wert verwendet name:op:value, wobei op eq, gt, gte, lt oder lte ist.
  • Gesprächsnachrichten per Text durchsuchen - GET /v1/convai/conversations/messages/text-search
    • Optionales nullable dynamic_variable_params (wiederholbares String-Array) mit derselben Syntax hinzugefügt.
  • Ausgehender Twilio-Anruf, ausgehender SIP-Trunk-Anruf, ausgehender Exotel-Anruf und Batch-Anrufe übermitteln
    • telephony_call_config verwendet jetzt separate Eingabe- und Ausgabeschemas.
    • Optionales nullable twilio_machine_detection (TwilioMachineDetectionConfig) hinzugefügt. Der Modus mode akzeptiert enable oder detect_message_end und hat standardmäßig den Wert enable. Die Einstellung wird für Nicht-Twilio-Anbieter und eingehende Anrufe ignoriert.
  • Telefonnummer importieren - POST /v1/convai/phone-numbers
    • Optionales nullable account_auth_token (String) für Importe von Twilio-API-Schlüsseln hinzugefügt, um Signaturen eingehender Webhooks zu validieren.

Schemaänderungen

ElevenAgents

  • WebhookEventType enthält jetzt answering_machine_detection.
  • AgentBranchSummary enthält jetzt optionales nullable draft_created_at (Integer) und optionales draft_is_behind_tip (Boolean, Standard false).
  • AgentKnowledgeBaseRagChunkResponseModel enthält jetzt das erforderliche nullable source_url (String).
  • AgentSummaryResponseModel und SpeechEngineSummaryResponse enthalten jetzt das erforderliche voice_id (String).
  • AnalysisProperty enthält jetzt optionales nullable name (String) und allowed_values (AllowedValues). LiteralJsonSchemaProperty enthält jetzt ebenfalls allowed_values. Beide verwerfen allowed_values_dynamic_variable.
  • DataCollectionResultCommonModel enthält jetzt optionales nullable name (String).
  • WorkspaceApiKeyResponseModel enthält jetzt optionales nullable platform_limits (PlatformLimits).
  • MCP-Tool Icon enthält jetzt optionales nullable theme (light oder dark).
  • SMBToolConfig enthält jetzt die Parametervarianten send_custom_email, create_service_quote_request und create_product_quote_request.
  • Webhook-Abfrageparameterschemas und die Telefonie-Anrufkonfiguration verwenden jetzt separate Eingabe- und Ausgabemodelle.
  • WebSocket-Ereignisse agent_response enthalten jetzt optionale attachments (Array). Jedes Element erfordert url und name (Strings) und akzeptiert optionales mime_type (String).

ElevenCreative

  • ReferenceVideo.studio_clip verwendet jetzt StudioClipLocator statt StudioClipReference. Die Felder und das Wire-Format bleiben unverändert.