Add Langfuse to your AI agent
Open source LLM engineering platform. Traces, evals, prompt management and metrics to debug and improve your LLM application.
- Things your agent can do in Langfuse
- 62
Things your AI can do in Langfuse
Your FormWise AI can handle any of these in Langfuse — on its own, without you needing to click a button.
Add Annotation Queue Item
Add a trace, observation, or session to a Langfuse annotation queue by queue ID and object ID. Optionally set the item's annotation status.
Assign Annotation Queue User
Assign a user to a Langfuse annotation queue by queue ID and user ID. Returns the user, queue, and project IDs for the created assignment.
Check Health
Check the health of the Langfuse API and database. Returns the server version and health status.
Create annotation queue
Create an annotation queue in the authenticated Langfuse project for human evaluation, using the supplied score configuration IDs. Returns the created queue and its ID.
Create comment
Create a comment on an existing Langfuse trace, observation, session, or prompt in the specified project. Supports Markdown content and an optional author who belongs to the project's organization. Returns the created comment ID.
Create Dataset
Create a dataset in the connected Langfuse project, optionally with a description, metadata, and JSON Schemas for item inputs and expected outputs. This creates the dataset container; add dataset items separately.
Create Dataset Item
Create a Langfuse dataset item with input, expected output, and metadata. Providing an existing item ID updates that item in the same dataset.
Create Evaluation Rule
Create a Langfuse evaluation rule for incoming observations, using stable evaluator IDs and their latest versions. Explicitly choose enabled: true starts automatic evaluations and may incur model costs; false creates a disabled draft. Omitted filters match all observations and omitted sampling evaluates every match. Rule names need not be unique.
Create evaluator
Create a version-1 evaluator in the authenticated Langfuse project. Choose llm_as_judge with a prompt and structured score output, or code with source code and runtime language. Names need not be unique. An evaluator defines how to score data; evaluation rules separately determine which data to evaluate.
Create media upload URL
Obtain a presigned upload URL and media ID for Langfuse media associated with either a trace (optionally an observation) or a dataset item. Requires the media MIME type, byte length, SHA-256 hash, and containing field. Only requests the URL; does not upload a file. The URL can be null if already uploaded.
Create model
Create a custom Langfuse model definition for usage-to-USD cost calculation and optional tokenization. Supply a model name, matching regex, usage unit, and either pricing tiers (recommended) or legacy flat prices. Each tiered model needs exactly one default tier with priority 0 and no conditions.
Create Prompt
Create a new version of a named Langfuse text or chat prompt. Chat prompts require type='chat' and support messages and named placeholders. Optionally attach arbitrary JSON configuration, deployment labels, tags, and a commit message.
Show 50 more things it can do
Create Score
Attach an evaluation score to exactly one Langfuse trace, session, or dataset run, optionally narrowing a trace score to an observation.
Create score config
Create a score configuration in the authenticated Langfuse project to define numeric bounds, categorical label/value pairs, boolean scores, or text scores. Boolean categories are autogenerated; omit categories for BOOLEAN configs. Use the returned config ID when creating scores validated against this configuration.
Delete Dataset Item
Delete a Langfuse dataset item by its ID and all its run items. This action is irreversible.
Delete Evaluation Rule
Delete a Langfuse evaluation rule by its stable ID, including legacy trace and dataset rules. This removes the live-ingestion rule only; associated evaluators and previously produced scores are preserved.
Delete Evaluator
Delete a Langfuse evaluator and all of its stored versions by its stable ID. Associated evaluation-rule assignments are also removed. Scores already produced by the evaluator are preserved.
Delete LLM Connection
Delete a Langfuse LLM connection by its ID. Evaluators that depend on the deleted connection are automatically paused.
Delete Model
Delete a project-owned Langfuse model by its ID. Models managed by Langfuse cannot be deleted; create your own definition with the same modelName to override a managed definition instead. Returns an empty response on success.
Delete Prompt
Delete Langfuse prompt versions by prompt name. Optionally filter deletion by label or version. If neither label nor version is specified, all versions of the prompt are deleted. Returns an empty response on success.
Delete Score
Delete a Langfuse score by its ID. Supports both trace and session scores. Returns an empty response on success.
Delete Trace
Delete a specific Langfuse trace by its unique trace ID.
Delete Traces
Delete multiple Langfuse traces by their trace IDs.
Get Annotation Queue Item
Get a specific item from a Langfuse annotation queue by queue ID and queue item ID. Returns the associated object, annotation status, and timestamps.
Get comment
Retrieve one comment by its unique Langfuse ID in the authenticated project. Returns the comment content, associated object type and ID, timestamps, and author user ID when available.
Get Dataset
Retrieve a Langfuse dataset by name, including its metadata and JSON Schemas for dataset item inputs and expected outputs.
Get Dataset Item
Retrieve a single Langfuse dataset item by its ID, including its input, expected output, metadata, source IDs, and resolved media references.
Get Evaluation Rule
Get one Langfuse evaluation rule by its stable identifier, including legacy trace or dataset rules. Returns its enabled state, sampling, stored filters, evaluator assignments, variable mappings, creator, and timestamps.
Get evaluator
Get one evaluator by its stable identifier in the authenticated Langfuse project. Returns its latest definition, version metadata, effective runtime status, and associated evaluation-rule assignments. Use version history for older definitions.
Get media
Retrieve one media record by its unique Langfuse ID in the authenticated project. Returns the MIME type, size in bytes, upload timestamp, and download URL with its expiry. Does not download the media content.
Get model
Retrieve one Langfuse-managed or project-custom model definition by ID. Returns model matching rules, tokenizer configuration, usage unit, legacy prices, and conditional pricing tiers used for cost calculation.
Get Project
Get the project associated with the connected project-scoped API key, returned in a data list with its organization, metadata, and retention configuration. No project ID is required. To get all projects using an organization-scoped API key, use the provider's organization API separately.
Get Prompt
Retrieve a Langfuse text or chat prompt by name, optionally selecting a deployment label or exact version and resolving dependencies.
Get score configuration
Retrieve one score configuration by ID in the authenticated Langfuse project. Returns its score data type, numeric bounds, categorical labels, description, timestamps, and archive status.
Ingest Traces
Export OpenTelemetry traces to Langfuse using OTLP HTTP/JSON with real-time v4 ingestion. Supply resourceSpans containing scopeSpans and spans. Acceptance is asynchronous. Inspect partialSuccess: HTTP 200 can include rejected spans or warnings; do not retry partially accepted batches. This action supports JSON, not binary protobuf or gzip.
List Annotation Queue Items
List one page of items in a Langfuse annotation queue, optionally filtered by PENDING or COMPLETED status. Increment page while meta.page is less than meta.totalPages to retrieve subsequent pages.
List Annotation Queues
List annotation queues configured for human evaluation in the connected Langfuse project.
List comments
List one page of comments in the authenticated Langfuse project. Optionally filter by object type, object ID, or author user ID. Filtering by object ID requires objectType. To retrieve another page, increment page while page is less than meta.totalPages.
List Dataset Items
List dataset items, optionally scoped to a dataset, source trace or observation, or historical dataset version.
List Datasets
List datasets available to the connected Langfuse project.
List evaluation rules
List one page of evaluation rules in the authenticated Langfuse project, newest creation first. Includes legacy trace and dataset rules for inspection and migration, with stored filters and evaluator assignments. Pass meta.cursor unchanged as cursor to retrieve the next page; an absent or null cursor means there are no more pages.
List evaluator versions
List one page of an evaluator's version history, newest first, for history and audit use cases. Returns each version's definition and creator metadata. Pass meta.cursor unchanged as cursor for the next page; an absent or null cursor means there are no more pages. For only the latest definition, use Get evaluator.
List evaluators
List one page of evaluators in the authenticated Langfuse project, newest creation first. Each evaluator includes its latest definition, version metadata and evaluation-rule assignments. Pass meta.cursor unchanged as cursor to retrieve the next page; an absent or null cursor means there are no more pages.
List Experiment Items
List Langfuse experiment items started on or after a required datetime, ordered by time descending. Export inputs, outputs, expected outputs, metadata, and optional item/trace scores by selecting field groups. Returns one page; pass meta.cursor with the same filters to fetch the next.
List Experiments
List Langfuse experiments active from a required start time, optionally specifying an end time and including metadata and directly attached scores.
List LLM connections
List one page of LLM provider connections in the authenticated Langfuse project, including model configuration and masked secrets. To retrieve another page, increment page while page is less than meta.totalPages.
List Models
List Langfuse-managed and project-custom model pricing definitions used for usage and cost calculation.
List Observations
Search Langfuse observations such as generations, spans, events, agents, and tool calls, selecting only the field groups needed.
List prompts
List one page of prompt names, types, versions, labels, tags and latest matching configuration in the authenticated Langfuse project. Optionally filter by name, label, tag, update dates or advanced JSON conditions. Returns metadata rather than prompt content; use Get Prompt to retrieve a template. Increment page while meta.page is less than meta.totalPages to retrieve subsequent pages.
List score configurations
List one page of score configurations in the authenticated Langfuse project, including score types, numeric bounds, categorical labels, and archive status. To retrieve another page, increment page while page is less than meta.totalPages.
List Scores
Search numeric, boolean, categorical, text, and correction scores with subject and annotation context.
Query Metrics
Run an aggregate Langfuse metrics query over observations or numeric, boolean, or categorical scores.
Remove Annotation Queue Assignment
Remove a user's assignment to a Langfuse annotation queue by queue ID and user ID. Returns whether the assignment was removed.
Remove Annotation Queue Item
Remove an item from a Langfuse annotation queue using the queue ID and annotation queue item ID.
Submit feedback
Submit feedback to Langfuse about its skills, MCP tools, CLI, docs, or public API. Only call after the user has explicitly approved the feedback content for submission; any supplied goal must also be user-approved. Do not include secrets, credentials, customer data, trace payloads, or unrelated use-case details. Not available in the HIPAA cloud region. Returns a feedback correlation ID.
Update Annotation Queue Item
Update a Langfuse annotation queue item's status to PENDING or COMPLETED using its queue ID and item ID. Returns the updated queue item.
Update Evaluation Rule
Update a Langfuse evaluation rule by its stable ID. Supply only fields to change; explicit nulls are forwarded. Filters and evaluator assignments replace their complete lists. An empty assignment list disables the rule; enabling requires a nonempty resulting list and may incur model costs. Legacy trace and dataset rules only allow deactivation with enabled=false; their name, filters, sampling, and assignments cannot change.
Update evaluator
Update a Langfuse evaluator by stable identifier. Supply name or description for a metadata-only change without creating a version. To replace a definition, include type and all required definition fields; definitions are replaced, not merged. The evaluator type cannot change. Null description clears it; null or omitted modelConfig selects the project default model. Definition replacement may reactivate evaluators paused for invalid or missing model configuration; other pause reasons require an explicit reactivation check.
Update media
Update an existing Langfuse media record with its upload timestamp and HTTP status, and optionally the upload error message and elapsed time. This records the upload result; it does not upload media content. Omitted optional fields are not sent; explicitly supplied null values are forwarded. Returns an empty response on success.
Update Prompt Labels
Update deployment labels for a specific Langfuse prompt version by name and version. Labels are unique across versions of a prompt; the latest label is reserved and managed by Langfuse. Returns the updated text or chat prompt version.
Update score config
Update an existing Langfuse score configuration by config ID. Change its name, description, archive status, numerical bounds, or categorical label/value pairs. Omitted fields are not sent; explicitly supplied null values are forwarded. Boolean categories are autogenerated and cannot be passed. Returns the updated configuration.
Upsert Model
Create or replace a project-owned Langfuse model definition by ID for usage cost calculation and optional tokenization. Built-in models cannot be modified. This replaces the model definition; supply its desired configuration.
Built for the way you actually work
No code, no engineers
Connect in a few clicks and start using your AI right away. If you can use the apps you already love, you can do this.
Sounds like you, not like a bot
Train your AI on your offer, your voice, and the way you actually talk to clients — it picks up where you leave off.
Plugs into the stack you already use
No need to rip out your CRM, your scheduler, or your email tool. Your AI works inside the apps running your business today.
Your data stays yours
Client conversations, lists, and credentials are scoped to your workspace. Nothing gets shared, sold, or used to train anyone else’s AI.
What you can do once Langfuse is connected
Onboard new clients without lifting a finger
When someone signs up, your AI greets them, sets up their next step in Langfuse, and keeps the momentum going — even at 2am.
Reply to leads in seconds, not days
Your AI watches Langfuse for new inquiries, answers questions in your voice, and books the call before they cool off.
Get your weekends back
Hand off the repetitive Langfuse work — follow-ups, reminders, updates, simple admin — and stop being the bottleneck in your own business.
How to connect Langfuse to your agent
- 1
Start using FormWise for free
Sign up in under a minute.
- 2
Find Langfuse in your connected apps
Inside FormWise, open Connectors and look for Langfuse.
- 3
Hit "Connect"
Click "Connect Langfuse" and log in like you normally would. We only ask for the permissions your AI actually needs.
- 4
Tell your AI what to do in Langfuse
Build a quick AI Agent (it's like writing instructions, not code), and pick the Langfuse actions you want your AI to handle.
- 5
Watch it run
Send it a real-world task and watch your AI take care of Langfuse for you. Tweak the wording until it feels just right.
Powered by the AI you already trust
Your Langfuse workflow runs on the same world-class AI used by ChatGPT, Claude, and Gemini. We handle the technical part — you just tell your AI what to do, in plain English.
- OpenAI
- Anthropic Claude
- Google Gemini
Questions other Langfuse users had before signing up
Do I need to know how to code?
Not even a little. If you can use Langfuse today, you can set this up. You'll connect Langfuse, tell your AI what it should help with, and you're live. The whole thing is built for coaches, course creators, agencies, and operators — not engineers.
Will my clients know they're talking to an AI?
Only if you want them to. Your FormWise AI is trained on your voice, your offer, and the way you actually communicate — so it sounds like a thoughtful team member, not a clunky chatbot. Most people can't tell.
Can I make it sound like me?
Yes. You can give your AI examples of how you write, the questions you usually ask new clients, the way you handle objections, and the language you use about your offer. The more you give it, the more it sounds like you wrote it.
What if I want to take over a conversation?
You're always in control. You can step in at any point, take over from your AI, or stop it from sending messages until you've reviewed them. Think of it as a teammate, not a replacement.
Is my client data safe?
Yes. Your Langfuse login and client information stay scoped to your workspace. We don't sell it, we don't share it, and we don't use your data to train anyone else's AI. You can disconnect Langfuse or delete everything any time.
What happens when Langfuse updates their app?
We handle it. When Langfuse adds new features or changes how something works, we update the integration in the background. You don't have to do anything — your AI just keeps working.
How fast can I actually get this running?
Most people are up and running the same day they sign up. Connecting Langfuse takes a few minutes. Teaching your AI to handle the work the way you'd want it done is the part worth slowing down for.
What is FormWise?
FormWise is the AI agent builder for coaches, course creators, and agencies. You connect the apps you already use — like Langfuse — train your AI on your offer and voice, and let it handle the work you've been doing manually: onboarding, follow-ups, support, admin. No code, no developers, no engineering team required.
Can I sell AI agents to my clients?
Yes. A lot of FormWise users build AI assistants and sell them as part of their offer — done-for-you AI setups, white-label assistants for client businesses, custom GPTs trained on a client's brand. You can charge a setup fee, a monthly retainer, or both.
Can I embed my AI on my website or in my course?
Yes. Every AI you build in FormWise can be embedded on your site, dropped into your course platform, or shared as a standalone link. Your clients and students just open it like any other web page — no app to download, no login hoops.
Do I need to know anything about AI to use this?
No. If you can describe what you want your AI to do in plain English — "greet new clients, ask these 3 questions, book them a call" — FormWise can build it. We handle the models, the prompts, the connections. You handle the part you already know: what your business actually needs.
About Langfuse on FormWise
Open source LLM engineering platform. Traces, evals, prompt management and metrics to debug and improve your LLM application.
Connect Langfuse once and your FormWise AI gets 62 things it can do inside it. That means your AI can handle the Langfuse work in your business — the messages, the updates, the follow-ups, the admin — the way you would, just faster and around the clock.
You don't need to know how any of it works under the hood. We take care of keeping the connection alive, retrying if something fails, and making sure your data only ever moves where you tell it to.
New to Langfuse? Take a look at langfuse.com.
More Developer Tools integrations
Infisical
Infisical is a secrets management platform; this integration supports delegated read-only OAuth access and machine identity Token Auth in Infisical US Cloud.
GitHub
GitHub is a code hosting platform for version control and collaboration, offering Git-based repository management, issue tracking, and continuous integration features
Azure DevOps
Azure DevOps provides developer services for allowing teams to plan work, collaborate on code development, and build and deploy applications.
TikHub
Read supported social and TikHub metadata routes with one TikHub API key. Routes requiring platform cookies, proxies, logins, sessions, device identities, fingerprints, or signatures are excluded.
MongoDB
Administer MongoDB Atlas organizations, projects, clusters, users, networking, backups, and related cloud resources with an Atlas OAuth service account.
GetAnyAPI
GetAnyAPI is an independent API aggregation marketplace at getanyapi.com for discovering and running normalized data APIs. It is not officially affiliated with the source platforms whose public data may be available through its marketplace.
Stop doing the Langfuse work yourself
Hand it off to an AI assistant that sounds like you, works around the clock, and never forgets a follow-up. Free to start.
