Honeyhive
honeyhiveHoneyHive is a modern AI observability and evaluation platform that enables developers and domain experts to collaboratively build reliable AI applications faster.
Acciones disponibles (24)
Cada acción es una operación que el agente puede ejecutar contra este conector. Haz clic en una acción para ver sus parámetros.
Add datapoints to datasetHONEYHIVE_ADD_DATAPOINTS_TO_DATASETAcciónTool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.
HONEYHIVE_ADD_DATAPOINTS_TO_DATASETAcciónTool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.
Parámetros de entrada
dataobject[]ObligatorioList of JSON objects representing datapoints to add
mappingobjectObligatorioMapping of data fields to inputs, ground truth, and history
projectstringObligatorioProject name associated with the dataset
dataset_idstringObligatorioDataset identifier to which datapoints will be added
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Create Batch Model EventsHONEYHIVE_CREATE_BATCH_MODEL_EVENTSAcciónTool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.
HONEYHIVE_CREATE_BATCH_MODEL_EVENTSAcciónTool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.
Parámetros de entrada
model_eventsobject[]ObligatorioArray of model event objects to create
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Create Batch Tool EventsHONEYHIVE_CREATE_BATCH_TOOL_EVENTSAcciónTool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.
HONEYHIVE_CREATE_BATCH_TOOL_EVENTSAcciónTool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.
Parámetros de entrada
eventsobject[]ObligatorioArray of tool event objects to create
is_single_sessionbooleanIf true, all events in the batch are associated with the same session. Defaults to false.
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Create DatasetHONEYHIVE_CREATE_DATASETAcciónTool to create a dataset. Use when you need to initialize a new dataset within a project.
HONEYHIVE_CREATE_DATASETAcciónTool to create a dataset. Use when you need to initialize a new dataset within a project.
Parámetros de entrada
namestringObligatorioName of the dataset
typestringenumWhat the dataset is used for
evaluationfine-tuningsavedbooleanFlag indicating if the dataset is saved
projectstringObligatorioName of the project associated with this dataset
metadataobjectAny helpful metadata to track for the dataset
datapointsstring[]List of unique datapoint IDs to include in the dataset
descriptionstringA description for the dataset
linked_evalsstring[]List of unique evaluation run IDs to associate with the dataset
pipeline_typestringenumType of data pipeline
eventsession
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Create ToolHONEYHIVE_CREATE_TOOLAcciónTool to create a new tool. Use when you need to register a new function or plugin for invocation.
HONEYHIVE_CREATE_TOOLAcciónTool to create a new tool. Use when you need to register a new function or plugin for invocation.
Parámetros de entrada
namestringObligatorioHuman-readable name of the tool.
taskstringObligatorioName of the project associated with this tool.
typestringObligatorioenumType of the tool; must be either 'function' or 'tool'.
functiontoolparametersobjectObligatorioJSON schema defining the tool's callable parameters.
descriptionstringOptional detailed description of the tool's purpose.
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Delete DatapointHONEYHIVE_DELETE_DATAPOINTAcciónTool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.
HONEYHIVE_DELETE_DATAPOINTAcciónTool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.
Parámetros de entrada
idstringObligatorioDatapoint ID to delete (24-character hexadecimal string)
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Delete DatasetHONEYHIVE_DELETE_DATASETAcciónTool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.
HONEYHIVE_DELETE_DATASETAcciónTool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.
Parámetros de entrada
dataset_idstringObligatorioUnique identifier of the dataset to delete
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
End Evaluation RunHONEYHIVE_END_EVALUATION_RUNAcciónTool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed.
HONEYHIVE_END_EVALUATION_RUNAcciónTool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed.
Parámetros de entrada
namestringDisplay name for the evaluation run
run_idstringObligatorioUnique identifier of the evaluation run to update
statusstringObligatorioenumMust be set to 'completed' to mark the run as finished
pendingcompletedmetadataobjectArbitrary metadata fields to attach to the run
event_idsstring[]List of session/event UUIDs to associate with this run
dataset_idstringThe UUID of the dataset this run is associated with
configurationobjectConfiguration parameters used in this run
datapoint_idsstring[]List of datapoint UUIDs to associate with this run
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Get ConfigurationsHONEYHIVE_GET_CONFIGURATIONSAcciónTool to retrieve a list of configurations. Use when you need to fetch all configurations for a specific project before making changes.
HONEYHIVE_GET_CONFIGURATIONSAcciónTool to retrieve a list of configurations. Use when you need to fetch all configurations for a specific project before making changes.
Parámetros de entrada
envstringenumEnvironment to filter by. Allowed values: dev, staging, prod.
devstagingprodnamestringThe name of the configuration to filter by, e.g. 'v0'.
projectstringObligatorioProject name for configuration like 'Example Project'.
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Get DatasetsHONEYHIVE_GET_DATASETSAcciónTool to retrieve a list of datasets. Use when you need to fetch datasets for a specific project with optional filters.
HONEYHIVE_GET_DATASETSAcciónTool to retrieve a list of datasets. Use when you need to fetch datasets for a specific project with optional filters.
Parámetros de entrada
typestringenumDataset type filter. Allowed: 'evaluation', 'fine-tuning'
evaluationfine-tuningprojectstringObligatorioProject name associated with the datasets
dataset_idstringUnique dataset ID to filter a specific dataset
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Get MetricsHONEYHIVE_GET_METRICSAcciónTool to retrieve all metrics. Use when you need to list metrics for a specific project, after obtaining project context.
HONEYHIVE_GET_METRICSAcciónTool to retrieve all metrics. Use when you need to list metrics for a specific project, after obtaining project context.
Parámetros de entrada
project_namestringObligatorioProject name associated with metrics
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Get ProjectsHONEYHIVE_GET_PROJECTSAcciónTool to retrieve projects. Use when you need to list all available projects.
HONEYHIVE_GET_PROJECTSAcciónTool to retrieve projects. Use when you need to list all available projects.
Parámetros de entrada
namestringOptional filter to return only projects whose name contains this string
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
List ToolsHONEYHIVE_LIST_TOOLSAcciónTool to list all available Honeyhive tools. Use when you need to discover which functions or plugins are registered for use.
HONEYHIVE_LIST_TOOLSAcciónTool to list all available Honeyhive tools. Use when you need to discover which functions or plugins are registered for use.
Parámetros de entrada
pageintegerPage number for paginated results
limitintegerMaximum number of tools to return per page
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Retrieve DatapointHONEYHIVE_RETRIEVE_DATAPOINTAcciónTool to retrieve a specific datapoint by its ID. Use when you have a datapoint ID and need its full details.
HONEYHIVE_RETRIEVE_DATAPOINTAcciónTool to retrieve a specific datapoint by its ID. Use when you have a datapoint ID and need its full details.
Parámetros de entrada
idstringObligatorioDatapoint ID to retrieve (string identifier)
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Retrieve DatapointsHONEYHIVE_RETRIEVE_DATAPOINTSAcciónTool to retrieve a list of datapoints. Use when you need to fetch datapoints for a project with optional filters.
HONEYHIVE_RETRIEVE_DATAPOINTSAcciónTool to retrieve a list of datapoints. Use when you need to fetch datapoints for a project with optional filters.
Parámetros de entrada
projectstringObligatorioProject name to filter datapoints.
dataset_namestringOptional name of the dataset to filter datapoints.
datapoint_idsstring[]Optional list of datapoint IDs to retrieve.
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Retrieve EventsHONEYHIVE_RETRIEVE_EVENTSAcciónTool to retrieve events by filters. Use when you need to export events based on filter criteria, date range, and pagination.
HONEYHIVE_RETRIEVE_EVENTSAcciónTool to retrieve events by filters. Use when you need to export events based on filter criteria, date range, and pagination.
Parámetros de entrada
pageintegerPage number for pagination (default 1)
limitintegerLimit number of events returned (default 1000; max 7500)
filtersobject[]ObligatorioArray of filter objects to narrow results
projectstringObligatorioName of the project to query
dateRangeobjectDate range filter for events, using ISO 8601 timestamps.
projectionsstring[]Fields to include in the response
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Retrieve Experiment ResultHONEYHIVE_RETRIEVE_EXPERIMENT_RESULTAcciónTool to retrieve the result of a specific experiment run. Use when you need the status, metrics, and datapoint-level details of a completed experiment.
HONEYHIVE_RETRIEVE_EXPERIMENT_RESULTAcciónTool to retrieve the result of a specific experiment run. Use when you need the status, metrics, and datapoint-level details of a completed experiment.
Parámetros de entrada
run_idstringObligatorioUnique identifier of the experiment run
project_idstringObligatorioUnique identifier of the project this run belongs to
aggregate_functionstringenumOptional aggregation function for metrics. Allowed: average, min, max, median, p95, p99, p90, sum, count
averageminmaxmedianp95p99p90sumcount
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Start Evaluation RunHONEYHIVE_START_EVALUATION_RUNAcciónTool to initiate an evaluation run using external datasets. Use after selecting a project and events; optionally link a dataset.
HONEYHIVE_START_EVALUATION_RUNAcciónTool to initiate an evaluation run using external datasets. Use after selecting a project and events; optionally link a dataset.
Parámetros de entrada
namestringObligatorioName of the evaluation run to be displayed
statusstringenumStatus of the run; allowed: 'pending', 'completed'
pendingcompletedprojectstringObligatorioUUID of the project this run is associated with
metadataobjectAdditional metadata for the run
event_idsstring[]ObligatorioUUIDs of the sessions/events this run is associated with
dataset_idstringUUID of the dataset associated with this run
configurationobjectConfiguration used for this run
datapoint_idsstring[]UUIDs of datapoints from the original dataset linked to this run
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Start SessionHONEYHIVE_START_SESSIONAcciónTool to start a new session. Use when you need to initiate a new tracking session and retrieve its session_id.
HONEYHIVE_START_SESSIONAcciónTool to start a new session. Use when you need to initiate a new tracking session and retrieve its session_id.
Parámetros de entrada
sessionobjectObligatorioSession metadata payload
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Update DatapointHONEYHIVE_UPDATE_DATAPOINTAcciónTool to update a specific datapoint. Use when you need to modify fields of an existing datapoint.
HONEYHIVE_UPDATE_DATAPOINTAcciónTool to update a specific datapoint. Use when you need to modify fields of an existing datapoint.
Parámetros de entrada
idstringObligatorioDatapoint ID to update (string)
inputsobjectArbitrary JSON object containing the inputs for the datapoint
historyobject[]Conversation history associated with the datapoint
metadataobjectAdditional metadata for the datapoint
ground_truthobjectExpected output JSON object for the datapoint
linked_evalsstring[]IDs of evaluations where the datapoint is included
linked_datasetsstring[]IDs of datasets that include the datapoint
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Update DatasetHONEYHIVE_UPDATE_DATASETAcciónTool to update an existing dataset. Use when you need to modify a dataset's details (name, description, datapoints, linked evaluations, or metadata) after confirming its ID.
HONEYHIVE_UPDATE_DATASETAcciónTool to update an existing dataset. Use when you need to modify a dataset's details (name, description, datapoints, linked evaluations, or metadata) after confirming its ID.
Parámetros de entrada
namestringUpdated name for the dataset
metadataobjectArbitrary metadata to attach to the dataset
datapointsstring[]Full list of datapoint IDs to associate with the dataset
dataset_idstringObligatorioUnique identifier of the dataset to update
descriptionstringUpdated description for the dataset
linked_evalsstring[]List of evaluation run IDs to link to this dataset
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Update EventHONEYHIVE_UPDATE_EVENTAcciónTool to update an event. Use when updating event details by ID.
HONEYHIVE_UPDATE_EVENTAcciónTool to update an event. Use when updating event details by ID.
Parámetros de entrada
configobjectConfiguration to apply/update
metricsobjectMetrics to record/update
outputsobjectOutputs to set/update for the event
durationnumberDuration of the event in seconds
event_idstringObligatorioID of the event to update
feedbackobjectFeedback payload to attach/update
metadataobjectAdditional metadata to set/update for the event
user_propertiesobjectCustom user properties to set/update
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Update MetricHONEYHIVE_UPDATE_METRICAcciónTool to update an existing metric. Use when you need to modify a metric’s properties after creation. Ensure you retrieve the metric first to verify its current state.
HONEYHIVE_UPDATE_METRICAcciónTool to update an existing metric. Use when you need to modify a metric’s properties after creation. Ensure you retrieve the metric first to verify its current state.
Parámetros de entrada
namestringUpdated name of the metric
typestringenumType of the metric
custommodelhumanpromptstringUpdated evaluator prompt for the metric
criteriastringCriteria for human-evaluated metrics
metric_idstringObligatorioUnique identifier of the metric to update
pass_whenbooleanExpected pass condition for boolean metrics
thresholdobjectThreshold settings for numeric metrics.
event_namestringName of the event the metric is computed on
event_typestringenumType of event the metric is computed on
modeltoolchainsessiondescriptionstringShort description of what the metric does
return_typestringenumExpected return type of the metric
booleanfloatstringcode_snippetstringUpdated code block for the metric
enabled_in_prodbooleanWhether to compute this metric automatically on production events
needs_ground_truthbooleanWhether a ground truth value is required to compute this metric
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not
Update ProjectHONEYHIVE_UPDATE_PROJECTAcciónTool to update a project's name or description. Use when you need to modify an existing project by its ID after creation.
HONEYHIVE_UPDATE_PROJECTAcciónTool to update a project's name or description. Use when you need to modify an existing project by its ID after creation.
Parámetros de entrada
idstringObligatorioUnique identifier of the project to update
namestringNew name for the project
descriptionstringNew description for the project
Parámetros de salida
dataobjectObligatorioData from the action execution
errorstringError if any occurred during the execution of the action
successfulbooleanObligatorioWhether or not the action execution was successful or not