NAiOS IconNAiOS Logo
Contacto
Volver al catálogo

Honeyhive

honeyhive

HoneyHive is a modern AI observability and evaluation platform that enables developers and domain experts to collaboratively build reliable AI applications faster.

Artificial IntelligenceDeveloper ToolsWeb del proveedor
Acciones
24
Triggers
0
Autenticación
—
OAuth gestionado
No
Información técnica: el detalle de parámetros, schemas y triggers de esta página está pensado para equipos de integración. Si solo necesitas saber si tu herramienta favorita está disponible, basta con ver la lista de acciones.

Acciones disponibles (24)

Cada acción es una operación que el agente puede ejecutar contra este conector. Haz clic en una acción para ver sus parámetros.

Add datapoints to datasetHONEYHIVE_ADD_DATAPOINTS_TO_DATASETAcción

Tool to add datapoints to a dataset. Use when you need to append multiple entries with specified input, ground truth, and history mappings.

Parámetros de entrada

  • dataobject[]Obligatorio

    List of JSON objects representing datapoints to add

  • mappingobjectObligatorio

    Mapping of data fields to inputs, ground truth, and history

  • projectstringObligatorio

    Project name associated with the dataset

  • dataset_idstringObligatorio

    Dataset identifier to which datapoints will be added

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Create Batch Model EventsHONEYHIVE_CREATE_BATCH_MODEL_EVENTSAcción

Tool to create multiple model events in a single request. Use when you need to log a batch of event interactions to HoneyHive.

Parámetros de entrada

  • model_eventsobject[]Obligatorio

    Array of model event objects to create

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Create Batch Tool EventsHONEYHIVE_CREATE_BATCH_TOOL_EVENTSAcción

Tool to log a batch of external API calls as tool events. Use when you need to record multiple tool events in one request—use after gathering all event data.

Parámetros de entrada

  • eventsobject[]Obligatorio

    Array of tool event objects to create

  • is_single_sessionboolean

    If true, all events in the batch are associated with the same session. Defaults to false.

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Create DatasetHONEYHIVE_CREATE_DATASETAcción

Tool to create a dataset. Use when you need to initialize a new dataset within a project.

Parámetros de entrada

  • namestringObligatorio

    Name of the dataset

  • typestringenum

    What the dataset is used for

    evaluationfine-tuning
  • savedboolean

    Flag indicating if the dataset is saved

  • projectstringObligatorio

    Name of the project associated with this dataset

  • metadataobject

    Any helpful metadata to track for the dataset

  • datapointsstring[]

    List of unique datapoint IDs to include in the dataset

  • descriptionstring

    A description for the dataset

  • linked_evalsstring[]

    List of unique evaluation run IDs to associate with the dataset

  • pipeline_typestringenum

    Type of data pipeline

    eventsession

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Create ToolHONEYHIVE_CREATE_TOOLAcción

Tool to create a new tool. Use when you need to register a new function or plugin for invocation.

Parámetros de entrada

  • namestringObligatorio

    Human-readable name of the tool.

  • taskstringObligatorio

    Name of the project associated with this tool.

  • typestringObligatorioenum

    Type of the tool; must be either 'function' or 'tool'.

    functiontool
  • parametersobjectObligatorio

    JSON schema defining the tool's callable parameters.

  • descriptionstring

    Optional detailed description of the tool's purpose.

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Delete DatapointHONEYHIVE_DELETE_DATAPOINTAcción

Tool to delete a specific datapoint by its ID. Use when you need to remove a datapoint from HoneyHive after confirming its identifier.

Parámetros de entrada

  • idstringObligatorio

    Datapoint ID to delete (24-character hexadecimal string)

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Delete DatasetHONEYHIVE_DELETE_DATASETAcción

Tool to delete a dataset by ID. Use when you need to remove a dataset after confirming its ID.

Parámetros de entrada

  • dataset_idstringObligatorio

    Unique identifier of the dataset to delete

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

End Evaluation RunHONEYHIVE_END_EVALUATION_RUNAcción

Tool to mark an evaluation run as completed. Use after finishing manual evaluations to update the run status to completed.

Parámetros de entrada

  • namestring

    Display name for the evaluation run

  • run_idstringObligatorio

    Unique identifier of the evaluation run to update

  • statusstringObligatorioenum

    Must be set to 'completed' to mark the run as finished

    pendingcompleted
  • metadataobject

    Arbitrary metadata fields to attach to the run

  • event_idsstring[]

    List of session/event UUIDs to associate with this run

  • dataset_idstring

    The UUID of the dataset this run is associated with

  • configurationobject

    Configuration parameters used in this run

  • datapoint_idsstring[]

    List of datapoint UUIDs to associate with this run

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Get ConfigurationsHONEYHIVE_GET_CONFIGURATIONSAcción

Tool to retrieve a list of configurations. Use when you need to fetch all configurations for a specific project before making changes.

Parámetros de entrada

  • envstringenum

    Environment to filter by. Allowed values: dev, staging, prod.

    devstagingprod
  • namestring

    The name of the configuration to filter by, e.g. 'v0'.

  • projectstringObligatorio

    Project name for configuration like 'Example Project'.

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Get DatasetsHONEYHIVE_GET_DATASETSAcción

Tool to retrieve a list of datasets. Use when you need to fetch datasets for a specific project with optional filters.

Parámetros de entrada

  • typestringenum

    Dataset type filter. Allowed: 'evaluation', 'fine-tuning'

    evaluationfine-tuning
  • projectstringObligatorio

    Project name associated with the datasets

  • dataset_idstring

    Unique dataset ID to filter a specific dataset

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Get MetricsHONEYHIVE_GET_METRICSAcción

Tool to retrieve all metrics. Use when you need to list metrics for a specific project, after obtaining project context.

Parámetros de entrada

  • project_namestringObligatorio

    Project name associated with metrics

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Get ProjectsHONEYHIVE_GET_PROJECTSAcción

Tool to retrieve projects. Use when you need to list all available projects.

Parámetros de entrada

  • namestring

    Optional filter to return only projects whose name contains this string

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

List ToolsHONEYHIVE_LIST_TOOLSAcción

Tool to list all available Honeyhive tools. Use when you need to discover which functions or plugins are registered for use.

Parámetros de entrada

  • pageinteger

    Page number for paginated results

  • limitinteger

    Maximum number of tools to return per page

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Retrieve DatapointHONEYHIVE_RETRIEVE_DATAPOINTAcción

Tool to retrieve a specific datapoint by its ID. Use when you have a datapoint ID and need its full details.

Parámetros de entrada

  • idstringObligatorio

    Datapoint ID to retrieve (string identifier)

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Retrieve DatapointsHONEYHIVE_RETRIEVE_DATAPOINTSAcción

Tool to retrieve a list of datapoints. Use when you need to fetch datapoints for a project with optional filters.

Parámetros de entrada

  • projectstringObligatorio

    Project name to filter datapoints.

  • dataset_namestring

    Optional name of the dataset to filter datapoints.

  • datapoint_idsstring[]

    Optional list of datapoint IDs to retrieve.

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Retrieve EventsHONEYHIVE_RETRIEVE_EVENTSAcción

Tool to retrieve events by filters. Use when you need to export events based on filter criteria, date range, and pagination.

Parámetros de entrada

  • pageinteger

    Page number for pagination (default 1)

  • limitinteger

    Limit number of events returned (default 1000; max 7500)

  • filtersobject[]Obligatorio

    Array of filter objects to narrow results

  • projectstringObligatorio

    Name of the project to query

  • dateRangeobject

    Date range filter for events, using ISO 8601 timestamps.

  • projectionsstring[]

    Fields to include in the response

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Retrieve Experiment ResultHONEYHIVE_RETRIEVE_EXPERIMENT_RESULTAcción

Tool to retrieve the result of a specific experiment run. Use when you need the status, metrics, and datapoint-level details of a completed experiment.

Parámetros de entrada

  • run_idstringObligatorio

    Unique identifier of the experiment run

  • project_idstringObligatorio

    Unique identifier of the project this run belongs to

  • aggregate_functionstringenum

    Optional aggregation function for metrics. Allowed: average, min, max, median, p95, p99, p90, sum, count

    averageminmaxmedianp95p99p90sumcount

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Start Evaluation RunHONEYHIVE_START_EVALUATION_RUNAcción

Tool to initiate an evaluation run using external datasets. Use after selecting a project and events; optionally link a dataset.

Parámetros de entrada

  • namestringObligatorio

    Name of the evaluation run to be displayed

  • statusstringenum

    Status of the run; allowed: 'pending', 'completed'

    pendingcompleted
  • projectstringObligatorio

    UUID of the project this run is associated with

  • metadataobject

    Additional metadata for the run

  • event_idsstring[]Obligatorio

    UUIDs of the sessions/events this run is associated with

  • dataset_idstring

    UUID of the dataset associated with this run

  • configurationobject

    Configuration used for this run

  • datapoint_idsstring[]

    UUIDs of datapoints from the original dataset linked to this run

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Start SessionHONEYHIVE_START_SESSIONAcción

Tool to start a new session. Use when you need to initiate a new tracking session and retrieve its session_id.

Parámetros de entrada

  • sessionobjectObligatorio

    Session metadata payload

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Update DatapointHONEYHIVE_UPDATE_DATAPOINTAcción

Tool to update a specific datapoint. Use when you need to modify fields of an existing datapoint.

Parámetros de entrada

  • idstringObligatorio

    Datapoint ID to update (string)

  • inputsobject

    Arbitrary JSON object containing the inputs for the datapoint

  • historyobject[]

    Conversation history associated with the datapoint

  • metadataobject

    Additional metadata for the datapoint

  • ground_truthobject

    Expected output JSON object for the datapoint

  • linked_evalsstring[]

    IDs of evaluations where the datapoint is included

  • linked_datasetsstring[]

    IDs of datasets that include the datapoint

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Update DatasetHONEYHIVE_UPDATE_DATASETAcción

Tool to update an existing dataset. Use when you need to modify a dataset's details (name, description, datapoints, linked evaluations, or metadata) after confirming its ID.

Parámetros de entrada

  • namestring

    Updated name for the dataset

  • metadataobject

    Arbitrary metadata to attach to the dataset

  • datapointsstring[]

    Full list of datapoint IDs to associate with the dataset

  • dataset_idstringObligatorio

    Unique identifier of the dataset to update

  • descriptionstring

    Updated description for the dataset

  • linked_evalsstring[]

    List of evaluation run IDs to link to this dataset

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Update EventHONEYHIVE_UPDATE_EVENTAcción

Tool to update an event. Use when updating event details by ID.

Parámetros de entrada

  • configobject

    Configuration to apply/update

  • metricsobject

    Metrics to record/update

  • outputsobject

    Outputs to set/update for the event

  • durationnumber

    Duration of the event in seconds

  • event_idstringObligatorio

    ID of the event to update

  • feedbackobject

    Feedback payload to attach/update

  • metadataobject

    Additional metadata to set/update for the event

  • user_propertiesobject

    Custom user properties to set/update

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Update MetricHONEYHIVE_UPDATE_METRICAcción

Tool to update an existing metric. Use when you need to modify a metric’s properties after creation. Ensure you retrieve the metric first to verify its current state.

Parámetros de entrada

  • namestring

    Updated name of the metric

  • typestringenum

    Type of the metric

    custommodelhuman
  • promptstring

    Updated evaluator prompt for the metric

  • criteriastring

    Criteria for human-evaluated metrics

  • metric_idstringObligatorio

    Unique identifier of the metric to update

  • pass_whenboolean

    Expected pass condition for boolean metrics

  • thresholdobject

    Threshold settings for numeric metrics.

  • event_namestring

    Name of the event the metric is computed on

  • event_typestringenum

    Type of event the metric is computed on

    modeltoolchainsession
  • descriptionstring

    Short description of what the metric does

  • return_typestringenum

    Expected return type of the metric

    booleanfloatstring
  • code_snippetstring

    Updated code block for the metric

  • enabled_in_prodboolean

    Whether to compute this metric automatically on production events

  • needs_ground_truthboolean

    Whether a ground truth value is required to compute this metric

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not

Update ProjectHONEYHIVE_UPDATE_PROJECTAcción

Tool to update a project's name or description. Use when you need to modify an existing project by its ID after creation.

Parámetros de entrada

  • idstringObligatorio

    Unique identifier of the project to update

  • namestring

    New name for the project

  • descriptionstring

    New description for the project

Parámetros de salida

  • dataobjectObligatorio

    Data from the action execution

  • errorstring

    Error if any occurred during the execution of the action

  • successfulbooleanObligatorio

    Whether or not the action execution was successful or not