Evaluate before you license. Integrate without starting from scratch.Request an Evaluation
A7 / AI LabsFor frontier labs and data-acquisition teamsTraining · Evaluation · Agents · MultimodalEvaluate before you license

Stop buying datasets on faith.Test them first.

Algorithm7 converts rights-cleared proprietary information into structured evaluation tasks, verifiable benchmarks and model-ready training assets. Assess the dataset against your capability requirements before committing to a full license.

A7 Test · what you can measureBefore licensing
Task definitionsRepresentative samplesBaseline questionsHidden reference answersDeterministic or expert gradersQuality and coverage reportProvenance and rights recordDefined success metrics
You decide on the full license after you've measured.
01 · The buyer problem

More raw data isn't the gap. Usable, provable data is.

Proprietary datasets are usually sold on a description and a sample. Your team then spends months finding out whether the data is relevant, clean, legal to use and in a format you can consume. Algorithm 7 answers those questions before you buy.

01

Relevant to a capability gap

Mapped to the skill you're trying to move, not just the domain.

02

Structurally usable

Linked, normalized and documented against a schema.

03

Representative of hard cases

Real failures, corrections and edge conditions, not curated happy paths.

04

Documented and legally usable

Provenance and permitted use recorded per record.

05

Measured quality

Completeness, fidelity and label accuracy reported, not claimed.

06

Suitable for evaluation

Checkable answers, separated from the context a model sees.

07

Delivered in your format

Shaped for your training or evaluation infrastructure.

See it in an evaluation pack.

Open the example

What Algorithm 7 produces

Algorithm 7 is the seven-stage process that turns raw proprietary data into structured, testable assets, so you evaluate before you commit to consuming at scale.

Explore Algorithm 7
Evaluation-ready datasetsVerified benchmarksTraining data productsReasoning and correction tasksAgentic environments, where supportedControlled licensing and delivery
02 · What an evaluation proves

Three different claims. We keep them separate.

Data quality, benchmark performance and learning gains are often blurred together in data sales. They are measured differently, and only the first two come out of an A7 Test.

Measured in A7 Test

Data quality

Is the data complete, faithful to its source, consistently labeled and legally eligible?

Reported as: coverage, completeness, label agreement, leakage checks, rights status.

Measured in A7 Test

Benchmark performance

How do your current models score on tasks derived from the data? Where do they fail?

Reported as: task scores against hidden references, by task type and difficulty.

Requires a training experiment

Demonstrated learning gains

Does training on the data actually improve the model? A test can't answer this on its own.

Established by: a controlled experiment with held-out evaluation, which we can help design under a pilot license.

03 · Inside an A7 Evaluation Pack

What the model sees. What you see. What you license.

Switch between the three views of one pack. The model-facing view never contains the reference answer. Examples are fictional and shown for demonstration.

Fictional example
Input context

Repository snapshot at the incident commit, service logs up to the alert window, and the incident ticket text. No later commits or postmortem.

Task

Identify the root cause of intermittent checkout 5xx errors and propose a code change.

Expected response

A unified diff and a one-paragraph diagnosis, in the response schema provided.

Verification

Runs outside the model view
Scorecard

Not visible to the model
Source provenance

Not visible to the model
Licensed consumption

Requires a license
Model-facing view: the reference answer and grader are withheld.Run an illustrative grader on the Overview
04 · The task record

One domain-neutral structure, every sector.

Every task Algorithm 7 produces follows the same spine, so tasks from different sources train and evaluate together. Temporal fields only appear where the source is a workflow over time.

a7.taskSoftware engineering
source_refsrc:repo-incident/0417
domainsoftware.reliability
contextRepo at commit, logs to alert window, ticket
evidenceStack traces, latency metrics, recent diffs
temporal_cutoffAlert time + 16 min
expected_outputDiff + diagnosis (JSON schema v2)
objectiveRoot-cause and fix intermittent 5xx
verificationSandbox run: regression + suite
reference_outcomeHidden · evaluator only
provenanceSource systems, processing log, version
rightsEvaluation, training · no sublicense
qualityFidelity checked · leakage scan passed
05 · Data products

Five product families.

Which families a dataset can support depends on the evidence it contains and what its source permissions allow. We say so in the evaluation, before you license.

1Model-ready training datasetsSupervised examples, trajectories, corrections and outcome labels in your training format.Needs: rich context and documented outcomes
2Verifiable evaluation benchmarksHeld-out tasks with hidden references and deterministic or expert graders.Needs: independently checkable answers
3Agentic workflow and tool-use tasksMulti-step tasks across tools, scored on final state and policy compliance.Needs: reconstructable system workflows
4Multimodal real-world datasetsLinked documents, images, sensor series, audio or video with expert annotation.Needs: consent and rights for each modality
5Interactive environments and continuous programsAgent environments, and recurring delivery as new authorized data accrues.Needs: ongoing supply and engagement scope

Evaluation approaches

Rights-cleared sampleBlind benchmarkSecure evaluation environmentStructured test specificationAPI-based gradingLimited licensed pilot
06 · Questions

What research, data and legal teams ask.

It measures data quality and how models perform on tasks derived from the data. It does not by itself prove that training on the data will improve your model. That requires a controlled training experiment, which we can help design under a pilot license.
Only if the source permissions allow it and your license grants it. Evaluation and training are separate permissions. Every record carries its permitted uses, and products only include records whose terms cover your licensed use.
Context visible to the model is separated from hidden references and post-cutoff outcomes at the task level. Packs are checked for leakage before release, and graders run outside the model-facing interface.
No. We need the capability you want to measure and how you would judge success. Confidential architecture, training data or roadmap details are not required.
Higher-sensitivity data may only be evaluated in a restricted environment or through controlled access, rather than as a downloadable sample, depending on the custodian's authority and safeguards.
Terms are set per agreement. Some products are licensed non-exclusively; custom programs can be scoped differently where the source permissions allow.

Tell us whatthe model needsto learn.

We'll scope an evaluation against your requirements before any license is discussed.

You don't need to share confidential model details. A description of the capability and how you'd measure it is enough to start.

Request an Evaluation

Primary use

Preview build: live submission is not connected yet. Submitting will not send your details.

* Required. Please don't include confidential model details or any raw data.

Request received.

Your request was submitted. The Algorithm7 team will be in touch to scope the evaluation.