Similarity Measures for Small Data Problems
When you can safely reuse someone else's data
This protocol makes an analysis team state which similarities their result actually depends on, before they combine two datasets, and which of those they can check.
Problem
Combining data across sources is routine. Teams pool two cohorts, reuse a published model at a new hospital, borrow controls from an old trial, or substitute observational data where a randomized trial is not available. Every one of those moves rests on a claim that the sources are similar enough for the specific job at hand. What usually gets checked instead is whatever happens to be convenient to measure, most often whether the covariate distributions overlap. The dissimilarity that would actually break the result goes unexamined, and nothing in the workflow flags its absence.
Approach
The similarity chain reverses the order. The analytical task is fixed first, and it determines what has to be compared. Each link ties the task to the kind of similarity it depends on (of the data, of the design that produced them, or of the model being reused), a plain-language condition that similarity has to meet, and an empirical check for the condition. Some conditions act as gates: when a gate fails, everything downstream is not merely imprecise but undefined, and the chain says so rather than returning a number. The paper works the protocol through a published meta-analysis, where the pooling decision turns out to rest on an assumption that the documentation supports but no measurement can confirm.
Outcome
The protocol ships as usable material rather than argument alone: a checklist, reference catalogs mapping common tasks to the similarity types they require, and a conversational agent skill that walks a researcher through the specification and writes out a report suitable for a methods section. Further worked examples cover pooling external data for a target setting too small to support a model on its own, substituting real-world evidence for a randomized trial, and cross-species single-cell integration. The manuscript is in preparation.