Get started
Introduction
What Skynet is, what it optimizes, and where to start.
Skynet improves an artifact that you already have. You give it a starting version, a set of cases and a metric. Skynet proposes new versions, runs each one on your cases, scores the output with your metric, and keeps the best version.
What Skynet optimizes
Skynet works on four artifact kinds:
| Artifact kind | What changes |
|---|---|
| Prompt | The prompt text |
| Code | The source code |
| DSPy program | The instructions of the predictors in a dspy.Module |
| Text | Any other text, for example a document or a configuration |
Every run uses the same contract. Your run code defines run(artifact, input). Your metric defines score(input, output, expected=None). The metric returns a score and written feedback. The optimizer reads the feedback to make the next version better.
One product, many engines
Skynet is Optimize Anything. The artifact kind decides which engines can work on it:
- Prompt, Code and Text artifacts use the native engines: GEPA, Best-of-N, Meta-Harness, AutoResearch, AutoSaddler and ShinkaEvolve.
- DSPy program artifacts use the DSPy optimizers: DSPy GEPA, DSPy MIPROv2 and DSPy BootstrapFewShot.
Auto picks for you. On a DSPy program, Auto uses DSPy GEPA. On other artifact kinds, Auto combines five native engines. Read How optimization works and Engines.
How a run works
- You describe the task and set the starting version.
- You give the cases. Skynet splits them into train, validation and test sets.
- You select an optimizer, the models and a budget.
- You write the run code and the metric. A contract check runs them on sample cases.
- Skynet runs the optimization and shows the results.
Skynet selects versions on the validation cases. It reports the final score on the test cases. The engines never see the test cases.
Where to start
| If you want to | Read |
|---|---|
| Start your first run | Quickstart |
| Understand how optimization works | How optimization works |
| Choose an engine | Engines |
| Prepare your data | Datasets and splits |
| Write a metric | Metrics and scorers |
| Fill in the wizard | Submit a run |
| Read your results | Results |
| Understand cost | Billing |
| Use Skynet from an agent | MCP |
| Call Skynet from code | API |
| Check the limits | Limits |