Jobs at scale · Autessa Synthetic Data
Background jobs and parallel batches
Autessa Synthetic Data runs every dataset as a background job. It splits the work into batches sized to your columns, runs several workers in parallel on large jobs, and shows live progress, so you can start a 5,000-row job and get on with your day.
The problem
Large generations do not fit in a browser tab
Generating thousands of rows takes many model calls. Doing that in one request times out, and doing it one call at a time is slow. Both lose everything if something fails halfway.
What you get
- Start returns immediately; generation runs in the background.
- Rows per call are sized from your column mix, so long-text columns get smaller batches.
- Large jobs run several batches at once; the page shows how many workers are active.
- Each batch has its own status, row count and rejected count.
- The home list and the job page refresh themselves while work is in progress.
- Cancel stops after the batch in progress; rows already written stay written.
How it works
How does background jobs and parallel batches work?
Start the job
Press Start generation. You land on the dataset page.
Batches are planned
Autessa sizes batches to fit your columns.
Workers generate
Batches move from Pending to Generating to Staged or Written, several at a time on large jobs.
Track progress
Watch rows generated against rows requested, the active workers and the time of the last progress.
Every option
Batch states
| Option | What it does |
|---|---|
| Pending | Waiting for a worker. |
| Generating | A worker is generating this batch. |
| Staged | Generated and waiting for review (review mode). |
| Writing | Being written to the table. |
| Written | Written to the target. |
| Discarded | Thrown away; never written. |
| Failed | The batch failed; the reason is shown on the batch. |
Permissions
Who can do what?
| Who | Can |
|---|---|
| People in your company | Create datasets, see the company list of jobs, open any job and review, approve, append, cancel or discard it. |
Connected
How background jobs and parallel batches connects to the rest of Autessa
FAQ
Questions about background jobs and parallel batches
Can I close the page while a job runs?
Yes. Jobs run on Autessa’s servers. Come back to the Synthetic Data home and open the job to see where it is.
How many workers run at once?
Large jobs run several batches in parallel, and the job page shows the current number of active workers.
Does generation use AI credits?
Yes. Each batch is one model call plus at most one repair and one top-up. If the company runs out of budget or credits, the job finishes with the rows it has.
100% customizable, code and all
Make Autessa Synthetic Data fully your own.
Use it out of the box, then change anything. Ask Autobot, Autessa’s AI builder, for a new field, screen, report, workflow or agent and it builds it into your copy of the app. Or open the code and edit it yourself. Nothing is locked: the app, its data and its code are yours.
Start free and make it yours