ORIGINAL REDDIT POST
Best models to generate Synthetic data for fine-tunning
Basically I want to generate a 5k rows (each being a long agentic task, 50-100k long) synthetic dataset on code review for fine tunning deepseek 4 flash. What is the best way? what I saw API is very very expensive so I need suggestions on the best coding plan…
Basically I want to generate a 5k rows (each being a long agentic task, 50-100k long) synthetic dataset on code review for fine tunning deepseek 4 flash. What is the best way? what I saw API is very very expensive so I need suggestions on the best coding plan which has models much better then deepseek 4 flash that are subsidized and won't block me from generating training dataset.
Collected discussion
Define expensive. Is 300 dollars expensive if it gives you 3000 dollars better answers in the long run, to me it sounds like a 2700 w
Something under 500$ Preferably around 100 if possible:) 100 at least as a POC and after seeing results I should be able to do 400-500$
I didn't get to that part yet but cloud gpus Probably on vast.ai as I have used them before
If so, please don't worry about API costs. at all. GPU - maybe B200 or above - rent fee will eat-up other cost soon.
So basically you can run a 10 q mvp/poc for 15 dollars if it is all output and no caching. Why no start with that and measure the actual costs and results, I don’t know where you got the 5k number from but are you sure that is what you need and what are the benefits over x time of having a fine tuned ds4flash
Wait, what kinds of GPU will use to finetune DS4 flash?
For bulk synthetic generation, don't pay premium per-token API pricing if you don't need the flagship model quality for every row. A lot of that dataset (code review style tasks) doesn't need the smartest model in the world, it needs consistency. I'd look at a serverless inference API that gives you access to a range of open models at per-token pricing instead of committing to one vendor's rate card, DigitalOcean's serverless inference does this and it's a lot cheaper for bulk jobs like 5k long-form generations than hitting a frontier model API directly.
You might want to ask this over in r/Unsloth as well.