Bit technical but super important.
Would you use a 400B size model just to send an email?
This is what a lot of people are doing right now.. And it's a complete waste of compute power and energy!
What you should do instead, is fine tune a smaller model.. Say 8B in size.
Fine tuning simply means to teach the model how to respond and give it new knowledge without it forgetting what it already knows.
- Take 100 of your best email replies you've written yourself.
- Put it in a spreadsheet.
- 2 Columns: Prompt, Response
- Prompt Column: Write the message you usually send to AI when you need emails drafted.
- Response Column: Paste in the AI response with included email in the formatting you want it to master.
- Use Unsloth for Windows & Linux. MLX for MacOS to fine tune your model.
That's it!
You've successfully trained a tiny model to write your emails for you :)