Jun '24 • General discussion
Ollama, ModelFiles and a tiny bit of crewai
Hi,
I saw a video on YouTube where these three parameters where added to the Agent() in CrewAI,
system_template=
"""<|begin_of_text|><|start_header_id|>system<|end_header_id|>{{ .System }}<|eot_id|>""",
prompt_template=
"""<|start_header_id|>user<|end_header_id|>{{ .Prompt }}<|eot_id|>""",
response_template=
"""<|start_header_id|>assistant<|end_header_id|>{{ .Response }}<|eot_id|>""",
Are those params supported by the Agents class in CrewAI? Can't fins any info on it in the agent documentation on crewAI.
Also would it maybe be possible to add this in the ModelFile like;
FROM openhermes:latest
# Set parameters
PARAMETER temperature 0.8
PARAMETER stop Result
# Sets a custom system message to specify the behavior of the chat assistant
SYSTEM """
{{ if .System }}<|start_header_id|>system<|end_header_id|>
{{ .System }}<|eot_id|>{{ end }}{{ if .Prompt }}<|start_header_id|>user<|end_header_id|>
{{ .Prompt }}<|eot_id|>{{ end }}<|start_header_id|>assistant<|end_header_id|>
{{ .Response }}<|eot_id|>
"""
In the CrewAI documentation, this is not added to the model file, but does it have a purpose or what would be the best use of the system message if not the above for models from Ollama?
1
14 comments
Ollama, ModelFiles and a tiny bit of crewai
skool.com/ai-developer-accelerator
Master AI & software development to build apps and unlock new income streams. Transform ideas into profits. 💡➕🤖➕👨💻🟰💰
Leaderboard (30-day)
1
+53
2
+30
3
+20
4
+14
5
+12
Powered by