One of the biggest changes in ChatGPT is that it is no longer limited to text.
You can upload an image, and ChatGPT can read, interpret, and reason about what is in the picture.
That matters because real life does not always come neatly typed out.
Food comes on plates.
Nutrition facts come on labels.
Products come in wrappers.
Restaurants meals come with sauces, sides, and unknown portions. This is where image understanding becomes useful.
At a simple level, ChatGPT can look at an image, identify visual patterns, read text when available, and combine that with general knowledge to make an estimate.
For my nutrition tracker, that means I can upload:
- A picture of a meal
- A nutrition label
- A protein bar wrapper
- The front of a box
- A restaurant plate
- A drink label
If I upload a nutrition label, it can usually pull out the calories, protein, carbs, fat, fiber, and serving size.
If I upload a food photo, it can estimate what is on the plate and give me a starting point.
Is it perfect? It is impressively accurate, especially ChatGPT. However, understanding food weight or size is hit or miss.
And that is important. A photo is not the same thing as weighing food on a scale.
ChatGPT may not know whether a piece of chicken is 120g or 200g. It may not know how much butter was used, how much oil was absorbed, or how much sauce is under the food.
So I treat photos as a fast data entry tool, not final truth, especially at restaurants.
Restaurant meals are harder because portions, sauces, oils, and cooking methods are not always obvious from a picture. However, it is better than guessing - for me.
But the photo still gives ChatGPT a very good starting point.
Obviously, if I have a nutrition label, that usually works much better because ChatGPT can read the actual calories, protein, carbs, fat, fiber, and serving size from the label.
So the rule is simple:
- Photos are great for fast estimates.
- Labels are better for precision.Corrections make the tracker useful.
The workflow becomes:
- Upload the photo or label.
- Let ChatGPT make the first pass.
- Adjust the portion size if needed.
- Log the corrected result.
That is what makes images so useful. Instead of typing every ingredient, wrapper, or nutrition label by hand, I can show ChatGPT what I am looking at and let it do the first pass.
Then I correct what matters.
Pro Tip:
Give ChatGPT Scale (size or weight)
Photos work better when ChatGPT has something to compare against.
A picture can show what the food looks like, but it may not know the actual size.
So when possible, give it scale.
Put your hand near the plate.
Include a fork, cup, or package in the photo.
Show the nutrition label.
Mention the size in text after the photo.
Something as simple as:
This is a 12-inch pizza.
or
This is an 8 oz chicken breast.
or
The bowl is about 2 cups.
This can dramatically improve the estimate.
The photo gives ChatGPT visual context.
The text gives it measurement context.
Together, the estimate gets much better.
The AI Lesson:
It is about multimodal AI.
Multimodal simply means ChatGPT can work with more than one kind of input.
Not just text.
Images too.
That means the workflow becomes more natural.
You do not always have perfect data.
You do not always know the exact serving size.
You do not always want to type everything out.
But you can usually take a picture. And that picture becomes part of the workflow.
The best AI workflow is not always the most technical one. Sometimes it is the one that removes enough friction that you actually keep using it.