π’πˆππ†π‹π„ ππ‡πŽπ“πŽ π“πŽ πŸ‘πƒ: 𝐈𝐍-𝐖𝐀𝐋𝐋 πŒπ„π, ππ„π…πŽπ‘π„ 𝐓𝐇𝐄 πƒπ‘π˜π–π€π‹π‹ π‡πˆπƒπ„π’ πˆπ“.
Here is a real use case for a free Apple tool most people are treating as a toy.
Apple released SHARP, an open research model that turns one photo into a 3D Gaussian splat scene.
Not a flat picture. A scene you can rotate.
That matters on a real job, because once drywall goes up, the MEP inside the wall is gone from view.
A photo helps. A rotatable 3D record helps more, if you capture it right and you do not pretend it is something it is not.
This is a step-by-step tutorial, field first.
What SHARP is:
SHARP is Apple's free, open research model. It runs offline and locally, and it lives on GitHub.
It turns a single photo into a 3D Gaussian splat scene, built from millions of tiny, soft, semi-transparent blobs of color that blend into a photorealistic image you can rotate.
The output is metric, with real-world scale, and it saves as a standard .ply file that works with public splat viewers.
Each scene is about 1.2 million Gaussians, in two 768 by 768 layers.
It is the full-3D cousin of iOS 26 Spatial Scenes, which only shifts a subject against a background when you tilt the phone.
What SHARP is not:
It is not a measurement tool, and it is not a BIM replacement.
It estimates depth and 3D structure from one view. What the camera cannot see, it has to guess.
It does not prove what is behind a pipe, inside a wall cavity, or on the far side of a stud.
Use it as a visual record, tied to a real QA/QC check. Never as proof of hidden work by itself.
And one honest limit, straight from the article: SHARP runs on an Apple silicon Mac only.
It does not run natively on an iPhone today.
So the iPhone is your capture and viewing device. The Mac does the 3D processing. Your app ties the two together.
The workflow, in plain terms:
Capture the open wall, turn each key photo into a 3D splat, attach it to the room and wall, check it, sign it off, then keep it for Operations.
When a valve, a junction box, or a cleanout is needed two years later, you open the wall on screen instead of opening the wall with a saw.
Step 1, set up SHARP once, on a Mac:
You need an Apple silicon Mac, Xcode, Homebrew, and Claude.
Xcode is the longest part, including its first-launch tool installation.
Homebrew is a one-line install.
Claude, the free version is enough, is the go-between that sets the model up for you.
Point Claude at the SHARP GitHub page and ask it to set the model up on your computer.
Answer its follow-up questions in the same conversation. Setup took about 15 minutes in the article.
SHARP is not a packaged app. It has no launch icon.
You run it through Claude, and a locally hosted SHARP page appears after about 30 seconds.
Step 2, capture the wall on iPhone, before drywall:
Do this wall by wall, room by room, before the board goes up.
Take one wide photo that shows the whole wall, stud to stud, floor to ceiling.
Then take close photos of every MEP item that will be hidden: valves, cleanouts, junction boxes, panels, dampers, and fire stopping.
Keep the camera square to the wall, keep the light on, and keep a tape or a known reference in the wide shot when you can.
Name every photo the same way, every time: project, level, room, wall, date.
Example: Level 2, Room 204, North wall, 2026-11-05.
If the name is not consistent, the record will not be findable later, and the whole exercise fails.
Step 3, turn the photo into a 3D scene:
In the local SHARP page, widen the window so all of it is visible, then add your JPEG or PNG photo.
Click Generate. Each photo took almost exactly 2 minutes in the article.
Export the result as a .ply file, into a folder named for that room and wall.
Do not click around to Assets or Scenes before you export. Save the file first.
Step 4, view it and check it before you trust it:
Open the .ply in SuperSplat, a free online viewer that needs no account.
Choose Open PLY, find your file, and drag to rotate it.
Check the scene against what you saw in the room.
Can you see the valve? Can you see the box? Can you rotate far enough to tell what is in front of what?
If the splat smears an area or invents geometry at the edges, mark that area as unverified in your notes. Do not let a pretty render cover a bad capture.
Step 5, run the QA/QC check, with a human signing it:
The splat is the record. The check is still a person.
Walk the wall against your MEP checklist, and record pass, fix, or re-inspect for each item.
Typical items to check in the open wall: duct and pipe routing and supports, conduit and boxes, fire stopping and penetrations, insulation, blocking, and nail plates where piping and wiring pass through studs.
Photograph every fix, and re-run the splat for that wall after the fix.
No sign-off, no drywall. That rule does not change because the record is now in 3D.
Step 6, hand it over for Operations and FMI:
File each .ply with its room, wall, date, inspector, and sign-off, in the same place every time.
Link it to the asset it shows: the valve, the panel, the cleanout, the shutoff.
During Operations, when someone needs to find that asset, they open the room, open the wall, and rotate the scene.
They see where it is before they cut, drill, or shut anything down.
That is the FMI value. The record you made before drywall becomes the map you use after handover.
Step 7, vibe-code the iPhone app around it:
Do not start by coding the 3D model. Start by coding the workflow above.
Your app needs five screens, in this order: Capture, Wall, Check, Sign-off, Find.
Capture: open the iPhone camera inside the app, force the naming rule, and stamp project, level, room, wall, date, and inspector on every photo.
Wall: one wall, one folder, with its wide photo, its close photos, and its .ply file.
Check: the MEP checklist for that wall, with pass, fix, and re-inspect on each line, and a photo attached to every fix.
Sign-off: name, date, and a clear yes or no for drywall. No yes, no board.
Find: search by room, wall, or asset, and open the splat. That is the Operations screen, and it is the one that pays for the whole system.
Under the hood, keep it simple:
iPhone captures and views. The Mac runs SHARP and returns the .ply.
The app sends the photo to the Mac pipeline, gets the .ply back, and stores it with the wall record.
Use the viewer that already works, SuperSplat in the browser, or an embedded PLY viewer in the app, before you build a custom viewer.
Vibe-code it in small prompts, one screen at a time, and test each screen on a real wall before you add the next one.
What to watch out for:
Single-photo depth is an estimate, not a survey.
A splat can look clean and still be wrong at the edges, behind an object, or in a dark cavity.
Lighting, glare, and a tilted camera make it worse, so capture the same way every time.
Keep the original photos too. The .ply is a derived record. The photo is the evidence.
And keep the file sizes honest: about 1.2 million Gaussians per scene adds up fast across a whole building, so file by room and wall, and archive the closed walls.
My take:
This is the right shape for AI on a real job.
One free tool, one clear workflow, one record that survives handover.
Not a demo. A wall you can still see after it is covered.
Start with one room, one wall, and one full pass through all seven steps.
If that pass holds up in Operations, then scale it.
Not demos. Decisions.
What wall would you try this on first? The one with the most hidden MEP, or the one you have had to open up before?
If you already have a field app that records as-builds documentation for jobsite records enhance your workflow with SHARP implementation.
Source at the end.
2
1 comment
Todd Sutton
2
π’πˆππ†π‹π„ ππ‡πŽπ“πŽ π“πŽ πŸ‘πƒ: 𝐈𝐍-𝐖𝐀𝐋𝐋 πŒπ„π, ππ„π…πŽπ‘π„ 𝐓𝐇𝐄 πƒπ‘π˜π–π€π‹π‹ π‡πˆπƒπ„π’ πˆπ“.
powered by
AI in Construction
skool.com/ai-in-construction-8633
Practical AI workflows, prompts, and honest lessons for contractors and construction pros. Bring a real bottleneck. Leave with something you can use.
Build your own community
Bring people together around your passion and get paid.
Powered by