Activity
Mon
Wed
Fri
Sun
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
What is this?
Less
More
Memberships
AI Developer Accelerator
10.8k members • Free
AI Developer Accelerator Pro
17 members • Free
540 contributions to AI Developer Accelerator
10d •
I benchmarked a bunch of Local LLMs on Ollama
It was a quiet weekend and i felt like a change of pace.I always mean to run Locall LLM's on my desktop PC but I never really stick at it. This weekend I wrote some rudimentary benchmarking tests so I could compare the performance of my Custom AI PC and my MacBook Pro M4 max. The results were quite surprising. Anyhoo I wrote it up and published it on Medium incase anyone fancies a 10 min read.
1 like • 22h
@Miles Vaughn It is definitly an interesting point that I never considered. My PC has a 1200W PSu, and the Nvidia 4090 can consume upto 850W. I found this article on reddit re the M4 Max. Supposedly 212W was the peak of the guys workload during heavy video editing.
0 likes • 11h
@Scott Graham heres the stats for the re-benchmark. i need to look at nemotron:latest. I expected it to work. Running my tests, which I think are more real world than the ones that were referenced in your
9d •
Import Error
Hi While importing "from langchain.chains import create_history_aware_retriever" It's throwing errors. Please suggest any other to use Chat history.
0 likes • 9d
Hey @Setu Singh Welcome Aboard! It would be nice to know the errors you are recieving so we can assist in less scatter gun approach. I am guessing you are using python in a virtual environment That said, the function you are calling is an old function and now resides in langchains_classic.chains If you change the line FROM from langchain.chains import create_history_aware_retriever TO from langchain_classic.chains import create_history_aware_retriever This should fix the error I used the code on this page to generate my error and the above fix to make it work. Hopefully this helps you out
0 likes • 2d
@Purendeeswar Reddy You are completly right. My example was 1`0 mins of playing and a quick fix as I had no code to work with so created the error and addresses it with the classic chains. As you rightly point out this is a tactical fix and the longer term fix should be to use the newer prefered LangChain methods
5d •
Need advice to further develop mobile app
Hey guys -need little advice Been working hard on the app I had in my mind for a little while: Its in polish -kind of journal with drawing cards -working on it now in aistudio google (80% code done) -after all is done -I want to send it to google store for android and IOS and first test it on my phone -what is the best route? Any other google apps that can help? need sth that is relatively easy to do as I am not a coder -of course can learn. Antigravity? Firesbase? Emergent, any others? Cheers in advance x
1 like • 5d
Morning @Sebastian Urbanik have you written it as a Mobile app in something like Swift/React native/Kotlin? I have an app i am developing and it runs on react native, and that provides me with tools that enable me to have a mobile phone emulator on my dev setup. Google must have something similar with the Android Development stuff.
7d •
Wan2.2 model
Alibaba released their Wan 2.2 model back in July. As I am not in that space I let it pass me by until I saw a post from @Simoo Emkoss . Having had a look into his issue I deployed the model to my local PC, and utilised ComfyIU as the interface. Damm, to a layman it is great. I had a play around with it and managed to generate a few silly videos to see what it could do. I was impressed. Even when i slipped up after adding a massive prompt the eagles were awesome (First Video) I think what shows the power though is the second video. It was created from a still picture and i had the dog turn around and wander away. It is only a few seconds clip but the detail is amazing. And my prompt you may ask. Well here it is. " the dog turns and runs away from the camera as teh grass gently sqays in the wind" Yep complete with typos that I am so good at. I should point out the first video is text to video (T2V), and the second video is image to video (I2V) Render times T2V - circa 5 seconds I2V - 205 Seconds I am sure you videographers out there know lots of ways to utilize this power. Me? I'll just move on :)
2 likes • 6d
Hey @Carlos Aguilar I am running the following PC - Windows 11 Pro - NVIDIA RTX 4090 with 24GB dedicated GDDR6 VRAM - 192GB DDR5 system RAM I also run a MacBookPro M4 Max 48GB, but i didnt use it for this test.
1-10 of 540
@tom-welsh-8986
Because no great story starts with "Last night I had a salad..."
Active 7h ago
Joined Apr 22, 2024
ENTP
UK
Powered by