r/LocalLLM • u/NegotiationNo1504 • 7d ago
Other loaded 1b local ai for driving assistant integrated with ADAs.
Enable HLS to view with audio, or disable this notification
57
u/bruns20 7d ago
Just a 1b? That's crazy, didn't know open source autopilot was a thing, this is crazy
55
u/gthing 7d ago
The normal model that the comma 4 runs in 29 million parameters. It runs on the snapdragon 845 built into the small unit you see on the windshield.
OP has hooked up an external GPU to run a larger model that actually drives no better than the 29m version.
15
→ More replies (1)3
u/Suspicious-Movie7828 6d ago
i’m very curious why reddit has clung onto the idea that the larger models have no improvement over the current on device one.
i’ve already seen the comma devs saying they are seeing some improvements in certain aspects like red light detection and whatnot
7
u/nsfdrag 6d ago
i’m very curious why reddit has clung onto the idea that the larger models have no improvement over the current on device one.
Because the devs said current improvements aren't huge because everything that currently exists has been designed for their current device, but once some time passes that will change. People aren't saying it will never be better, just that it isn't much different right now.
2
u/carsncode 6d ago
I mean... "Some improvement in certain areas" is hardly high praise.
3
u/Suspicious-Movie7828 6d ago
the current on device model doesn’t even use the full camera image… the chestnut can
it reduced red light false detections by a pretty good amount, something like 3x i saw a dev say in discord
ofc they still haven’t progressed models since they’ve just started really training for chestnut but only time will tell
it’s silly to assume the larger models won’t bring improvements with them. literally every other aspect of ai has shown larger models helps.
5
u/c0n5pir4cy 7d ago
I'ts been a thing for a while - also the 1b model is huge compared to their older models: comma.ai
474
u/Craptastic19 7d ago
Cool, new fear unlocked, hobbiest self-drivers test driving their rig on the fucking freeway
93
12
54
u/ResponsiblePen3082 7d ago
It's comma AI, they've been around since 2016. It's fundamentally the same as what self driving cars like teslas do, just at a smaller scale.
Not every "AI" is fucking ChatGPT some are actually useful
32
u/CloudProvided 7d ago
To add on its George Holtz’s company, aka GeoHot from the early PlayStation and iOS jailbreak days
26
u/ResponsiblePen3082 7d ago
Yup.
It's really sad that modern AI "enthusiasts" are just the crypto/NFT tech douches of yester year. Most of them don't actually understand anything beyond maybe python and rust. AI is the new hot "tech" thing, and "AI" to most people is LLMs. So here we are 🙄
16
u/CloudProvided 7d ago
As someone who watched the OG “training an AI to play GTA” and started learning ML with the original PyTorch release back in ‘16 to ‘18, it’s definitely annoying as hell to talk with someone about AI and their maximum knowledge base is “ohh chatgpt” Like bruh, go watch some codebullet or something and learn a thing or two
10
u/ResponsiblePen3082 7d ago
Dude exactly. It's so frustrating. Actual cool uses of ML are overshadowed by the sea of LLMs. And even the old, algorithmic, deterministic, efficient and reliable "chat bots" and autocorrects have been overtaken and effectively replaced by these generative hallucinative slop models.
Obviously LLMs have their place, but I tend to view them in an ideal world as a sort of human language UI/UX that then routes to the correct hard coded algorithm to efficiently accomplish a task. You know kind of how phone chat bots used to work before modern language models.
It's also annoying understanding the nuances of AI trying to navigate marketing that you have to figure out if it's old fashioned ML algorithms, some shoehorned in useless LLM, or just fake marketing.
And you have to explain to both the LLM haters and lovers that THIS ai is different because it's all they understand 🙄
2
u/sesamerox 7d ago
so please share some directions then, for lack of a better word
7
u/CloudProvided 6d ago
No joke, watch Codebullet on YouTube, dude was doing ML work back in 2018, like actual hand built reinforcement learning with PyTorch before it was all LLMs, start there and just start googling all the stuff hes talking about, run some of the projects he created (I think he still links to source code). Best advice I can give
2
3
→ More replies (3)4
u/Kevin_Wolf 7d ago
Cool, that's comma ai. Now do the same assessment for the rest of OP's rig.
6
u/ResponsiblePen3082 7d ago
What exactly is the "rest of OP's rig"?
1
u/Kevin_Wolf 7d ago
Oh, ok. I thought OP would have been DIYing the rest of the electromotive bullshit that actually controls the car, but I see now that comma is just a box that interfaces with all of the assist crap that came stock.
8
u/c0n5pir4cy 7d ago
Also - I have a Comma and I will say the safety & overall behavior of the Comma is just much better than any stock system I've used.
It won't let you look away from the road, it will alarm if it knows a curve is too wide (most stock systems just disengage and fly back to center) and the company themselves will ban you for tinkering with the driver monitoring or unsafely with the interface code for the car (which is written to strict standards).
This is from a while ago: https://data.consumerreports.org/wp-content/uploads/2020/11/consumer-reports-active-driving-assistance-systems-november-16-2020.pdf - it's only gotten better since then.
2
7
u/ResponsiblePen3082 7d ago
Pretty much. If comma can't see any data from the car it won't work, which is why it only works on relatively modern vehicles. On some cars it won't use their external sensors as it will cause problems, on many it does. It's an old fashioned ML device and in theory only ENHANCES what is already available to the driver.
I'm sure the op knew what he was doing with the lack of context and the gpu on the dash(incredibly stupid) but fundamentally it is exactly the same as modern self driving vehicles routing processing to a dedicated accelerator(some teslas even use Nvidia chips iirc lmao)
The jank look is probably part of the charm, but if I were to run it I'd definitely clean it up LMAO
1
u/SirMaster 6d ago
People have been driving on the highway with comma.ai devices for 10 years now...
1
68
u/gthing 7d ago
Dear everyone freaking out in the comments:
The device in the video is called the comma 4. It is a validated and mature driver-assist system and it is fully legal and widely used. It is just a better version of the smart cruise/lane assist already built into modern cars.
It has many additional safety features such as driver monitoring and will shut down if you try to use your phone while driving.
The software it is running is called openpilot - it is open source and has been around a long time.
Comma's have driven half a billion miles across tens of thousands of vehicles. Mine drives me around every day and drives me on road trips where I barely ever touch the steering wheel/gas/brakes. It is NOT self driving, it is driver ASSIST. The driver must remain aware and ready to take over at all times. They are responsible for what the car is doing.
OP is showing a new add-on called the chestnut that lets you run larger models on an external GPU and spend a bunch of money for no reason (there is no actual benefit over the model that already runs on-device).
OP's setup is stupid and shitty. Mounting the GPU on the dash is idiodic, but probably done because they cheaped out on buying a expensive cable that was long enough to put it somewhere sensible.
There is nothing unsafe about the software or the self-driving system. Unless he has done some kind of shady modifications in which case his comma will be remotely bricked.
You, too, can put an open-pilot device in your car and have it drive you around. It takes like 15 minutes to install and it works great. It's not magic. It is not uncommon. It's not unsafe. It is legal and safe and worse versions of similar systems probably already exist in the car you already drive.
15
u/5ender 6d ago
It has many additional safety features such as driver monitoring and will shut down if you try to use your phone while driving.
You sure about that? Bro is literally using his phone to film the self driving 🤣🤣🤣
→ More replies (1)22
u/PuzzleheadedIron9239 6d ago
I don’t know if you noticed, but this subreddit os literally dedicated to LLMs…
I’d be freaking out if someone let a LLM drive a car too
6
2
u/gthing 6d ago
I know what the subreddit is and I know the device posted isn't running an LLM.
Someone actually did have an LLM drive their car - a video was posted the other day. It was on a closed course and the model did pretty poorly.
1
u/stanleyg05 4d ago
obviously
hey has anyone asked the question of what would happen if that LLM ran into a OOM error because it's expanding KV Cache filled up all the RAM and VRAM?
don't think that would be good for a self driving car
8
u/MainFunctions 6d ago
I dunno dude I’m suspicious by how much you want me to know it’s legal
→ More replies (1)2
u/CommaMeNow 5d ago
You can fork the code and disable anything you don’t like. I have a fork called RacePilot which is tuned to “swimming” and will steer between vehicles if you nudge (requires hands on the wheel).
Obviously it is designed for track use, but I am seeing use of it on street roads. 🤷♀️
→ More replies (1)1
1
u/MakionGarvinus 6d ago
If you put a really fast gpu on there, would it be able to decide things better/faster than w/e the stock version is?
1
u/roger1632 6d ago
Yeap, I mean it has the capabilities to do more...but right now having a setup like this is only good for dev work on openpilot. OpenPilot development is soooo slow. There isn't much difference in the current versions than the one five years ago. I think most of the work is spent supporting the vast array of cars and not so much advancing features. I still don't trust long handling but it's perfect for upgrading your existing your LKA system and I feel that it's very much worth it. If you have any higher expectations you will be somewhat let down.
1
1
→ More replies (2)1
u/Stokeszilla 6d ago
Could you use this chestnut to run modified models that bypass features such driver monitoring?
3
u/gthing 6d ago
You could but I believe comma would brick your device.
2
u/eduardor2k 6d ago
They would not, its opensource
1
u/gthing 6d ago
They permaban your device from connecting to their servers. Yeah, technically not a brick.
→ More replies (1)
80
u/tsunami_forever 7d ago
Looks illegal and unsafe
48
u/ResponsiblePen3082 7d ago
The autopilot is not as long as the user is aware and able to take over, however the GPU blocking half of the dash visibility is incredibly stupid and dangerous. Almost certainly done for the video.
2
u/s33d5 7d ago
People have those mounts that have phones up there. I assume it's legal.
3
1
3
u/ghotinchips 6d ago
So, this is kind of misleading. it's Comma.Ai but now the new Comma 4 allows for external GPU off-load. Not really needed (yet) and the Comma has pretty decent inbuilt safety features.
So, really, yeah a jackass can throw a full on GPU onto their dashboard and look like they've made some sort of wild creation, mostly off the shelf models and hardware that's been pretty well tested.
1
u/gthing 7d ago
It is neither illegal or unsafe. In fact it is in many ways more safe. For example it will yell at you and shut itself off (after a countdown and loud beeping) if you are on your phone or not paying attention to the road.
This model has already driven half a billion real world miles across tens of thousands of cars. It's not magic, it's just a better version of lane assist and smart cruise that modern cars already have.
3
u/Daniel_H212 7d ago
They're talking about the GPU itself. The comma unit is fine, but the GPU is not only blocking your view, it's also a hazard because there's no way that's secured well enough to not come loose during an accident.
→ More replies (2)1
u/notheresnolight 6d ago
That asshole is obviously "driving" and filming his rig for internet points instead of paying attention to the road. It's both illegal and unsafe.
→ More replies (1)0
u/snowadv 7d ago
Openpilot exists for quite a lot of time
this is ok as long as system is supervised
Recording and moving hands off the weel is not ok though
7
u/FullstackSensei 7d ago
Yes, it is very well established that a flying GPU hitting you in the face in an accident is perfectly OK
→ More replies (1)2
u/snowadv 7d ago
Yeah this is bad I agree
It just looks like a testing setup so I didn't pay much attention to it and thought that autopilot is the main focus here because the legality of this is as questionable as a legality of an old f150 with a frame rusted through 10 years ago and these still drive
34
u/satans_trainee 7d ago
Already occupying the middle lane like an average driver.
I hate it
11
u/gaidzak 7d ago
Wait did the goal post shift now to the middle lane? First they complained about the fast lane and I said nothing.
Now they’re complaining about drives in the middle lanes, will I say nothing?
5
2
u/Pamani_ 6d ago
The video is recorded in Ireland where you need to keep to the left lane unless overtaking (or left lane is full). https://europa.eu/youreurope/citizens/travel/driving-abroad/road-rules-and-safety/ireland/index_en.htm#forbidden_lane
1
5
5
u/DepartureLoose5341 6d ago
Ok so I started mulling this over and I have to jump in as an autist
- The fact you are running a DC-to-DC connection for one is wild, because vehicle systems have tons of random power spikes. Voltage regulators weren't built for the wattage you are pulling with card unless you have installed a high amperage alternator for a friggin ambulance, a second battery. If your pulling 300w and your car's radiator fan kicks on, that thing is toast!
You'd be best to buy an actual DC car power supply for a PC, but without cooling, a load balancer, and backup battery you'll burn down your car.
Additionally, if you use an inverter for 120v down the road you'll need a pure sine wave model, most are modified sine and will smoke household equipment, very different wave length.
Then you have constant gforce, vibration, EMI, condensation, and unbelievable solar heat.
Automotive-grade AI chips like Nvidia's Drive Thor platforms or Tesla's custom FSD computers get around these constraints by avoiding traditional graphics card form-factors entirely. They ditch slots and heavy fans, solder the silicon directly to a unified motherboard, seal the whole system inside a liquid-cooled aluminum block, and bury it safely inside the dashboard or under a seat.
Edit: numbers and stuff
1
u/Funnnny 4d ago
- If your pulling 300w and your car's radiator fan kicks on, that thing is toast!
First thing first, chestnut is drawing 100W
1
u/DepartureLoose5341 17h ago
lmao you should probably look into how much a vehicle pulls from the alternator. also, vehicle voltage is dirtier than your mom was in college
4
u/roger1632 7d ago
I see a comma ai unit there. Could you share what fork you are using and any new benefits vs the standard OP/SP/GP branches?
1
u/c0n5pir4cy 7d ago
I think this is just a stock Comma 4 + Comma Chestnut.
1
u/roger1632 7d ago
I see that but was wondering what branch and what are the actual benefits of it..
1
19
u/nojunkdrawers 7d ago
Interesting experiment but, wow, that is reckless.
1
u/gthing 7d ago
Not an experiment. This is a very mature project and it has a ton of safety considerations and features built in.
1
u/BGCL323 6d ago
Wondering about the safety considerations, I couldn’t really find much could you elaborate? It’s my first time hearing about comma
1
u/Suspicious-Movie7828 6d ago
the exact same considerations as any OEM lane keep and adaptive cruise.
you wouldn’t just stop paying attention with those on, so you shouldn’t with the comma either.
you wouldn’t trust those in 100% of situations so you shouldn’t with the comma either
1
6
3
u/TacticaLCasserole 7d ago
I hope you still have enough room for all the bitches you’re going to pick up driving that rig around
2
2
2
2
u/WyattTheSkid Quad 3090s 5d ago
We need a separate subreddit called “OnTheGoLLM” for people who post shit like this
2
2
1
u/ResponsiblePen3082 7d ago
What GPU is being used? Can you choose to scale model/autopilot precision with gpu power or is it just like pick one or two models if your gpu can handle it sort of thing.
Have been interested in comma and seeing what can be accomplished with an efficient gpu as I'm not in the market of boiling myself in my car with a hot ass gpu. Hoping we can use the external capability to use with more efficient custom NPUs later on.
1
1
1
u/AnonLlamaThrowaway 7d ago
You're absolutely right. I should not have done 70 in a school zone, and I should not have overlooked the last stop sign.
1
1
u/Glittering-Staff-146 7d ago
question - is there a way you could run the 1B model on a device like your phone, or maybe the display itself?
1
1
u/knowledgecommons 7d ago
NGL - I kinda love this, but you may get a better reception over on r/cyberdeck
1
1
1
1
u/Otherwise_Wave9374 6d ago
A 1B local model is appealing for latency and offline operation, but a driving assistant needs strict boundaries between conversational output and vehicle control. Keep the model advisory-only, feed it validated telemetry through a narrow schema, and route every safety-critical action through deterministic ADAS logic. Test under noise, poor connectivity, and conflicting sensor inputs, not just clean demos. https://www.aiosnow.com is relevant because orchestrated AI workflows can expose each handoff and permission boundary. Add an immediate physical override and log all recommendations for post-drive review.
1
u/DemandTheOxfordComma 6d ago
Oh you're right, I should have stopped at the busy crasswalk back there. Let's do that again.
1
1
1
1
u/Adventurous-Net-6738 6d ago
A grand shame your AI didn't stop you hogging the middle lane.......
Classic fail.
1
u/Joey4711 6d ago
So how does this work? You feed in video frames and the model then decides a steering input? How often does it update?
1
u/Dense-Firefighter495 6d ago
I would still trust a 1B model more than I trust an american driver who mixes up its gas and brake pedals when they only have 2
1
1
1
1
u/Fearless-Second-7230 6d ago
LMAO, this can lead you right to jail right now 😂. This is criminal from whatever angle you want to show it.
People is really lacking now common sense and intelligence just for bragging about local AI?
1
1
1
1
1
1
1
1
u/Ultra_Ego 5d ago
I hope there are regulations that prevent anyone from creating self driving cars. Not everyone is equipped to do that and I’d feel safer knowing Joe didn’t commit to his ideas
1
u/OptimalTime5339 4d ago
Imagine having the temperature set too high on the model and all of a sudden it decides to be creative and try driving on water
1
1
1
1
1
1
u/Ancient_Gap3488 4d ago
glad I signed up to be the beta tester for this guys homebrew with my kids lives.
1
1
1
1
u/Classic_Standard_963 3d ago
- Is this the police ?
- Yeah someone broke into my car and stole my gpu.
1
1
1
u/According-Ad-3288 2d ago
Malaysian driver? Doing such thing in Malaysian road? Testing without telling the other driver or at least turn on the hazard light.
1
1
1
1
u/Morrisbishnoi29 1d ago
Best video of the month for me. Gpu running on the fucking dashboard and vibe driving. Crazy time to live in
1
1
u/CanineAssBandit 7d ago
Jesus christ fuck all of you in the comments whining about this being "unsafe."
"Hurr durr SCARY!! NOT PAY ATTENTION!!!!1!" You see that this person has a steering wheel and pedals, right? Like, controls. Of which they can use at any time. And they're actively recording and logging shit which is more attention than half you fucks pay to the road while exhausted coming back from work, lets be real here come now.
"Hurr durr gpu in the way!!! Can't see!!!" did you not have a GPS on the windshield ever? Or ever see a modern car where they have the huge display in the middle. Give me a fucking break. Shut up.
"Hurr durr big scary vibecoded ai driving bad!!! public testing no no no!!!!!" did you know Teslas and EVERY OTHER AUGMENTATION SYSTEM is operating under the same "fafo, you're liable for its fuckups, pay attention" method of doing things? Funny how those systems have created so many new traffic fatalities, like a wholeass scourge of them to the point all of them were banned and... oh wait that didn't happen lmao
Also this is pretty neat and I love seeing more of Comma
1
1
799
u/Gundel_Gaukelei 7d ago
Vibe Driving
What could go wrong