MentraOS – open-source Smart glasses OS

206 pointsposted 5 days ago
by arbayi
(github.com)

122 Comments

andrewla

5 days ago

Is anybody making smart glasses that are just a display? For me, the rest of the feature set verges on being anti-features. I'd much rather a very rudimentary display that my phone or another device could send relatively low bandwidth data to over bluetooth or some other protocol and build from there.

Having a camera or a mic on the glasses themselves seems like something I'd mostly want to avoid for privacy, and having a speaker just seems like gilding the lily when we already have a variety of headphones to choose from.

numpad0

5 days ago

Note that Solos smart glass from one of other comments might be on eBay for $49 each, but they used to be $499 new. Even Realities G1 is $599. Vufine was way cheaper at $199, but it was wired only and it came with no software whatsoever.

Smart glasses inevitably cost in those ranges because the exotic displays used on them are costly to make and/or operate. Inkjet OLED on silicon or reflexive monochrome LCD with RGB sequential front lighting combined with a prism system or things of that nature.

IOW, those excessive feature sets isn't drawn from product concepts or user stories, they're drawn backwards from cumulative parts and engineering costs to justify MSRP. Same reasons as why almost all EVs are marketed as premium products, they can't make them cheaply so they're adding extra glitters in paint to justify price tags.

If anyone could make displays smaller than a pinky fingernail at $5 that can be driven with an Arduino... then there would be lots of smart glasses that are just Bluetooth picture frames.

andrewla

2 days ago

This rings true to me -- it's hard to sell a $480 device that only displays images. Easier to sell a $500 device that is a $480 display + $20 of crappy software and sensors and speakers and compute so that buyers think they're getting their money's worth.

floren

5 days ago

Not to toot my own horn, but I've been fiddling with a now-discontinued, very cheap pair of display smart glasses: https://news.ycombinator.com/item?id=45087803

You can send low-resolution images to them via Bluetooth. I just figured out how to read button presses. There are speakers and a mic, but I haven't figured out how to use them yet (they don't show up as regular audio devices on Linux).

You'd need to write custom stuff to generate the images, but with a little imagemagick scripting I've had some pretty usable results.

bArray

4 days ago

Very cool work, and the write-up is also great.

Personally I want to see something that isn't dependant on a depleting level of stock, ideally something open source. Otherwise the development investment just doesn't seem worth it.

queSide

5 days ago

I think most of Xreal's offerings are just a display you plug into a phone or laptop.

skhameneh

5 days ago

Not quite "smart glasses", but if you want "glasses that are just a display", the Lenovo Legion Glasses are pretty good and they look like normal aviators at first glance.

I have a pair and I've been experimenting a bit.

For iOS you can mirror display or use Stage Manager. For Android, at least with Samsung, DEX is pretty decent.

For audio, they're decent too, I like the convenience and comfort. The audio has good fidelity, but depth is mediocre (better than phone speakers though).

FWIW I say DEX is decent, having much of the same gripes as I do with Stage Manager. Dual screen, resizing windows, and full screen support is still a mixed bag on all mobile devices. It can be very frustrating at times. Application support on iOS and Android is about the same, which is disappointing. Supposedly iOS 26 fixes some of this, but I haven't tried the beta.

caydenpiercehax

5 days ago

Most people pursuing this include display + microphone.

The microphone lets you pick up voice, which is critical. Captions, translation, note-taking, etc. all benefit from this.

Even Realities G1 is this. Mentra is releasing a pair in first half of 2026 like this. Display + microphone.

arbayi

5 days ago

https://store.vufine.com/ I think vufine might be what you are looking for, I don't know much about them as well, also found it here on Hacker News.

alchemist1e9

5 days ago

It’s wired and very finicky. Basically a 10 year old solution to this problem. I have on in my collection. It’s cool but not really useful or in same tier as the other products being mentioned.’

hnlmorg

5 days ago

Loads. I’ve got a pair of Xreal glasses and use it regularly.

walterbell

4 days ago

Viture similarly offers wired USB-c displayport, with myopia adjustment up to -5 diopters, and optional magnetic frame for custom prescriptions. They sell refurbs on eBay and have a Linux SDK. It's surprisingly functional as a mirrored monitor, without the additional software or hardware which adds platform-specific features like virtual monitors.

numpad0

4 days ago

Those birdbath stereo smartglasses must be coming from some exact same ODM, they're too same.

senectus1

5 days ago

THIS!

ever since reading the opening chapter of Charles Stross' Accelerando, this is what I've wanted.. an always present live information feed available on tap at any time.

renegat0x0

5 days ago

To be honest most of my apps are web pages now. Even on my phone I do not use any more than the default apps. For what is missing I have written my own self-hosted pages.

I sometimes wonder why people "synchronize" anything, since everything is in my self-hosted instance.

unaut

5 days ago

Yeah, same here—just give me a clean display and Bluetooth. No cameras, mics, or speakers needed!

circuit10

5 days ago

It would be difficult to do head tracking without a camera and having it fixed in your view would limit what you could do with it and be distracting I think (depends on the use case/person though)

HeatrayEnjoyer

5 days ago

Glasses with a camera should be legislated away with specific narrow exceptions for e.g. safety in certain industrial tasks.

com2kid

5 days ago

Because smart glasses, that flash a light and make a loud noise when taking a picture, are more invasive than phones literally everywhere? Or street billboards with built in cameras?

Or how about dash cams in cars? CCTV cameras on ATMs as you walk down the street?

1oooqooq

4 days ago

"why would murder be illegal? people get killed all the time. are you going to outlaw cars because you can run over someone? murder laws make no sense."

kids these days. geez.

com2kid

4 days ago

The point is, smart glasses (which to be clear only take a picture when a button is pressed, just like any other camera people own) are not different than any other camera.

Also in the US there is no legal expectation of privacy on public streets. Plenty of public facing webcams are available for viewing.

Passing a law regulating the shape of a camera body is just stupid. Outlawing camera glasses makes less sense than outlawing camera flowers.

skhameneh

5 days ago

Reframe this to accommodate for the prevalence and general expectations of where cameras exist.

Many people walk around with a mobile device out, essentially carrying a device with (increasingly) close to a 360 camera view. Cameras are ubiquitous and targeting one niche device is a waste of time and effort.

esseph

5 days ago

Sounds like a lobbyist pitch from Big Camera Glasses

tonyhart7

5 days ago

"Is anybody making smart glasses that are just a display?"

it is called smart glasses when its just "glasses" ???

cco

5 days ago

Here's the deal, you don't need any of this.

I have Rayban Metas and the hardware is great...but the software borders on being unhelpful. If they merely served a dumb camera and bluetooth headset to my phone they'd be an unbelievably good product.

Meta won't do this because they want to capture _everything_ going on, but I don't want to chat with Meta's AI, it is very bad, I want to chat with Gemini or ChatGPT and I can do so with their glasses but I must initiate that on my phone (Meta won't give you wakewords for OpenAI/Google of course).

So my suggestion here would be don't? There is no need for an app store or anything like that, just the thinest software layer you need to make the sunglass hardware work as a dumb bluetooth headset and remote camera for the user's phone.

caydenpiercehax

5 days ago

That sounds nice but there's problems in reality.

How do the glasses serve as a "dumb camera to your phone"? What protocol do they use to do this? It doesn't exist. It's something that must be solved at the OS layer.

What if you want to use multiple apps? Are you going to spend 2 minutes each time disconnecting Bluetooth from one phone app, connecting to another, and then using it? No, you need to runtime that lets multiple apps access the sensors as needed.

Do you want to make an app that accesses the microphone? If you want to have translation app running at the same time that you're taking notes, then again you need some way to allow multiple apps to run at once.

MentraOS solves those problems.

lightedman

4 days ago

"How do the glasses serve as a "dumb camera to your phone"? What protocol do they use to do this? It doesn't exist. It's something that must be solved at the OS layer."

No, Snapchat did this just fine in the software layer with their glasses looooooong ago.

hnlmorg

5 days ago

> How do the glasses serve as a "dumb camera to your phone"? What protocol do they use to do this? It doesn't exist. It's something that must be solved at the OS layer.

USB webcams have been a thing for years ;)

I have a pair of Xreal glasses and, while they don’t have a camera, they do have the other components. They are entirely dumb. You plug the USB cable into your phone/laptop/portable gaming device and that’s literally it.

The cable runs discreetly from the back of the ear and has the additional benefit that you don’t need a heavy battery built into the frame of the glasses.

So you definitely can have a XR glasses that are “dumb”.

numpad0

4 days ago

XREAL is DisplayPort Alt Mode + USB for gyros. It's also wired only. DP needs 10-40Gbps of bandwidth, doesn't work wireless.

USB cameras also aren't natively supported on iOS/Android. You need apps. With apps comes lock-in opportunities which are never not tapped.

So "just use USB" doesn't make technical sense at all.

hnlmorg

4 days ago

> XREAL is DisplayPort Alt Mode + USB for gyros. It's also wired only.

I know what Xreal uses. As I said, I have a pair

> DP needs 10-40Gbps of bandwidth, doesn't work wireless.

And as I also said, having a cable is a feature, not a problem.

VR headsets are heavy and uncomfortable. USB powered XR glasses are not. And the reason for that is because you don’t need to make those XR glasses as literal portable computers with heavy batteries.

You might relish the idea of an ugly monstrosity that weighs as much as a laptop strapped to your head. Myself, I’d much rather have something that look and feel like sunglasses. If that means I need a discreet UsB cable behind my ear, then thats a small price to pay because they’d still look less stupid than wearing anything bulkier out in public.

> USB cameras also aren't natively supported on iOS/Android. You need apps. With apps comes lock-in opportunities which are never not tapped.

That’s not a limitation for all platforms though. And you’d have that problem on Android whatever solution you opted for. So it’s a moot point.

> So "just use USB" doesn't make technical sense at all.

It does and plenty of people, myself included, owning a pair of Xreal glasses are proof of that.

The problem here is not USB, it’s that you have very specific differing requirements and thus are dismissing the practical value myself and others have shared.

numpad0

4 days ago

> VR headsets are heavy and uncomfortable. USB powered XR glasses are not. And the reason for that is because you don’t need to make those XR glasses as literal portable computers with heavy batteries.

no it's lenses and chassis. Lenses work precisely because of their density difference against air, so the better they are, the heavier they are. Chassis weigh a lot because they use impact resistant ABS and don't make them in forged Al-Li or Ti or molded Mg, which they should consider for hilarity, but then the product will cost like a bad joke. The mobile computer part weighs nothing, they're like somewhat soggy potato crisps. Those 0.8mm PCBs, boy they feel like cardstocks. Batteries weigh a bit, but they're also usually lipo pouches, like 0.5kg/L. You're not putting dozen 18650 into a VR headset.

Especially VR lenses are heavy and bulky because they need short focal lenses with massive pupils for max FOV and max transmittance. The panels tend to be way bigger than that for smart glasses thanks to Palmer Luckey which he deserves credit for. Smart glasses tend to use way smaller panels and prisms with fractions of FOVs relative to VR, like 1/6th? 1/12th? They carry some amount of weight but not nearly as much, especially if it's waveguide or holographic or working as pure fresnels.

I'm not going into the second half of this response. I am sorry but I don't think it's worth anyone's time if I explained why DP Alt don't count as USB and all that stuffs.

hnlmorg

4 days ago

You’re arguing a lot but ignoring what other people are saying. It’s pretty clear from your other comments that you have distain for “software jockies”, but that doesn’t mean that we are idiots who don’t understand how hardware works.

Case in point: even if you took the lenses out, they’d still weigh more than a pare of sunglasses. You even admitted that yourself, but then you quickly brushed over that point.

So does it really matter that lenses are also heavy when we are talking specifically about the battery?

I also happen to know a thing or two about mobile computing hardware and there’s a bunch of stuff you’ve also neglected to mention that would add weight. But ultimately the battery alone is a compelling enough argument.

Let’s also remember that I wasn’t just talking about weight but bulk too. Even if you could get the weight down so it’s comparable to a pare of glasses (you couldn’t, but let’s assume for the moment that you do manage to break the laws of physics), it’s still going to be bulkier than a pair of glasses.

So even if you were right that the lenses were the only thing that matter about weight (which you’re not), it’s still just a moot point.

> I'm not going into the second half of this response. I am sorry but I don't think it's worth anyone's time if I explained why DP Alt don't count as USB and all that stuffs.

I’m not an idiot. I’m well aware that Xreal are using DP, and I’ve already pointed out before.

My point is all I need to do as an end user is plug in a USB-C cable and everything “just works”. The underlying protocol is largely irrelevant. It’s like saying “you’re not using wireless, you’re using 802.11ac…” literally zero consumers give a shit because it’s completely irrelevant to the UX of the device.

numpad0

4 days ago

> I also happen to know a thing or two about mobile computing hardware

You don't. You just don't. You haven't seriously thought about making an HMD. You haven't heard of those microdisplay vendors or had frantically searched how to cheat those electrical requirements. You haven't gutted a mobile device and held the shells and non-compute parts in hand. You haven't even torn apart a phone. You don't know how injection molded Mg chassis feel which don't sit right with your brain.

Your views and opinions and distributions of are based on user side stories and dopamine releasing qualities the elements offer, which is great for marketing existing or virtual products, but isn't well connected to underlying hardware. It's like human figures reconstituted from Penfield's Homunculus, made completely out of proportion.

I already brought up the shell. From the way you fixated on the battery after going through that part, it clearly didn't even come to your mind that the shells can be heavier than it, which I'm sure would be the case for a lot of battery powered HMDs.

You called DP Alt an underlying "protocol". It's DisplayPort. They're like one-way PCIe x1. Back of magazine Agilent vs Teledyne LeCroy stuffs. Besides you called XREAL displays "entirely dumb" when they have more than a 2D sprite engine on board. I know it does 3DoF warping when the host is not whispering the right command. It's a stupid feature but I'm doubtful PS2 can handle that.

And you keep insisting, what appear to boil down to, "use USB dumbass". Nothing about that make any sense.

hnlmorg

4 days ago

You’re making a lot of assumptions about me when you don’t know anything about me.

> From the way you fixated on the battery after going through that part, it clearly didn't even come to your mind that the shells can be heavier than it, which I'm sure would be the case for a lot of battery powered HMDs.

I mentioned the battery because I was making a comparison between wired vs wireless.

It’s really that simple.

> You called DP Alt an underlying "protocol". It's DisplayPort. They're like one-way PCIe x1

I also called it a specification elsewhere. What you’re actually doing there is calling out my incompetence at the English language. And being dyslexic I’d agree with you on that. I guess you’re going to insult me over that now too?

> Besides you called XREAL displays "entirely dumb"

No I didn’t. I said ‘“dumb”’ not “entirely dumb” and the quotes are important too because it clearly demonstrates I wasn’t using the term literally. The context was that they’re dumb compared to “smart” devices. Like how people talk about smart phones and “dumb phone even though “dumb phones” still have more computing power than Apollo 11.

It was a contextual statement, not a literal one. Hence the quotes.

> when they have more than a 2D sprite engine on board.

That depends on the model of the glasses. Mine don’t really do much processing compared to the higher end ones. Xreal make several different XR glasses. Though they all are wired (from what I recall).

The higher end ones do feel a lot more like smart devices, from what I’ve seen. Whereas the lower end ones need a companion device if you want to do anything beyond screening mirroring and audio.

Again, talking about UX here rather than components.

> And you keep insisting, what appear to boil down to, "use USB dumbass". Nothing about that make any sense.

Once again you’re rephrasing my comments in intentionally unflattering ways to misrepresent what I was saying.

I made the point that XR glasses can work without a full blown smart OS when driven by USB-C. And the fact that I literally own a pair of XR glasses that do exactly that, proves what I said not only makes sense, but is also factually correct.

———

Now you can continue to build strawman arguments, misquote me, make unfounded assumptions about me, and generally show bad HN etiquette if you want. But I have a family were my time is better spent. So I’ll leave you to find some other chump to troll this weekend

mycall

4 days ago

> discreet UsB cable behind my ear

If someone could create a fashionable, transparent usbc cable, perhaps replacing copper with indium tin oxide, it might change people's minds about wired.

acka

4 days ago

A real user-centric OS (like a full-fledged Linux distribution, not something intentionally crippled as badly as Android) would use something like PipeWire[1] for this. It's a project designed entirely around managing multiple multimedia devices so they can be accessed by multiple applications, even concurrently.

[1] https://pipewire.org/

numpad0

4 days ago

PipeWire? I don't think you want that kind of thing for raw video output. You want display content to be on VRAM. The void between software jockeys and hardware world sometimes makes me feel numb.

hnlmorg

4 days ago

> The void between software jockeys and hardware world sometimes makes me feel numb.

Comments like the above are completely unnecessary and against the rules on HN

lightedman

4 days ago

"USB cameras also aren't natively supported on iOS/Android. You need apps."

The attachable endoscope for my Ulefone Armor would disagree. It works with the stock Android camera app.

Lo and behold, you just need DRIVERS.

numpad0

4 days ago

Did they finally implement UVC in Camera2/CameraX? I thought that had been Soon(TM) for years.

lightedman

3 days ago

No, you just implement the Camera2 API and camera HAL interface in your driver so your device can talk to all the applications that call that API.

mycall

4 days ago

Some people prefer wired because of external battery, bandwidth, signal stability and integration/interop (e.g. usbc hubs). There are always tradeoffs in designs.

numpad0

5 days ago

(obex or opp or ftp, if you don't care about live previews. Nokia S60 could just do it, so could Windows Mobile 6.x and under. iOS/most Android, nope)

1dom

4 days ago

"How do the glasses serve as a dumb camera to the phone": just like a USB camera. USB protocol, or USBIP. "yeah, but what OS" - what OS does a USB webcam need to be a USB webcam? That OS.

"What if you want to use multiple apps?" for a headset that's a window to a phone, you see the phone screen, the phone handles multitasking. Want to switch between apps? Then switch between apps on your phone, and you see the result.

"Do you want to make an app that accesses the microphone?" again, the phone does it. What OS do my bluetooth earphones run to be accessible from my phone?

I agree with what the person you're responding to wants: just an screen/audio interface with my phone. MentraOS is obviously not* aiming to be that, otherwise it wouldn't have any apps at all, especially not things like a "notes" app or any other app I already have on my phone.

The issue is as soon as you start trying to build an app ecosystem, you inevitably create the sort of opportunities business loves to exploit, and then all of a sudden I've got another layer for big tech to try extract stuff from me, when all I wanted was to be able to see my phone screen without having my phone directly in front of me - as someone who uses apps rather than develops them, I don't need another app store or more apps!

*Edit: having read some of their work culture, and the people involved, this isn't a project that's intended to be owned by humans, this is going to become the worst kind of big tech, or nothing.

verdverm

5 days ago

META wants to be the Android of smart glasses because they know it will be the next dominate form factor when we have desirable devices (also why they are starting with less hardware but a form factor people feel comfortable wearing in public)

Android XR is coming out with Moohan next month, if Visor ever comes out, it is believed that will eventually by on AXR. Apple still seems hobbled since Jobs left

vorpalhex

5 days ago

It is hard for me to swallow the promise of smart glasses and I was dev-ing for the original Google glass.

It's awkward, battery life is a pittance, the display can be useful but only in select cases. Controls are always an issue. LLMs won't actually fix that - voice control is not the answer.

cco

5 days ago

Disagree with you there having used Rayban Metas for about six months.

Always-on access to an LLM via voice is a useful and novel way of interacting with computers.

From trivial things like asking it about a landmark I'm seeing or when I'm driving to tell me about some historical event (almost like an on tap podcast), to slightly more useful things like asking it to add stuff to my calendar/reminders when I'm biking home.

It certainly isn't a replacement for a more robust interface, but it is a very nice way of using a computer while I'm out and about and don't want to pull out my phone.

stavros

4 days ago

I would agree if I could use ChatGPT's advanced voice mode with them. It's purely a software/lock-in issue that I can't, but it means that I never wear my glasses, vs wearing them all the time.

They're so unobtrusive for chatting, that it would be amazing if we could get a capable LLM on the other side. Too bad we can't because corporations like walled gardens.

walterbell

4 days ago

OpenAI walled garden should have Jony Ive's upcoming $6B hardware device for voice chat.

mycall

4 days ago

Except people don't want to wear shades indoors, or if their eyes are find, glasses either. That is its Achilles heel.

jasonsb

5 days ago

I was about to make the exact same comment. But then I remembered that there are billions of people who buy products advertised on Facebook and TikTok because it's "cool" and "fun". So what do I know about the future of smart glasses OS? Probably nothing.

poly2it

5 days ago

How open-source are these glasses really? Are all software components compilable from source, or do they just publish an SDK Espressif-style?

alex1115alex

5 days ago

It's all open-source:

https://github.com/Mentra-Community/MentraOS

grokx

5 days ago

Not really, despite the repo being named MentraOS, this repo seems to include only some mobile apps (that either run on a phone or on the glasses), some server code, and some SDKs. Mentra glasses are likely running on a fork of AOSP, which is not in this repo.

SparkyMcUnicorn

5 days ago

AOSP (or even a minimal fork) is way too heavy to be running on the glasses. It looks like the firmware is quite minimal and the "OS" is the app.

https://github.com/Mentra-Community/MentraOS/tree/main/mcu_c...

alex1115alex

5 days ago

Mentra Live runs AOSP similar to the other AI glasses on the market (Ray-Ban, Xiaomi AI Glasses, RayNeo V3 AI Glasses, etc). It's heavy, but allows us to ship fast. You'll find this code in `asg_client` folder.

We're also working on a pair of HUD glasses that will release in 2026 using an NRF5340 MCU. The code for this is being developed in the `mcu_client` folder.

ENadyr

4 days ago

Please have an option for local processing. I would love to be able to use my locally running Gemma 3n model on my phone for low latency and for them to work without internet connectivity.

alex1115alex

4 days ago

We're going to be putting out a Mentra Edge SDK in the next few months, but it comes with some downsides. Using your phone as a compute device is a battery hog, and you can only connect one app to the glasses at a time.

wiseowise

4 days ago

>> AOSP (or even a minimal fork) is way too heavy to be running on the glasses

> Meta Horizon OS, previously known informally as Meta Quest Platform or Meta Quest OS, is an Android-based extended reality operating system for the Meta Quest line of devices released by Meta Platforms.

https://en.wikipedia.org/wiki/Meta_Horizon_OS

numpad0

5 days ago

Most smart glasses just run AOSP, that's the path of least resistance. Ones without displays are often just Bluetooth headsets in shape of eyeglasses, and only the ones with cameras but not displays are the ones that run a lightweight OS.

zoklet-enjoyer

5 days ago

Live translation is something I've been dreaming about since Google Glass. I just want translation, subtitles, turn by turn directions, and ad blocking.

joshuat

5 days ago

The idea of ad blocking with smart glasses kind of freaks me out. I'll take additive but I don't want subtractive reality where parts of the world are being hidden from me.

dns_snek

4 days ago

> parts of the world are being hidden from me

There's a Black Mirror episode on that (and more), S2E4 White Christmas.

barnabee

5 days ago

> I don't want subtractive reality where parts of the world are being hidden from me

I’ll make an exception for ad blocking as long as there’s a visual marker where the ad was.

ineedasername

5 days ago

Even Realities G1 glasses, which support Mentra, will do the first 2. The 3rd is partial, not quite turn by turn, but you can see a map around you with them on

rippeltippel

5 days ago

> and ad blocking

The possibility of shooting ads directly into the retina is probably the main driving force behind smart glasses.

dmbche

5 days ago

And ultimate attention analysis

g-b-r

5 days ago

and a moving camera with a good excuse to be always on and analyzing everything

michaelmior

5 days ago

> Devs get to write 1 app that runs on any pair of smart glases.

Except it seems they only run on Mentra glasses. Not Meta Ray-Bans, Echo Frames, or any of the many other existing smart glasses platforms.

alex1115alex

5 days ago

Hey, thanks for commenting, but this isn't true. You can check out our glasses compatibility list here:

https://github.com/Mentra-Community/MentraOS/blob/main/glass...

We're also looking to support the Brilliant Labs Halo glasses once they release later this year.

Regarding Ray-Bans: We'd love to support those, but the Ray-Bans are extremely locked down. Nobody has found a jailbreak yet. We're always open to support more glasses provided they're all-day wearable and have an SDK.

michaelmior

2 days ago

Thanks for clarifying! It's great to see that other platforms are supported. This wasn't immediately clear from reading through the website.

arbayi

5 days ago

I just found out about them and it seems super good. I wonder why Meta doesn't support such a thing called "Meta Glasses Application Store"

exe34

5 days ago

I'm more than happy to develop my own apps, but it doesn't appear that they support any one product with all the features yet.

randomname4325

5 days ago

because developers would immediately make ick apps that violate privacy or do black mirror type things that would kill any momentum

SuperShibe

5 days ago

Meta is already doing that and they want all the cake for themselves

misternintendo

4 days ago

I remember trying an early pair of smart glasses years ago and feeling let down because nothing worked beyond the demo apps. Seeing MentraOS now makes me think this could finally be the moment where smart glasses start to feel like real everyday devices.

g-b-r

5 days ago

Store requiring an account, and apps actually running on their servers.

This is definitely not the smart glasses operating system to converge on.

If there's anything worthwhile in it I'd advise interested people in forking it, and turning it into an actually open open-source operating system.

alex1115alex

5 days ago

Hey thanks for commenting. Developers host their own apps - they don't run on our servers. See:

https://docs.mentra.glass/ubuntu-deployment

https://docs.mentra.glass/railway-deployment

In your opinion, what do you think should change to make this an "actual" open source OS?

g-b-r

5 days ago

Ok, although everything seems to go through the "MentraOS Cloud" (https://docs.mentra.glass/core-concepts).

It's not that the OS is not open source, it's that it seems a privacy nightmare; the fact that the app also runs on the developers' servers just adds to the amount of parties you need to trust. That you and the people around you need to trust, actually.

And the company has strong connections to China, by the way.

The system is also not very open, if the users are forced to use your store.

It seems unlikely that there's much to be salvaged, given that you're using AOSP as the actual operating system.

caydenpiercehax

5 days ago

MentraOS allows multiple apps to run at the same time and access context at the same time by running apps in the cloud.

This is enabled by relay servers. You can use Mentra's relay server, or host your own.

This is the architecture that we use and recommend so multiple apps can run at once and access powerful AI, while saving your phones battery. If you need to run offline or on the edge, we're working on the Mentra Edge SDK so you can skip the cloud, but it has downsides - only 1 app at a time.

Remember, every app on your phone is communicating with its own backend - which you have to trust. This isn't different.

Users aren't forced to use the store. You can self host a relay server, self host a store, etc.

g-b-r

3 days ago

> MentraOS allows multiple apps to run at the same time and access context at the same time by running apps in the cloud.

I don't really see why you'd need a cloud for multiple apps to access "context" at the same time (or to be able to run more than one).

Being able to run apps on the cloud is nice, for the ones that are too heavy for the device, but I don't see why it would have to be a requirement.

You'll also have unnecessary lag in some situations, where a simple local app would be enough, and you'll be unable to do anything without an internet connection.

> This is enabled by relay servers. You can use Mentra's relay server, or host your own.

> This is the architecture that we use and recommend so multiple apps can run at once and access powerful AI, while saving your phones battery. If you need to run offline or on the edge, we're working on the Mentra Edge SDK so you can skip the cloud, but it has downsides - only 1 app at a time.

You're able to run AOSP on those devices, I don't see why you couldn't run several lightweight apps at the same time; if you mention the sdk, besides, I imagine that only apps that explicitly add support to run locally will be able to do so.

And, for lightweight software a constant data exchange will easily consume more battery than running everything locally.

> Remember, every app on your phone is communicating with its own backend - which you have to trust. This isn't different.

Every app on my phone?? You've never heard of local, offline apps?

And exchanging some data with a server is not the same as running entirely remotely, which necessarily requires transmitting all the data the app uses.

it's wild that you think that a "cloud app" has no privacy downsides compared to normal software.

> Users aren't forced to use the store. You can self host a relay server, self host a store, etc.

That's good.

But for yours, default store (that would likely become the dominant one, if your system were successful) you decided to require an account, reducing privacy further.

A4ET8a8uTh0_v2

4 days ago

Are self-hosted relay servers a new feature? I don't remember seeing those when I first looked into Mentra. How difficult is it to set up?

I get the trade off. Glasses may some not simply have enough space for hardware. I briefly debated attaching a relay ( some of the processing for what I had in mind could be done with a simple raspberry ).

jajuuka

5 days ago

Good to see someone jump on these early with FOSS. Seems pretty early days for the this OS and the tech though. No device has full support yet. I'm still not convinced smart glasses are going to have any staying power either.

dcreater

5 days ago

I would save your excitement. It's likely the same old playbook that every PE backed startup uses

caydenpiercehax

5 days ago

Fwiw we've been building open source smart glasses tech for 7 years, without a dime of funding until ~9 months ago, you can see it all on GitHub. We actually want this next platform to be open, that's our mission.

dcreater

4 days ago

I don't ever doubt the founders or the early employees. We may not even fault the investors. Its just the nature of the beast that when funds are raised, returns need to be made on investments and that typically dictates certain business practices that are currently prevalent here in silicon valley.

I'll cite the recent thread with Ollama's founders - they said the same thing of wanting to always be open. But if they truly cared about the FOSS community, they would not have moved to shadily fork llama.cpp instead of just contributing to that project and stating it proudly/clearly. This came to a head recently with their priorities becoming clear for the launch of gpt-oss to the point that even Georgi Gerganov himself spoke up.

1dom

4 days ago

From the careers page:

> Life at Mentra

> We're a squad of hardcore builders between San Francisco and Shenzhen working 996 to build the next personal computer. We're upgrading human intelligence with high bandwidth interfaces. We're transhumanist hackers.

> And we're not just here for a job. We're here for a mission.

This is the worst of SV VC bullshit right here and is antithetical to open sustainable software.

"We're here for a mission" - I'm sure all those VC firms involved are there for the the same mission too, right?

If this goes anywhere or becomes anything, it'll be rug-pulled out of open source.

nissepihl

4 days ago

I know the founders and they're very sincere and passionate. I think their drive is more important in shaping the company than the VC capital.

1dom

4 days ago

I don't doubt that they claim to feel that way, and that they feel they'll be the ones who push back against VC profiteering and enshittification.

That just confirms to me that they're in the same position as any of VC backed founder. That's why the VC firm backed them: because they saw an opportunity to profit from someone else's dream.

I would really, really love to revisit this discussion with you and the founders in 5 and 10 years time - I'd be happier if you proved me wrong:)

walterbell

4 days ago

We need more knowledge sharing on the topic of negotiating with VCs. Charles Ferguson's book was good, followed by the Venture Hacks blog from AngelList, https://www.amazon.com/High-Stakes-No-Prisoners-Internet/dp/...

  What we have here is a rare thing - an unvarnished account by an insider of what it took to make a deal with the VC sharks during the dawn of the Internet Age and come out of it with something you could take to the bank. You wont find many other tech business books giving such a detailed account from start to finish. Though it is lacking on the technical side, the view from the 'money guys' is pretty detailed. It is pretty amazing to realize the whole arc of the story is only about two years..  To then leverage his proceeds into some constructive social documentaries like 'Inside Job' is a great second act..

synergy20

4 days ago

interested in getting one of these smart glasses, checked their website, nowhere mentioned if it's good for near-sighted or far-sighted, or both. I hate to wear two pairs of glasses on top of each other.

pjmlp

5 days ago

It seems to be an SDK for apps running on existing iOS and Android devices, hardly an OS.

mayowaxcvi

5 days ago

Very excited by all this! Have been searching for something like this for so long!

asdev

5 days ago

this doesn't include AR right? it can't overlay stuff on what i'm seeing? if not, then it's pretty useless

caydenpiercehax

5 days ago

You're right, it doesn't. Because the glasses that you can actually wear today are not MR/AR.

But as the tech progresses, so will MentraOS to support spatial experiences.

barroomhero

5 days ago

I'm with you. Augmented Reality is what I'm looking for. I've been dreaming about it for decades.

rollcat

4 days ago

Augmented reality is what you already have right here, right now, on your wrist and in your ears.

In my book, AR is completely invisible, until you need it:

- A smart watch + strict notification filters (good idea either way), means you only see a notification when something worthy of your attention happens (you get a text, event reminder, etc). You can glance at the notification and decide if it requires your reaction, instead of reaching for your phone. (And likely, waste another 10min on it.)

- Wireless earbuds with turn-by-turn directions, especially for walking and public transport. Again, you don't need a screen, you can admire your surroundings or read a book.

- Pay for stuff. If you'd spend 10s on pulling a card out of your wallet, it saves you an hour of your life per year.

- Track your vitals. Overall not that important, until you notice and suspect something is wrong - you can compare things month over month, see trends, show it to your doctor, etc. I took a hard hit falling off a skateboard, my watch started a countdown to call for help - I stopped it, but I needed a minute to get up, so it was really reassuring to have this.

croes

5 days ago

So without their cloud service no apps.

Wouldn‘t call that an OS.

fph

5 days ago

Ah. I was about to ask if it is private and if the AI can run on-device, but I guess this comments answers all my questions in the negative. Too bad.

xeonmc

5 days ago

Just as its name indicates, it’s one of the same that comes up every month and produces undesirable waste at the end of the cycle

dcreater

5 days ago

Ridiculous.

Based on everything ive been able to infer and the comments on this thread, perhaps safe yo classify this under the FauxSS rather than FOSS

bighead1

5 days ago

Love this bit from mentra's careers page, https://mentra.glass/pages/careers

  This is not the place for

  * Prioritize work-life balance

user

5 days ago

[deleted]

sneak

5 days ago

> We're a squad of hardcore builders between San Francisco and Shenzhen working 996 to build the next personal computer. We're upgrading human intelligence with high bandwidth interfaces. We're transhumanist hackers. And we're not just here for a job. We're here for a mission.

Being upfront about 996 (and jira hatred further down the page) is wild. I sort of love it.

bobajeff

5 days ago

I love how direct Chinese language/culture is. (At least from my perspective.)

dade_

5 days ago

I was in Shenzhen, electronics market district. I hear Christmas music. What the hell? I round the corner to see a large stage and seating. There is a large banner in English that says, “Consumption Festival”.

dcreater

5 days ago

They're not Chinese

g-b-r

5 days ago

  > Cayden 凯登 Pierce CEO/CTO/Founder 
  > Cayden leads Mentra, overseeing software, hardware, and operations across San Francisco and Shenzhen

  > Nicolo Micheletti
  > In late 2024, he dropped out of Tsinghua University in Beijing to work on MentraOS

  > Thomas Tee 
  > Head of Hardware
  > Thomas leads Mentra’s hardware team in Shenzhen

  > Mentra Shenzhen 
  > Baoan, Shenzhen,
  > 广东省深圳市宝安区
  > 新安街道创业二路
  > 中洲中央公寓1905室

YVoyiatzis

5 days ago

If smart glasses can’t self-adjust vision or flag cataracts, they’re missing the point. This is not being discussed.

senectus1

5 days ago

also the range of shapes... they all seem to be "round" glasses.. I look like an idiot in round glasses i need rectangular shaped lenses.