Great and cool to see this, as well see some fellow smart glass enthusiasts on Hacker News.

I've been an avid enthusiast and promoter of Meta Ray Bans since Oct 2023. They are very handy and I think for anyone person who wear sunglasses or glasses and uses their phone to take pics or vids then they make a ton of sense (both things you can do with them without needing your phone.. also ask them for the time). Though Im not sure even the HN population is much about them.

Albeit I love them I do not think as you see the media and i guess Zuckerberg saying they are the next computing platform that to be true. You can not take selfies with smart glasses unless they offer a pop out tiny drone in the glasses to take pics of u lol. Thus, I think they will be complementary to our personal pocket smart and or upcoming pocket AI devices, which will able to take the best selfies of you ever (ur AI friend see on the lock screen directs you to the best light to get the best selfies).

Is there an opportunity to partner with (or sell to) one of the big digital sheet music vendors (like Musescore or Music Notes, etc)? I've never come upon a compelling personal use case for smart glasses, but as a pianist this could be it. I would HAPPILY purchase both glasses and a subscription from one of the big music vendors if this worked seamlessly and I could do things like embed a metronome or link it to my DAW so I could control things like tempo, rewind, even key transposition.

This is such a great use case. I stand in front of my monitor with my guitar and have to scroll the sheet music. So that means stop playing. I often wander away from my computer and then come back if I forget how a section goes.

I'm using tabs not notes, but I'm assuming/hoping your solution will adapt quite easily.

I wonder if you could use a microphone to listen for the notes in order to get auto-scrolling. Because you know the general timing, you're not searching through the entire song (likely) but honing down on the exact point that person is at. An inobtrusive metronome might be nice to.

Congats! One of the best projects I've seen in a long time, and particularly such a good use case for the early stage of this hardware.

Nice project, but I do not get the competitiveness of part of its implementation details:

-- the project uses "Even Realities G1" AR glasses (640x200, 25°FoV, 1bit green), while the "Epson Moverio" AR glasses can have overwhelmingly superior specs (1920x1080, 34°FoV, full RGB) for possibly an even lower price;

-- software wise, it «uses AugmentOS's SDK to communicate with Mentra servers which talk to the mobile app which talks to your ... glasses» - while an Epson Moverio system would just directly use the glasses as a display for an Android device...

Both gaps between the available and the employed make very little sense.

Professional collaborative pianist here.

This is very inspiring; congratulations! I’m sure there will be performance gains along the way, but upload time will be critical to optimize for in professional settings. Even forScore on the iPad is sometimes too slow. I was performing the Tchaikovsky Rococo Variations not long ago with a cellist; and the seventh variation flies by at such a breakneck tempo that I had to use the half page turn trick to make it work.

The other thing that pianists in particular are picky about are editions. At least 95+% of the scores on my iPad are straight-up pdf scans of particular print editions. In terms of workflow, I would think that it has to ingest pdf for it to be viable for working musicians.

All that said, in chamber music settings, I can imagine the freedom to visually engage with your partners could be very compelling! Good luck with your next steps.

A full orchestra on stage playing with no music stands sure would be make for a nice sight (assuming the glasses looked like regular old glasses -- (or maybe blues brothers shades)).

Three seconds to send a bitmap? And I thought the Brilliant Monocle/Frame was slow! In the video it looks like you don't get more than a bar or two on-screen at a time... wouldn't any reasonably fast piece outpace the rate at which you can get the next bar on the device?

Great job! For converting music to readable images, the latex of music typesetting is lilypond, which has the ability to create legible music at any size by scaling the notational glyphs accordingly[1]. This sounds like what you were trying to achieve achieve with opencv.

With that being said, although lilypond is very intelligent about all sorts of typesetting minutiae, but it's probably difficult to wrangle it to run on smart glasses.

[1] https://lilypond.org/doc/v2.24/Documentation/essay/engraving...

Congrats! Great video write up also!

Very cool idea and demo.

The ability to adapt paper music would be useful. In some genres -- I play big-band jazz -- virtually no material is available in printed form, or it's in the composer's preferred format, which is typically PDF.

This would be incredibly useful for sight reading.

Instead of 30 pedals, give the conductor a butt-on.

[flagged]