glisten/mist: Getting in on the v1 hype train | The Gleam Programming Language | Page 1

grand pendant Mar 6, 2024, 2:20 PM

#

It's come up a bunch in the context of libraries, and I've been a bad semantic versioning citizen. So I figured it was probably time to just go for it.

https://github.com/rawhat/glisten is now officially v1 🥳

https://github.com/rawhat/mist is now on its v1 release candidate. Feel free to test it if you want.

Notable changes are relatively minimal, but you can see the CHANGELOGs for details. glisten had a little bit of a glow-up in terms of the public API (mostly just hiding some stuff that didn't need to be public). mist can now do Server-Sent Events, as well as a few smaller things.

Thanks for being awesome everybody lucyglow

GitHub

GitHub - rawhat/glisten: A pure gleam TCP library

A pure gleam TCP library. Contribute to rawhat/glisten development by creating an account on GitHub.

GitHub

GitHub - rawhat/mist: gleam HTTP server. because it glistens on a web

gleam HTTP server. because it glistens on a web. Contribute to rawhat/mist development by creating an account on GitHub.

marsh nest Mar 6, 2024, 2:23 PM

#

hype!!!

#

ooooh SSE

grand pendant Mar 6, 2024, 2:35 PM

#

yeah i'm not sure how solid the interface is for that, but i'm als not sure how/if i can make it better 😕

marsh nest Mar 6, 2024, 2:39 PM

#

Is there an example somewhere?

nova ridge Mar 6, 2024, 2:41 PM

#

Is this the season where all the gleam libs hit 1.0

#

@vivid totem has been harassing me to release glint as 1.0

grand pendant Mar 6, 2024, 2:49 PM

#

marsh nest Is there an example somewhere?

no, lemme put one together... i can look around for a good sample program, but let me know if you have something interesting

marsh nest Mar 6, 2024, 2:51 PM

#

I don't have any clever ideas

#

A clock perhaps?

grand pendant Mar 6, 2024, 2:55 PM

#

ah yeah that sounds good

solar dirge Mar 6, 2024, 3:37 PM

#

nova ridge <@222803261529260032> has been harassing me to release glint as 1.0

it is good for semver reasons

#

a culture of 0.x.y in the ecosystem is quite me

grand pendant Mar 6, 2024, 4:22 PM

#

classic... ```

So, I've searched around for a solution built into the protocol, and it there does not appear to be one. If your server calls response.emit('close') or response.end(), the client will treat this like an error and attempt to reconnect to the server. (At least in the case of Chrome, it will attempt to reconnect indefinitely, unless it considers the network error fatal).

So it appears that one way or another, your client has to close the connection```

#

but my example works, so i'm gonna just ship it lol

marsh nest Mar 6, 2024, 4:22 PM

#

That's quite funny

grand pendant Mar 6, 2024, 4:24 PM

#

https://github.com/rawhat/mist/blob/master/examples/eventz/src/eventz.gleam i'm very open to any ideas people might have around a better API, but this does work. and it unfortunately needs to be pretty imperative

marsh nest Mar 6, 2024, 4:27 PM

#

It needs to be the same as the websocket API minus the messages from the socket

#

Otherwise you are not going to be able to handle system messages, debugging, etc

#

Anything that is about sending and recieving messages should look like an actor and have actor as a base, unless you wanna implement all the under-the-hood OTP stuff from scratch

grand pendant Mar 6, 2024, 4:29 PM

#

i'd really like to not have to spawn another process for this, but i might just have to do that

marsh nest Mar 6, 2024, 4:29 PM

#

Why's that?

grand pendant Mar 6, 2024, 4:31 PM

#

it's the same issue that i've had with the websocket one (and why i'm also spawning a separate process for that)... the selector types need to be different, and i don't have a way to express that with the actor API

marsh nest Mar 6, 2024, 4:31 PM

#

No I mean why do you not want to spawn another process?

#

Every long running process needs to implement the OTP system protocol, debugging, etc. Actor gives you that, but this API makes it impossible

grand pendant Mar 6, 2024, 4:32 PM

#

yes i understand that, i'm gonna change it

marsh nest Mar 6, 2024, 4:32 PM

#

wicked

grand pendant Mar 6, 2024, 4:32 PM

#

it seems a bit superfluous to spawn another process when i have the handler... but i guess it's not going to be doing very much, so that's not really a big deal

marsh nest Mar 6, 2024, 4:34 PM

#

It's like 1ms of latency for something that lives for probably minutes, that's fine

#

I doubt you'd be able to ever measure the difference

grand pendant Mar 6, 2024, 4:36 PM

#

fair point

#

thanks for the feedback!

marsh nest Mar 6, 2024, 4:37 PM

#

No, thank you 💜

#

Mist rules

grand pendant Mar 6, 2024, 4:37 PM

#

lucyhappy

grand pendant Mar 7, 2024, 4:42 AM

#

v1.0.0-rc2 released 🥳 fixed up the SSE implementation! the link above has the details, but it's basically: ```rust
mist.server_sent_events(
req,
response.new(200),
init: fn() {
...
actor.Ready(state, selector)
},
loop: fn(message, conn, state) {
actor.continue(state)
}
)

which i think resolves the issues noted above, and should look as one would expect for something like this 😅

marsh nest Mar 7, 2024, 9:39 AM

#

So what's next on your hit list 👀

grand pendant Mar 7, 2024, 2:12 PM

#

i should probably do the graceful shutdown thing... but i'm also i think reasonably close to http/2? after that... i dunno lol

marsh nest Mar 7, 2024, 2:48 PM

#

HTTP2 would be incredibly cool

#

Honestly that's probably just about everything at that point?

grand pendant Mar 7, 2024, 2:53 PM

#

yeah i also can't really think of much else

#

then what do i do doll

marsh nest Mar 7, 2024, 2:55 PM

#

🤔

#

Looking for another ambitious project?

grand pendant Mar 7, 2024, 2:59 PM

#

haha maybe... everybody here is so good at jumping on cool library ideas

marsh nest Mar 7, 2024, 3:03 PM

#

Websocket client? 👀

grand pendant Mar 7, 2024, 3:20 PM

#

oh yeah that's a good idea

vivid totem Mar 7, 2024, 3:20 PM

#

that'd be really great

nova ridge Mar 7, 2024, 3:26 PM

#

what the gleam http client story like these days

vivid totem Mar 7, 2024, 3:38 PM

#

gleam_httpc is the go-to

marsh nest Mar 7, 2024, 4:20 PM

#

httpc is good enough now that it handles TLS nicely

#

When we have big Gleam companies maybe we'll hit some performance stuff that motivates the creation of something else, but until then I think we're good

nova ridge Mar 7, 2024, 4:20 PM

#

oh when did it get TLS 😮

marsh nest Mar 7, 2024, 4:21 PM

#

OTP26 maybe?

nova ridge Mar 7, 2024, 4:21 PM

#

ooooo

#

nice okay that'll be my default then

marsh nest Mar 7, 2024, 4:21 PM

#

Well it always had it but was painful to configure. Now it just works it seems

solar dirge Mar 7, 2024, 5:57 PM

#

grand pendant then what do i do <:doll:1158482704648642560>

what do you /like/ or are curious about?

grand pendant Mar 7, 2024, 6:16 PM

#

i like gleam

solar dirge Mar 7, 2024, 6:39 PM

#

Maybe work on gleam then? Just an idea?

#

Whatever excites you, so great you did and are doing mist ❤️

grand pendant Mar 10, 2024, 7:20 PM

#

blureyes

nova ridge Mar 10, 2024, 7:20 PM

#

grand pendant <:blureyes:1148462923023405056>

I have no idea what I’m looking at but I’m hyped

#

hype

marsh nest Mar 10, 2024, 7:32 PM

#

I love how @grand pendant just casually drops these super technical projects

grand pendant Mar 10, 2024, 7:33 PM

#

well i "cheated" a bit since i did most of the work in mist lol

grand pendant Mar 10, 2024, 7:33 PM

#

nova ridge I have no idea what I’m looking at but I’m hyped

websocket client

marsh nest Mar 10, 2024, 7:33 PM

#

“I cheated by implementing it by hand” sure ok dude

nova ridge Mar 10, 2024, 7:34 PM

#

Self-plagiarism

marsh nest Mar 10, 2024, 7:34 PM

#

I’m telling hbomb

grand pendant Mar 10, 2024, 7:35 PM

#

lucydebugfail

marsh nest Mar 10, 2024, 7:37 PM

#

I love that emoji

grand pendant Mar 10, 2024, 7:37 PM

#

me toooo

#

don't want to annoyingly ping, but dylan (dmmulroy) was working on a twitch client on stream last night, and will need a ws client it seems. so it felt a little serendipitous with the previous mention too lol

#

still needs a bunch of work so idk how soon i'll be able to publish it, but i'm happy with the progress for how long i've spent on it so far

marsh nest Mar 10, 2024, 7:42 PM

#

Have you told him?

grand pendant Mar 10, 2024, 7:43 PM

#

it came up in chat, but i also don't want to like block him if i can't get it reasonably functional soon lol

marsh nest Mar 10, 2024, 7:43 PM

#

that's fair

#

I thought you meant to block his messages on here for a second

#

I was like "wow he always seemed nice to me"

grand pendant Mar 10, 2024, 7:45 PM

#

this is my super secret chat

marsh nest Mar 10, 2024, 9:41 PM

#

ok so

#

why is Gleam is quotes? 😆

#

is it secretly written in Elixir

flat yarrow Mar 10, 2024, 9:44 PM

#

Those are back ticks (`) not quotes (" or ')

nova ridge Mar 10, 2024, 9:52 PM

#

Inline code formattting

marsh nest Mar 10, 2024, 9:52 PM

#

I think it's secretly Lua

grand pendant Mar 10, 2024, 9:54 PM

#

i will remove it haha

#

just wanted to squat the name

marsh nest Mar 10, 2024, 10:00 PM

#

wise

midnight harbor Mar 11, 2024, 1:29 AM

#

grand pendant just wanted to squat the name

so the airquotes are cause its vapourware

grand pendant Mar 11, 2024, 1:41 AM

#

ouch

marsh nest Mar 11, 2024, 10:16 AM

#

burn

grand pendant Mar 23, 2024, 5:32 PM

#

not sure if this warrants yet another thread but... i did the thing https://hexdocs.pm/mist/ 🎉

mist · v1.0.0

a misty Gleam web server

marsh nest Mar 23, 2024, 5:33 PM

#

Hypeeee

#

Big day!

grand pendant Mar 23, 2024, 5:35 PM

#

the perf seems to be back to parity with 0.17 so i'm happy with that

marsh nest Mar 23, 2024, 5:38 PM

#

What was the issue?

#

I guess periodic benchmarking is worthwhile

grand pendant Mar 23, 2024, 5:39 PM

#

it was the date generation on every request

#

and yeah, that does seem useful

marsh nest Mar 23, 2024, 5:39 PM

#

So what do you need the date for?

grand pendant Mar 23, 2024, 5:40 PM

#

it's required by the spec

#

to include that header

marsh nest Mar 23, 2024, 5:43 PM

#

TIL

grand pendant Mar 23, 2024, 5:43 PM

#

it has been an enlightening 24 hours lol

solar dirge Mar 23, 2024, 6:04 PM

#

which soec, websocket or http? latter because of proxies and cache?

solar dirge Mar 23, 2024, 6:04 PM

#

marsh nest I guess periodic benchmarking is worthwhile

i feel confirmed once in a while

#

still not a great hack but confirmed in my intuition 🙂 at guessing the culprit on bird/system date fetch

marsh nest Apr 22, 2024, 2:12 PM

#

For the timestamp thing

#

Is it an int that is stored?

#

I was wondering if it might be faster to use atomics than ETS or such

#

storing the atomics ref in persistent term

grand pendant Apr 22, 2024, 2:13 PM

#

i can try that

#

i'm currently storing the string, but could also just use the timestamp

#

err

#

we'd talked about it, but i'd need to re-implement some stuff, since i'd need to store birl.now() which is a type

marsh nest Apr 22, 2024, 2:24 PM

#

You don't need to store that record

#

you are not going to use the monotonic clock

#

only the wall clock

grand pendant Apr 22, 2024, 2:26 PM

#

yes i'm just saying, i'd need to implement the formatting stuff myself in that case

marsh nest Apr 22, 2024, 2:40 PM

#

Can just vendor that one function

grand pendant Apr 22, 2024, 2:46 PM

#

i can try it... do you think ETS will be a significant performance impact?

marsh nest Apr 22, 2024, 2:46 PM

#

Nah

#

It's fast

#

Atomics is faster though

#

Idk if you could measure the difference in the context of Mist

grand pendant Apr 22, 2024, 2:47 PM

#

yeah, makes sense

#

now that the start app module thing is working, i may just... do that and call it a day

nova ridge Apr 22, 2024, 2:55 PM

#

are erlang atomics only ever ints? 🤔

marsh nest Apr 22, 2024, 2:55 PM

#

atomics are a CPU feature and they're always numbers yeah

#

oh hmm does the BEAM not expose atomic floats

nova ridge Apr 22, 2024, 3:07 PM

#

marsh nest oh hmm does the BEAM not expose atomic floats

Atomics are 64 bit integers.
🤷‍♂️ seems not

#

are there any better docs than just the erlang stdlib docs for the atomics module

marsh nest Apr 22, 2024, 3:09 PM

#

Don't think so

#

What are you after?

nova ridge Apr 22, 2024, 3:16 PM

#

marsh nest What are you after?

mostly trying to understand when to use atomics vs ets vs a process

marsh nest Apr 22, 2024, 3:26 PM

#

if you can use atomics use atomics

#

If it's data use ETS

#

if it's behaviour use a process

#glisten/mist: Getting in on the v1 hype train