#theta-testnet-001 relayers
1 messages ยท Page 1 of 1 (latest)
We are running
can add to the update script any running channel or create new, whatever is needed)
I can
haha, almost everything expired after fork
I had a channel running in theory, but doing system work on indexer atm, so not sure how stable it is
you just create it, it is leaving without you but can die without you ๐ need txs or updates
can add any channel to hermes and make sure it wont be expired. just tell what
set up update txs every x hours
we also can add/open channel and back up it
actually, I could set up a channel too. I'd need some naan and atom testnet tokens tho
- someone opens to don't spam with a lot
- others configure update scripts
the only question is in naan for updating and test atom))
how much naan and atom is required to run for 10 days properly
i have decent atom,
Actually working on it as we speak
Having an issue getting test atom though, seems people are spamming the faucet.
how much do you need?
amazing! thank you!
question: assuming we support a specific channel and the relayers have lots of ATOM and NAAN, what could go wrong if hundreds or thousands of participants are trying to use the channel for transfers?
we have testnet ATOM for theta-testnet-001
out of balance for operators
10 to 50 would be just fine
Channel can be full. May be good idea to have several channels
stuck txs that must be cleared from time to time I suppose
Query hermes for unreceived packets and acknowledgements with the following:
hermes query packet pending --chain <A> --port transfer --channel channel-A
hermes query packet pending --chain <B> --port transfer --channel channel-B
Clear the channel with the following:
hermes clear packets --chain <A> --port transfer --channel channel-A
hermes clear packets --chain <B> --port transfer --channel channel-B
Update clients with the following:
hermes update client --host-chain <A> --client 07-tendermint-A
hermes update client --host-chain <B> --client 07-tendermint-B
the nam i running out quickly hahaaha
i will try to send, what i can
Gimme a sec, i'll get you my address
isn't each channel considered a different asset by the recipient chain?
you are right, this will make lot of questions
cosmos1h9krsew6kpg9huzcqgmgmns0n48jx9ydfvz354
how much NAAN does it cost per transaction, roughly? like roughly how much NAAN would a relayer need to handle all the txs
No. As i know, channel support all assets from one chain to another
I'm on board, and will provide the channel soon if still needed tomorrow.
depends on gas. main costs come from 2.5 naan fee
based on my experiences maybe 1 or 2 , cmiiw
if all relayers ran out of NAAN, would the channel expire?
Only if channel have no transactions during some time
in case no any activity at all then yes
and there wont be any updates if out of balance
and it will not coz update will not be done as no naan/atom ๐
yes
because the fees of ibc-client update is really expensive tbh hahaha
on the Namada side they are?
yeah
they are not expensive. expensive tx on namada
how are the ibc client update fees determined / set?
yes
ah!
not on another chain. only on namada
they will be 2.501 NAAN
so Namada tx fees are high, making client update fees expensive
you can limit max gas in config, but risk that then tx will be failed if gas will be high all the time
how are Namada gas fees set? validator operators? in their client
Chain activity and validators settings
i've already try that method and the result is the same as what you said
wrong
it's not corelated with the validator settings i think
in Cosmos chains i recall that validators set a minimum gas fee in their config file
That's right
oh well, probably not worth pursuing lower tx fees rn
will just need to calculate how much relayers will each need in NAAN, assuming.. we happy assuming 2.5 NAAN per tx?
a governances proposal for running a relayer for x naan would be cool!
just add extra dust like 0.01 naan
network down at the moment , query rpc or some error not sure
wdym?
looks like there was an upgrade to theta-test-001 chain
tx wont be really expensive. main issue is 2.5NAAN per tx. All other stuff like chain activity and so on wont cost much
that's the real problem i think
to clarify, is the issue that any tx is ~2.5 NAAN? or specifically it will cost the relayer 2.5 NAAN per IBC tx?
thinking it might be more
Not necessarily, non operators can also run update command in order to update ibc clients on both sides
won't relayer wallets still pay for relay?
for which? relaying IBC txs vs any Namada tx
https://rpc.sentry-01.theta-testnet.polypore.xyz/ this one works for me
Yep, but if others help in order to update clients, relayer operators won't spend too much
ibc. thought my relayer wallets were drained at higher rates
any tx 2.5 naan
sure
Ouch
i am sure this won't be coordinated ever)
We have decided the canonical channels already?
not yet
For theta-testnet-001
And just like that, NAAN became valuable hah
I'm sure there are people with some hundreds of k naan
If anyone already has one, I will kindly help funding the relayer address as well as updating both clients regularly
I have a ton of NAAN, thats why I spoke up but still working on getting my relayer working. Once I'm confident I'd be willing to do this @urban stag
๐
Well have no problem to fund relayer
hermes created by informal systems, right?
check dm
going offline for an hour or two, ping me if y'all need anything from me on this
Yep ๐ but not by me ha
can you comment in your addresses? https://docs.google.com/spreadsheets/d/13tnM-o8Cmcpmu7Q9_7xGRZHmGWCUxT4i2UIdlpF3KII/edit?usp=sharing
I just need some test atoms and i'll be up
comment only, no edit perm, sent req
can't you suggest edit? and then i can accept and it will be permanent
ah, as a comment, I guess yes
Add me too
add Mike
already request, "i'm baconvalley"
okay i've dropped some usernames into the sheet
we should probably limit it to 8 relayers, because we'll need to keep all of these funded
do you want multiple channels?
Multiple operators in one canonical channel
Sent edit request
Seem like 8 is enough, so I won't request
like it
when you get the chance, pls comment in:
- tnam address
- theta-testnet-001 address
left comment
added you
any chance to add me?
don't have google-access to edit. if someone can fill in this I'd appreciate: (assuming it's the relayer addresses)
cosmos185h858752697h2ut6q04eascjy5vknr3emt8pj
tnam1qz7zlsyt780rzdga5cdda7epddu4g7thxv5vmt3j
(back in a lil bit)
i'll add you
I also can if needed
but that's it, cut-off is 9
If there are still openings, please add me
thanks SO much for volunteering!
just don't forget us in the future ๐
there's a lot to remember ๐
but i would like to try a more focused incentivized testnet, similar to #๐ ๐ฅ-housefire-canary-net
really this is about the chance to work together a bit to advance this shielded expedition to its finality, haha
We have been capturing all open clients. We are happy to keep running.
not incentivizing relaying here, just to be clear
Being in top 100 is enough ๐
you'll be in top 100 relayers ๐
Just made a new one after hardfork
`Namada
"channel-1137",
Theta
"channel-4117",
`
correct trusting period?
what number do you think is correct?
I use script to update tendermint user every 5 minutes
no more questions
each chain has its own tursting period. for example if in axelar you create it with wrong , your channel won't be accepted
creating channel is not only run hermes with guide from chat
how can I check if my relayer is healthy?
no no, i've created my own ibc channel, i only asked
anyway this is testnet so we are free to do everything)
shielded-expedition.88f17d1d14 client_id: ClientId : ClientId("07-tendermint-3540") , connection_id: ConnectionId("connection-1738")
theta-testnet-001 client_id: ClientId : ClientId("07-tendermint-3516") , connection_id: ConnectionId("connection-3622")```
it should not be more than unbonding period and you can't start relayers if the config is wrong, actually, even config test is enough
i know it. fact that you can relay doesnt mean your channel is correct for counterparty
yes we were running it before fork, we can enable it again
I am still wondering about the trusting period in Namada, using now smth like a bit more than 1 hour, but didn't try to find a border value
I doubt, if it is dead, only through gov
does it cost NAAN to relay an asset into Namada, out of Namada, or both?
if we put like 2500 NAAN on each relayer, that's like 1000 txs per relayer
from namada to external - yes, apmk
Yes
maybe, i think so, have thoughts guys?
how to fix this?client state is not valid: latest height is outside of trusting period!
and update costs as well
that is like 1k tx, but this 1k include update clients and so on
I would suggest relaying in other way
You need just 2-3 operators for just updating channel
dead ๐ restore through gov (almost impossible in testnets) or re-create new
we should not overspend on updates, no need to have 8 updaters for 8 relayers, even one is enough, but if it is stable
ohh interesting
how do you limit a relayer to just updating vs relaying?
easy
you are not running relayer. You running just one bash script in cron)
what is the best value here?trusting_period = '4752s'
You are in wrong place
I recall in one of the projects there was a discord bot with notifications about clients close to expiration
how often do updates happen?
how often must they happen to prevent the channel from expiring?
/root/.hermes/bin/hermes update client --host-chain namada --client 00--tendermin--
in case of current testnet 2 times a day more then enough
#1222959128629215262 message ideally)
must relayers always be updating? or can we just relegate that to the bash script
missed it
solutive
they should be manually updated only if there is no any activity for a day for example
I know the project, but not sure they can share, need to ask )
quasar use it too
i saw it in their official server
does an update happen when an IBC tx is relayed?
didn't see in discord, maybe closed
yes
this is the ~2.5 NAAN, yeah? or is it 2.5 NAAN for the update and 2.5 NAAN for the relay
2.5 total
Guys, take into account that in Namada we should use pipeline_length as a reference to set the trusting period instead of the unbonding_length
check their "ibc-monitor" channel
2/3 of pipeline_length
just when you relay out of namada you use naan
is the NAAN cost for every IBC tx, or just relaying transactions away from Namada?
2 ways
ah! thanks (great timing, haha)
because the update happens regardless, and that's the cost?
no, when assets come from other chain, they should be relyed at distant chain too.
if i sent tx from namada to cosmos there will be tx at namada, and at cosmos) aand someone should pay for them)
sry, i might be wrong, i think it used both ways
Relayer would pay NAAN for recv tx (receiving in) and ack txs (sending out)
yes you are correct
how is this for a plan?
- four of us run an updater script and not a relayer
- each set to update like 12x per day; each funded with 1000 NAAN
- five of us run relayers
- updates set to manual; each funded with 5000 NAAN
time horizon being 7 days
why don't we create our Namada <> Cosmos configurations similarly for each other? the only difference is in the memo
this is a good plan
2nd group is the main in fact, and the 1st is just to make sure nothing gonna broke
It looks good to me
seems good
do u mean in hermes config.toml?
great! thanks for all this support
Yep
is there an example of a bash script for cron?
can i dm u
so command will be after we create channel; AFK for a couple of hours
Ofc
We will, as we talked before ๐๐ผ
We can take Min. epoch duration: 43200 to get an estimate in seconds of an epoch and then: 43200 * 2 = 86400 * 0.66 = 57024s -> this is the "ideal" trusting period on Namada's side
amazingly amazing
great! @cunning finch i made you an editor, are there other setting that relayers will need? and/or will be needed to open the channel
@quaint arch is going to take over coordination
i think he'll start with sending some tokens (NAAN & ATOM), and then discuss opening the channel
for reference, here's the coordination sheet: https://docs.google.com/spreadsheets/d/13tnM-o8Cmcpmu7Q9_7xGRZHmGWCUxT4i2UIdlpF3KII/edit#gid=0
@here take note your role
ัosmos side trusting period?
upd addrs relayer
hey @minor solstice don't forget to comment your address in the spreadsheet
check the spreadsheet
supporting IBC channel [tbd], set updates to manual- this can cause a little confusion ) ( would be better if u can remove this)
Just added the trusting period as well for Cosmos testnet. Aside from that, I think default values can work fine. Will add gas settings as well just in case (unsure if they are ideal on Cosmos side, but it worked to me previously)
sent naan and testnet atom to everyone
(@minor solstice once you add your addresses i'll send you some too)
don't forget to use filter packet to only relay your own channel messages
so now we just have to agree on a canonical channel-id, which bengt needs to compile the wasm tomorrow and make the governance proposal
and then keep it active during and after the proposal period or we have to start all over again
I have atom test if needed and many naan (reward)
@cunning finch
Yeah, but that's after channel creation. Will add it afterwards ๐
I'm all set, I just need cosmos coins (naan is available).
ready
So now we have to agree on who will create the canonical channel?
sure, is anyone set up and ready to make a channel?
hey im running IBC relayer between Theta and Namada, but just have 2 ATom and 650 naan in my wallet, so maybe i will need more tokens
do i must change my hermes config to the same setting on google doc ?
oh i saw a cutoff
Ideally yes, especially the trusting period, even though if you already set a value that's notably lower than the recommended one when you created the channel, we'll need to create a new one with those
anyway if u need more volunteer, im ready
asked if someone could input my values as per message above, but nobody seems to have taken the task
someone do me a favor and input these? I don't have easy access to edit google docs
@quaint arch my addresses are here
do we all relay the same channel or?
You don't need access, post a comment and they'll add it all up
Daniel adding atm)
right click, comment, later it will be entered as main text
Yep, added
bro, I meant what I said. thanks to whoever put it in there ๐
got a channel:
SUCCESS Channel {
ordering: Unordered,
a_side: ChannelSide {
chain: BaseChainHandle {
chain_id: ChainId {
id: "shielded-expedition.88f17d1d14",
version: 0,
},
runtime_sender: Sender { .. },
},
client_id: ClientId(
"07-tendermint-3546",
),
connection_id: ConnectionId(
"connection-1743",
),
port_id: PortId(
"transfer",
),
channel_id: Some(
ChannelId(
"channel-1142",
),
),
version: None,
},
b_side: ChannelSide {
chain: BaseChainHandle {
chain_id: ChainId {
id: "theta-testnet-001",
version: 0,
},
runtime_sender: Sender { .. },
},
client_id: ClientId(
"07-tendermint-3518",
),
connection_id: ConnectionId(
"connection-3624",
),
port_id: PortId(
"transfer",
),
channel_id: Some(
ChannelId(
"channel-4118",
),
),
version: None,
},
connection_delay: 0ns,
}
whoop, just made one as well haha
changing to that one
for the 'updaters', does this look right? we just have to run this in a cron job?
hermes --config ~/.hermes/config.toml update client --host-chain theta-testnet-001 --client 07-tendermint-3518
hermes --config ~/.hermes/config.toml update client --host-chain shielded-expedition.88f17d1d14 --client 07-tendermint-3546
Yeah, a loop in a bash script will do the trick as well ```#!/bin/bash
while true
do
hermes update client --host-chain shielded-expedition.88f17d1d14 --client 07-tendermint-3546
hermes update client --host-chain theta-testnet-001 --client 07-tendermint-3518
sleep 6000
done```
@minor solstice sent you funds
@pallid wolf @elder cipher did i get your addresses yet?
mikhail88888
not yet, wait me a minute
namada : tnam1qqd3z5qeg0pu0s5h24szxq4pe4dgd3naxsztstjw
cosmos : cosmos1tqzktq6ukyvu83r2sd8g3mjsjhp2pf9q08nxzc
got funds on nam. were you sending on atom as well?
received on atom
as well
got my relayer set up with my pubkey in memo, assuming it's best if we remove that before going live?
okay , 2 IBC channels are healthy
do we need to do anything special to relay this channel, or just configure permissions so this is what we relay?
Transfers from/to working fine
transfer/channel-1142/uatom: 160```
```gaiad q bank balances cosmos1ay642tntyt36kpgu7x2ynkxptq0gar4qenf7kt
balances:
- amount: "16"
denom: ibc/F04FF8C3379F78D47F8839AE06C6EA217176BE98D0FA0550914195B4BF501E23```
i will comeback next 4 hours, its 4AM rn, sry guys ๐ฆ
ty, tokens should be there when you get back ๐
nothing special, but you might want to set filters to only those channels so you don't run out of gas early
exactly. I'll have to create a channel of my own to create the client I think but guessing that's not an issue. will get on it asap
wyt @quaint arch remove this?
no reason to but up to you
alright I'll just leave it there then.
can track what goes through mine
In order to register it for shielded set rewards, do we need the tnam address-like denom of the (shielded?) testnet atoms, right?
If I'm not wrong
yep which depends on the channel (though the code will convert it from human readable)
const ATOM_BASE_TOKEN: &str = "uatom";
let ibc_atom_denom = format!("transfer/{ATOM_CHANNEL_ID}/{ATOM_BASE_TOKEN}");
let ibc_atom_token = ibc::ibc_token(&ibc_atom_denom);
# then use this to change various parameter values
Omw home, just seeing this. Is the issue with clients randomly freezing resolved btw? Relayers here who had this happening? Or was this related to a specific hermes version?
trying to create client but atm got severe issues with my rpc. thought only validator. some widespread issues with timeouts idk why. but everything complex on rpc fails atm (anything with lots of calls). I'll try later and see if it calms down. if more practical to have someone else run it lmk, think it'll come through eventually though
why do you need a client? for the sake of testing by itself?
was under the impression a client needed to be created in order to start the relayer. that's not the case?
nope, you can use an existing one, that is the target here: have one canonical channel which already created
I can boot up hermes fine ofc but have a feel it'll stall on relays for same reason. but definitely willing to give it a go
ofc, just thought I had to go the other route
let me see how it behaves then..
the other route is what everyone did during last month and how my page appeared: >1k not working clients ๐
aye
alright started relaying, let's see how this goes
those channels are not active atm... actually, their clients have expired
Weird. Thanks for pointing that out, I should have monitored more closely. I take it back then ๐
can you guys add me as well?
we must change to exact tendermint id and channel id in google sheet right ?
btw i received naan tokens but atom still low on funds
relayer set up, updates and tx checked. working!
which issue was that? hadn't heard about it yet
i'm also finding hermes times out on namada rpc calls about ~30% of the time, even just a hermes health-check fails randomly. maybe just system specs issue, if the node is busy with masp stuff?
is anyone else getting that?
Will link to it in the other chat
Facing the same time to time
think it's a more general rpc performance issue
created a gh issue on this, but so far hasn't gotten much attention (the more general issue)
are people still running v1.7.4-namada-beta7 or should we switch to v1.7.4-namada-beta8-rc from last week?
I'm running beta-7
the long form memo branch
imma be out for a few hours, will check back here later if any developments
beta-7 as well, haven't set up my relayer yet though. Are there enough people already? Saw that gavin preferred a small set.
I think I'm currently myself relaying, pretoro, and Gylijov from Nodiums
Sheet updated. @molten drum hey Liver, do you have Hermes running already?
Aah, aah I read passed that, thank you!
Afaik the only active updater is Spork for now
I'm also running update commands though, just in case
only in the sense that we don't have unlimited tokens to keep everyone topped up, anyone is welcome to relay ofc if they already have funds for gas
Got it! I'll just turn one on, no need to place me in the sheet. If there comes a moment where we run short on relayers, some have difficulties or have to bail out then I'm here!
Still got like 10 testnet ATOM
Curious to see how quick that depletes
ty for the offer! we're not adding more to the sheet but only because we don't want to add too many and run out of gas funds
Hehe yw and yes that's for sure the right choicee
Think it's on now. Channel-1142 <=> channel-4118.
How often do you update btw?
Could set a script up for that as well just in case
Ah 12x a day, so every 2hrs, got it.
synced client id and host chain with sheet, do we just wait now ?
Oh lol, I just realized that response wasn't towards me ๐คฃ!
Awkwarddddd
++ from yesterday yet
just do not see real activity atm, yesterday tried 2 transfers, and both were done through your relayer
cosmos tx didn't go through last time but should have it now
should i do this loop scripts ? @quaint arch
today we'll hopefully test the shielded rewards proposal code on campfire and then post a proposal on shielded expedition for voting next week (we don't want voting period to be during the long weekend)
yep that works
ThreadId(01) connection handshake already finished for Connection { delay_period: 0ns, a_side: ConnectionSide { chain: BaseChainHandle { chain_id: shielded-expedition.88f17d1d14 }, client_id: 07-tendermint-3546, connection_id: connection-1760 }, b_side: ConnectionSide { chain: BaseChainHandle { chain_id: theta-testnet-001 }, client_id: 07-tendermint-3518, connection_id: connection-3631 } }
i updated hermes relayers to the same cliend id as google sheet, but the connection id is difference.
its still okay right ?
hmm, i'm not sure why... it should look like this
~$ hermes update client --host-chain shielded-expedition.88f17d1d14 --client 07-tendermint-3546
2024-03-29T14:32:35.107647Z INFO ThreadId(01) using default configuration from '/home/hermes/.hermes/config.toml'
2024-03-29T14:32:35.108255Z INFO ThreadId(01) running Hermes v1.7.4+38f41c62
SUCCESS [
UpdateClient(
UpdateClient {
common: Attributes {
client_id: ClientId(
"07-tendermint-3546",
),
client_type: Tendermint,
consensus_height: Height {
revision: 0,
height: 20964457,
},
},
header: Some(
Tendermint(
Header {...},
),
),
},
),
]
you know if proposal 447 is you guys or pretendoors?
Because my relayers had difference channel id previously , so i created another one with the client id on sheet.
My update client log still the same as you
proposal 447 is 'proposals swarm', do you mean a different id?
either way, we didn't make any proposals recently nor did heliax
sorry typo. 477
you need the channel id in the hermes config and not the client
and in the update script yes, client )
hm, anyway funny and strange here how do you get diff connection with the same clients, only if someone created manually an additional connection....
lol
2024-03-29T14:59:00.840454Z INFO ThreadId(01) using default configuration from '/home/namada_rpc/.hermes/config.toml'
2024-03-29T14:59:00.841186Z INFO ThreadId(01) running Hermes v1.7.4+1ede457f
SUCCESS ConnectionEnd {
state: Open,
client_id: ClientId(
"07-tendermint-3546",
),
counterparty: Counterparty {
client_id: ClientId(
"07-tendermint-3518",
),
connection_id: Some(
ConnectionId(
"connection-3624",
),
),
prefix: ibc,
},
versions: [
Version {
identifier: "1",
features: [
"ORDER_ORDERED",
"ORDER_UNORDERED",
],
},
],
delay_period: 0ns,
}
2024-03-29T14:58:28.581937Z INFO ThreadId(01) using default configuration from '/home/namada_rpc/.hermes/config.toml'
2024-03-29T14:58:28.582374Z INFO ThreadId(01) running Hermes v1.7.4+1ede457f
SUCCESS ConnectionEnd {
state: Open,
client_id: ClientId(
"07-tendermint-3546",
),
counterparty: Counterparty {
client_id: ClientId(
"07-tendermint-3518",
),
connection_id: Some(
ConnectionId(
"connection-3631",
),
),
prefix: ibc,
},
versions: [
Version {
identifier: "1",
features: [
"ORDER_ORDERED",
"ORDER_UNORDERED",
],
},
],
delay_period: 0ns,
}```
we have two connections on the same client 07-tendermint-3518 (cosmos side)
lol
If I'm not understanding wrong Hermes docs, this is possible actually? ๐ค
https://hermes.informal.systems/documentation/commands/path-setup/connections.html#new-connection-over-existing-clients
yes, but why someone created them
and this makes me thinking I am missing something ๐
2024-03-29T15:01:59.428249Z INFO ThreadId(01) using default configuration from '/home/namada_rpc/.hermes/config.toml'
2024-03-29T15:01:59.428729Z INFO ThreadId(01) running Hermes v1.7.4+1ede457f
SUCCESS [
PortChannelId {
channel_id: ChannelId(
"channel-1140",
),
port_id: PortId(
"transfer",
),
},
PortChannelId {
channel_id: ChannelId(
"channel-1141",
),
port_id: PortId(
"transfer",
),
},
PortChannelId {
channel_id: ChannelId(
"channel-1142",
),
port_id: PortId(
"transfer",
),
},
]```
```hermes query connection channels --chain shielded-expedition.88f17d1d14 --connection connection-1760
2024-03-29T15:03:24.786621Z INFO ThreadId(01) using default configuration from '/home/namada_rpc/.hermes/config.toml'
2024-03-29T15:03:24.787084Z INFO ThreadId(01) running Hermes v1.7.4+1ede457f
SUCCESS []```
do I need to update client to the client listed in the canonical channels json?
update script? yes, you need to update specifically those clients
Created a channel below.
tnam1qq7nfjqrsg8x9vssf87wamav883dw6eargagd763
cosmos1980eh8cnppjs6yn6wre7tgj9ywe6swwc75hn6e
SUCCESS Channel {
ordering: Unordered,
a_side: ChannelSide {
chain: BaseChainHandle {
chain_id: ChainId {
id: "shielded-expedition.88f17d1d14",
version: 0,
},
runtime_sender: Sender { .. },
},
client_id: ClientId(
"07-tendermint-3589",
),
connection_id: ConnectionId(
"connection-1761",
),
port_id: PortId(
"transfer",
),
channel_id: Some(
ChannelId(
"channel-1154",
),
),
version: None,
},
b_side: ChannelSide {
chain: BaseChainHandle {
chain_id: ChainId {
id: "theta-testnet-001",
version: 0,
},
runtime_sender: Sender { .. },
},
client_id: ClientId(
"07-tendermint-3529",
),
connection_id: ConnectionId(
"connection-3632",
),
port_id: PortId(
"transfer",
),
channel_id: Some(
ChannelId(
"channel-4125",
),
),
version: None,
},
connection_delay: 0ns,
}
for what?
Client will be updated everyday.
Hermes guide, you can create new connection with existing client id
I know, but for what? ๐
my channel id is diff to the sheet, i dont know how to change it to
what do you mean your is different? did you create a new channel and it is different?
you only need to take that canonical and put it into hermes config in filters if you want to stick to it
Oh okie got it, thank you
we got shielded set rewards working on a local testnet ๐
this was super handy! #1222959128629215262 message
we're standing by for word from Brent to check our wasm code, discuss parameters (like inflation amount, target), and overall if we're good to go
i think we'll want the voting to begin mid-day Monday (i know it's a holiday for some) and have the voting period be active for validators all of Tuesday as well
ideally we'd have shielded set rewards active by Friday
Sorry been mostly out of commission today but will get the update script going and settings updated tomorrow
okay, Spork is the one leading this
are we in scoring v2 already post fork, or only when shielded set rewards are active?
Guys, please don't create more channels. We already supporting the canonical one - check spreadsheet on pinned messages for further reference
read the channel above..
@quaint arch using update script now and updating canonical channels
totally wrong channel...
I have setup my relayer between selected channel shielded-expedition.88f17d1d14 channel-1142 and theta-testnet-001 channel-4118
My address
cosmos1l2hfmy3uengp2pnec9qhuz504j0m86y8slkgst
tnam1qqevylt0tatda2wzjz5v9r4u8gmm3tkptq9n4q7g
Can I get some gas ?
https://explorer.polypore.xyz/theta-testnet-001/tx/DD7E62867B44E3EEAE015327868FF88A6B6966AF940F43C21ABECB2944C97BC5
Ping Dashboard is a block explorer/web wallet for blockchains built on Cosmos SDK, Cosmoshub, Osmosis, Juno, Evmos, Injective, Canto and 70+ blockchains listed on ping.pub
omg there are sooo many Cosmos Hub testnet IBC channels ๐ https://services.liveraven.net/cosmos-testnets/namada/ibc-channels
okay how is the canonical channel (the only channel we care about) doing? target Channel 4118
Still working, just tested via site. Implementing cosmos atm.
Just refactoring the code still and abstracting out logic so I can continue working on it with a clear mind.
I also relay, and I still got like 10.28 ATOM compared to 3 days ago ๐ฎ (which was also around 10)! Though not many are probably using the channel.
(and also update), so it might be quite cheap. Though yeah the real deal starts when everyone will make use of it.
Edited: forgot to mention how much I had 3 days ago.
great! this is what we expected. the constraint will be NAAN, we think
interface looks awesome
Nice!
Tysm man!
let me check my wallets and see how they look
not sure mine has relayed a lot
looks like it did a few only
big thanks to everyone here for helping out on this! everything looks good ahead of the ssr proposal, hopefully coming later today
if anyone needs anything or has questions, lmk
Let's go ๐ค
not sure why my relayer isn't picking up much of these
It's like the far west, so the fastest ones (it may related to hermes config, server specs, etc.) are likely to relay packets more frequently - anyway, if those start to have latency, the rest of operators are there to keep relaying packet as normal
alright, I'll be the backstop then ๐
Has anyone manage to send shielded ATOM through the channel ? Or is it still not possible because shielded transfer are broken ?
My submission made two days back is not showing.
the last update of the file is from March 29 if I recall correctly
you can check 2nd tab in the spreadsheet
anyone else seeing a frozen client?
ERROR foreign client error: client 07-tendermint-3546 on chain id shielded-expedition.88f17d1d14 is frozen: client state reports that client is frozen
@here
Ah damn it happened?
Just a sec, lemme check
Yeah crap, seeing it
yep ++
btw, I recall that I used to update once per hour and the trusting period was something about a bit more than 1 hour, especially as saw that the client has expired in 2-3 days all the time
thought it was fixed somehow long time ago
ppl continue to create their own channels instead of using canonical...
frozen != expired
Freezing of client is connected to misbehavior last I checked out this problem.
Dunno how exactly it happens though.
updated 11 minutes ago
ok, wrong wording, nvm
i never experienced a frozen client on Noble, but happened to my osmosis client 3 times
Reason: Duplicated text
Did the freezing of clients start to happen ever since the memo size was increased? I don't remember this to happen before that long memo branch. But unsure, cause back then I had an unfiltered relayer on steroids relaying on all channels.
Damn, saw it live. Rip.
crap)
๐
Lemme check mine, see if something odd's in there.
and those messages are from Cosmos side, looking to the height
https://www.mintscan.io/cosmoshub-testnet/tx/4028D1A5ABB9B4D0FAAB4CBFB5F36E31E353E93FC38538480494960CBE330604?height=21003472
1st ibc timeout that I see on my wallet from cosmos side
when i make ibc to cosmos osmo noble stargaze and celestia i found that client frozen after ~ trusted period and cosmos not living more 2 days
update not helping for me
In uncommon situations, a highly valued client may become frozen due to uncontrollable circumstances ๐
Well. We're being too high class now.
I didn't see any misbehaviour evidence in the log also
When submitting evidence of Misbehaviour to freeze a malicious client
but updating it once per hour helped to keep it alive
If the one third of the validator set of the chain the client represents decides to collude, they can sign off on two valid but conflicting headers each signed by the other one third of the honest validator set. The light client can now be updated with two valid, but conflicting headers at the same height. The light client cannot know which header is trustworthy and therefore evidence of such misbehaviour is likely to be submitted resulting in a frozen light client.```
yes, but can't answer for everyone
I used 4k+ smth and updated once per hour before, and didn't see frozen channels
but recall that the client had two connections as well, what I wrote on the first day, just that should not be the problem usually
Ofc it's the same (technically speaking)
statuses are not by nature, but the result is the same, yes))
Yep
dunno, can two connections lead to that inconsistency? #1222959128629215262 message
it is like apphash in the chain seems
if we missed update it should be Expired and not Frozen
I think I already reported internally something related to frozen height on ibc clients on Namada's side one month ago or more
Yeah we spoke bout it a month or so ago
those with updating scripts, when was your last update from namada's side?
any chance to get tx?
hmm, weird tbh. something seems to be wrong on namada side
what height your client was frozen on ? i mean output of this command
hermes query client state
I assume that frozen height can't still be fetched on Namada, and I think it's somehow related to the issue we are facing
correct, it always shows height 1
Yeah, for some reason I'm seeing height 1, revision 0.
Could make sense indeed.
Wanna open the issue, but I don't know in which repo would fit better, Hermes or Namada? Had the same doubt when I reported it a while ago
I used to think it's hermes, but now I'm leaning more towards namada itself.
But Hermes might be better, cause it's related to relaying
We dunno what the actual problem is
what if we try rly instead of hermes
Might as well be something in the fork of hermes that's not taken care of well
I did see someone (from the rly team?) asking for guidance to get namada integrated in rly
Yeah, but is it not supposed that chain should send the frozen height, in order to be fetched from Hermes? ๐ค
Unsure tho
Yeah, I'm not sure how to see if the namada protocol supports this already. If it doesn't, then yes it's likely that it fits the namada repo better
cant it be related to hardfork?
i mean hermes could try to update height that is lower then earliest because we dont have history
Gonna open it once I get back to home, and let's see what team discovers
no it's an old issue existing from early days of SE
Cool! Thank you :)!
Or be an outlaw and copy paste the issue into both repos ๐คญ
wondering then why in the config with the trusting period around 4k+ sec and update once per 1 hour I didn't get my own clients frozen even one time?
still have a suspicion it can be related to the multiple connections... dunno why ๐ง
Hmm, I sadly had all my channels frozen
I do still have an osmosis one open I think
3rd day now.
as per that explanation when you get two correct hashes and can't decide which to use, then it can be frozen
++
ERROR foreign client error: client 07-tendermint-3546 on chain id shielded-expedition.88f17d1d14 is frozen: client state reports that client is frozen```
But that would be in case of hash fork? Or maybe I'm missing smth
dunno ๐ค ๐ป
last successful client update for me was apr 1, 19:00 utc
Okay, just opened the issues on both Heliax Hermes fork and Namada repositories
https://github.com/anoma/namada/issues/2985
https://github.com/heliaxdev/hermes/issues/27
as said before, why then this #1222959128629215262 message ๐ค I really didn't get clients frozen for a long time
we need to check 2 things as for me, with the new channel
- be sure that the client is unique, no multiple connections on it and still stick to the current trusting period from the file
- if it will be frozen again, reduce the update and period to ~1 hour and check again
we can use two new channels for that to check in parallel
also if it is Frozen, it is not due to missing the trusting period, it is some non-deterministic misbehaviour
I'd wait for team to dig into it
i had my osmosis channel updated every hour but eventually it got frozen too
i also set misbehaviour=false in hermes configs to disable misbehaviour detection
so i guess this issue has nothing to do with trusting period or update frequency
Yes, I remember this, also same for me when I tried it afterwards
Though atm I still have an osmosis channel open, not sure when it will freeze.
๐ค one of my channels frozen just after 1 day, another one lived for a week or so
i'll open a new one tomorrow to examine it more carefully
Yeah it's really weird, it might be due to a tx?
Keep thinking that it might be something with a wrong shielded tx, with an incorrect memo, but this is a leap.
btw which hermes branch /version should we use now ?
I'm using 1.7.4 beta 7 still
the long-memo version tho
Think most here do (either that branch or clean branch)
Same git status On branch 1.7.4-namada-long-memo Your branch is up to date with 'origin/1.7.4-namada-long-memo'.
Btw just for a quick check: this one translates as a -dirty-version?
hermes 1.7.4+dc498bbf-dirty
i used same version too
I recompiled it to double check and getting this one./hermes -V hermes 1.7.4+1ede457f
Ah I think I did something dirty then
I'll recompile, cause that commit version I gave is totally off btw lol, wth I do.
@warped holly checkout using the tag version (from the docs) to be sure. Lankou also had that kind of issue at some point because he compiled at the wrong commit
Yeah mine was cause of own custom changes, I was merging two separate branches together at some point in the past and forgot to replace the binary again with a clean one ๐
I feel you pain
made some infra changes, so assume my relayer should be more stable now
do we have agreement on which is the right commit?
https://docs.namada.net/operators/ibc#from-binaries
or
https://docs.namada.net/operators/ibc#from-source
๐
export TAG="v1.7.4-namada-beta7"
I believe the faq lists another version?
can't check atm but thought it prefered the long-memo for SE
- Is the latest hermes branch v1.7.4-namada-beta7 compatible with Namada +v0.31.0?
It's not up to date with +0.31.0 but it's based on a version that is compatible with +0.31.0.
oh ๐ฎ I didnt know there was that long memo version !
I've done all my test with the version from the docs. got no trouble with it
do we have a new canonical channel pair?
did the old one expire?
frozen, the whole discussion above ))
Is there a way to unfreeze the thing?
I've since governance proposal on some IBC chains to restore channels, is this it? It frozen=dead= create new one ?
it's impossible to unfreeze something in testnets, you need to get consensus on voting ๐
Also, there's no such proposal type in Namada yet. It wouldn't solve the issue though
are you going to create a new channel(s)? or someone else
Nope, we haven't informed yet and don't think that issue is going to get resolved soon. Shielded set rewards can still be tested fortunately. In my case I sent a few testnet atom to Namada
ok, I'll spinup my own to check if it is a persistent problem
not yet but a heliax dev is going to suggest some config changes and then we'll try again
does anyone have anything in their logs that would give an idea of what height the client froze at? even approximate?
nope ๐ฆ looked through and nothing suspicious
the only thing worrying me is that we had 2 connections up for that client, it should not be a problem, but who knows here
as per that explanation how the client can be frozen it can be that the same tx came through two channels simultaneously and therefore due to that a misbehaviour appeared
looked at the logs yesterday and nothing...
Lemme check, I had relayed something 10 min before it froze. That gap might be too big though.
This one didn't freeze
2024-04-02T06:48:42.499482Z INFO ThreadId(1157) worker.batch{chain=theta-testne
t-001}:supervisor.handle_batch{chain=theta-testnet-001}:supervisor.process_batch
{chain=theta-testnet-001}:worker.packet.cmd{src_chain=theta-testnet-001 src_port
=transfer src_channel=channel-4118 dst_chain=shielded-expedition.88f17d1d14}:rel
ay{odata=cleared/78a458bd ->Destination @0-21020899; len=1}: response(s): 2; Ok:
A8CF032D7E60AC2DACC1AB3990763852B095E0562F583848539A0DB8625FB43F; Ok:7C297721334
37DFC30F09159FD1D30ABD58253AB57FF2C9E4CD2D0021D06F8C0 target_chain=shielded-expe
dition.88f17d1d14
This one did freeze:
2024-04-02T06:58:04.460934Z INFO ThreadId(1157) worker.batch{chain=theta-testne
t-001}:supervisor.handle_batch{chain=theta-testnet-001}:supervisor.process_batch
{chain=theta-testnet-001}:worker.packet.cmd{src_chain=theta-testnet-001 src_port
=transfer src_channel=channel-4118 dst_chain=shielded-expedition.88f17d1d14}:rel
ay{odata=cleared/2cda6347 ->Source @0-281973; len=1}: response(s): 1; Ok:E589293
A28347ECBB4685D38375CAC7977AE237EA51B721871B0878A01A03ADB target_chain=theta-tes
tnet-001
I'm on my phone, think the copy paste is screwed up.
I'm comparing two different directions here tho if I check the target_chain value.
Actually the last one before the frozen one that had target chain theta testnet 001 had an error. But I've seen that error appear more often
4-04-02T06:47:52.878993Z ERROR ThreadId(18) worker.batch{chain=shielded-exped
ition.88f17d1d14}:supervisor.handle_batch{chain=shielded-expedition.88f17d1d14}:
supervisor.process_batch{chain=shielded-expedition.88f17d1d14}:worker.packet.cmd
{src_chain=shielded-expedition.88f17d1d14 src_port=transfer src_channel=channel-
1142 dst_chain=theta-testnet-001}:relay{odata=2bd66fb8 ->Destination @0-281918;
len=1}:send_messages_and_wait_check_tx{chain=theta-testnet-001 tracking_id=2bd66
fb8}:send_tx_with_account_sequence_retry{chain=theta-testnet-001 account.sequenc
e=190}: failed to broadcast tx with unrecoverable error response=Response { code
: Err(22), data: b"", log: "packet messages are redundant", hash: Hash::Sha256(7
8B9529F856E4CF0A6154457068669D45BCAEF680F354F0FE833CA87B14C6C00) } diagnostic=un
known TX sync response error: 22
2024-04-02T06:47:52.879074Z INFO ThreadId(1177) worker.batch{chain=shielded-exp
edition.88f17d1d14}:supervisor.handle_batch{chain=shielded-expedition.88f17d1d14
}:supervisor.process_batch{chain=shielded-expedition.88f17d1d14}:worker.packet.c
md{src_chain=shielded-expedition.88f17d1d14 src_port=transfer src_channel=channe
l-1142 dst_chain=theta-testnet-001}:relay{odata=2bd66fb8 ->Destination @0-281918
; len=1}: response(s): 1; Error with code 22:78B9529F856E4CF0A6154457068669D45BC
AEF680F354F0FE833CA87B14C6C00 target_chain=theta-testnet-001
Ima go behind the pc and cut a segment of my logs, this copy pasting is probably not looking okay on a desktop.
this just mean someone relyed before you. nothng unusual
Ah right!
Here's a log snippet around where it froze, might narrow the height down a bit more @quaint arch.
Made sure not to narrow it down too much, the 'surrounding' txs before and after might be useful.
amazing, thanks! are the timestamps in utc?
nothing special at logs. have tons of such at all relayers(
Yes UTC
It might be useful to narrow down, perhaps if everyone does this we can figure out roughly at which height it froze
I'll fix switching between chains today, then redeploy my ibc app with osmo-test-5/theta-testnet-001 => namada-se shielded fix.
Will then continue to experiment with the SDK, see what's possible for namada-se => the other chains in a shielded manner.
Honestly don't think it has to do with config as frozen height isn't being emitted - this prob has to do with how ibc-rs is integrated in Namada
But who knows
is everything working with channel-1142/channel-4118? I sent some uatom (both to a shielded and non-shielded addr) but not sure if I did it correctly and nothing appeared on the Namada side. Sending from Namada gets rejected by VPs
the whole discussion above is about the client was frozen...
Thanks, I saw that but wasn't sure whether that was just one relayer or everybody's. Also not sure why my Namada tx was rejected by VPs, that's probably just something I'm doing wrong.
I recall someone got it rejected when used non-working channel (expired/frozen client)
https://services.liveraven.net/cosmos-testnets/namada/ibc-channels you can find working here (updated once per 2h)
there are few problems with getting osmosis data but cosmos is actual
just discovered https://github.com/anoma/namada/issues/2730
@quaint arch I'm not sure if this is a coincidence, but my osmosis client froze the moment I accidentally did a non-shielded IBC transfer to a znam address. This simply means I left the IBC memo empty in the transfer.
Doesn't seem coincidental, my suspicion was already this, see the message I reply to
Hmm, I should create a new channel and try to replicate this.
Brb.
BINGO
2024-04-03T19:33:47.708799Z ERROR ThreadId(20) spawn:chain{chain=osmo-test-5}:client{client=07-tendermint-3191}:connection{connection=connection-2869}:channel{channel=channel-6731}:worker.packet.cmd{src_chain=osmo-test-5 src_port=transfer src_channel=channel-6731 dst_chain=shielded-expedition.88f17d1d14}: task aborting after encountering fatal error: link error: failed during a client operation: client 07-tendermint-3704 on chain id shielded-expedition.88f17d1d14 is frozen: client state reports that client is frozen
It immediately froze
So okay, uhm I can prevent it in the frontend, but this requires fixing on-chain.
This is what I did, as you can see it's set to UNSHIELDED, but I'm sending the tokens to a znam address.
Unshielded simply means it leaves the ICS-20 memo field blank, so this whole freezing thing is related to either the memo being empty/faulty or the address format being off. Or ofc both.
Great, hope that this save time and helps devs to identify and resolve the reported issue ๐ค
I wanted to fix it in my frontend already, but now think it's better to leave it like this for now. That way the edge case can be tested.
Deployed latest version of the IBC app btw, shielded from osmo or theta-testnet => namada working.
Also assets get auto-converted to known denoms + shows which channel they come from.
Testing now. I still can't see assets on the Namada side, but maybe takes a while for IBC to complete?
The channels are frozen, just a sec haha.
I'm creating new channels for both chains atm, takes a bit.
But you can use other people's channels aswell. My default channels are just not working now.
If anyone is going to try and freeze a channel with the edge case above, please don't use a channel of mine ๐ .
It's okay if you accidentally do, cause I did the same by accident. Just make sure to toggle it to SHIELDED if you need to do a shielded tx.
the edge case is just leaving the memo empty?
It's either:
- sending to a znam address and having the memo empty.
- sending to a znam and having an invalid memo.
- sending to a foreign address.
So it's either the address field causing issues or the memo field.
The latter is actually something I have to try still, a foreign random address.
But if you toggle to SHIELDED, the IBC memo generation is taken care of automatically.
on a related note, I'm wondering how to import the extension's shielded address into the CLI. no worries if you don't know, I can just set it manually
viewing key or the pyment address? (payment address you can see in the extension under view keys)
Ah I get what you mean
No, I haven't gotten that solved, I keep getting a different Viewing Key if I import it
if i am not wrong the memo is generated by keplr> or namada side
or it use a api to generate it somewhere
i guess it is a remote api
I for now have that done via API, but next step is to get that shifted to SDK. Will deep-dive into the SDK tomorrow, cause I wanna tackle most stuff concerning namada => external chains.
Hope it's possible tho
gotchu
just want to confirm that
nice work anyway
It's no biggy to have this generated via an api, but I really, like really dislike CLI usage whatsoever lol.
Thanks chad
Lemme redeploy with different channels.
Ah wait it already shifted
ah phew, glad to have made the default channels inside of an .env file. That way I can just change those in vercel's env settings and click 'Redeploy' on the latest deployment.
Might need to CTRL+F5, channel should say 6732 for osmosis.
so the api, generate memo using the cli on the vm,with get request ? something like namadac ibc-gen-shielded --output-folder-path . --token x --amount x --port-id x--channel-id x --target x
Yes, finally! It worked! Thanks, you're a legend
Yes something like that indeed! Will soon hop off that method tho, hopefully tomorrow already :)!
Awesome!! Haha thank youu
Great it worked l..
๐ซก๐ซก salute you zen.
Glad to hear! Saluteeee back brother!
Hey guys! Did someone manage to do shielded-ibc (using memo via ibc-gen-shielded) after fork and receive NAAN or UATOM tokens on shielded address?
whoa @warped holly i'm just seeing all this now ๐
Haha, that's okay!
looks pretty exciting! @forest condor check this out
So many threads/channels ๐ฅ!
I do have to say, please only replicate the freezing of channels on own channels ๐คฃ...else if @quaint arch's going to test shielded tx's it might fail due to channels not working anymore.
The channel field is open tho, so it's also possible to type a different channel
I tried your app yesterday. I can see transactions on Mintscan that include a memo that I have set to my public key. But I did not see them show up in Namadexer.
I will try again
Yesterday I was not sure if the app was supposed to be functional.
Because of the discussions.
Depends btw which direction you're trying. Some transactions will of course be on the other chain.
Cool! Tell me if it's actin' up!
I periodically check if the channels I set as default are still working.
Some things were freezing up, like the Vault.
Namada => other chain shielded is not implemented btw.
Now I see I have NAAN on different channels
Ah yes, yes, this is the chaos and mess we created after letting so many create channels ๐.
I am guilty of it as well.
That was to be expected when the docs say you have to create channels to run a relayer, but is not clear about reusing existing channels.
True man, it did allow me (and I believe many others) to understand relaying more in-depth now
And testnets are there to be made a mess out of
So yeah, this eventually is all good.
And to prove the S Task it is also safer and easier to create new channels, although the format document says you can also submit an update transaction
I did too, just to be sure
Ah interesting, I did not know! That's indeed way simpler
But it is kind of ambiguous if that could be considered Operating IBC infrastructure
So I totally get why people are creating new channels
Is that also why setting From to Namada and enabling Shielded throws the error No results have been found on Vault?
Yeah the extension doesn't have this implemented, it tries to get the balance for the shielded address, but this doesn't work (at least in my experience atm). That's where the No results have been found on Vault comes from.
I'm playing around with the SDK now, see if I can figure something out. Though I don't think sending actually from Shielded namada to an external chain will work with the extension.
So I'll either come up with something temporary, but this will likely mean having to handle the keys outside of the extension...
Ah I was wondering how it would have worked considering the resources necessary to shielded-sync
Yeah, so right now:
- All things unshielded works, but who cares.
- Shielded works from external to namada.
- Balance fetching for osmosis and theta works (all assets). And for transparent namada addresses, though this is limited to only those you added and NAAN ofc.
Though hearing the latest in the validator circle, I'm not sure whether we'll be able to get something working properly since they stopped the SE development.
Shielded => shielded or shielded => transparent not working for me either, so I'm not even sure if that direction is doable now.
๐ฅ...
I'm ripping the SDK apart as we speak lol, so I'll see what I can get out of it.
sorry zen, not sure i understand...
are you talking about something like this?
gaiad tx ibc-transfer transfer transfer channel-4152 znam1qrylpn9848mz9v06sqefs9nekgqrj9hxa5v7p4e3l46j3q02sxsxymyjzyw9wt0fggtpn6qw2gpe3 100000uatom --from hub-relayer --keyring-backend test --node http://localhost:46657 --fees 7000uatom --chain-id theta-testnet-001 --memo ""
because if so, i haven't been able to replicate. or is it something specific to your app?
Strange, this is exactly what I meant yes, let me try again.
Forgive me, I'll possibly destroy my osmo channel now.
Okay, very interesting
It froze just now when I used my relayer address
to transact with
I wonder if using a wrong version could cause someth like this?
This, so that translates to:
osmosisd tx ibc-transfer transfer transfer channel-6732 znam1qqtnyzu97zknt3sff74aj8fnxxx6lr5gke2vqp8w8pmxz7dp25rt7jsmq46dn2g2t0al2ps2paryv 100000uosmo --from osmorelayer --chain-id osmo-test-5
I was trying all sorts of combi's with another address and it didn't freeze.
But now that I tried it with my relayer address that's relaying the osmo-test-5 channel it froze.
Is hub-relayer also the one relayng?
Or is that --from another address
This can also be the culprit yes
But aint that messed up if someone could freeze a whole channel just by being on an incorrect version?
I'm creating a new channel, will try all sorts of combinations again.
sure but wouldn't be the most surprising thing that could happen
we were all using at least three different versions I think
yes, the same key the relayer is using
I changed my version to long-memo branch, my hermes was dirty...
I'm not getting the issue anymore
Though, ain't that a big problem? If my hermes caused this, then just one bad actor can destroy a channel.
If it's related to hermes version
(btw channel-6735 can be used for osmosis)
yeah, don't think it's supposed to work that way
do you know what was different about your hermes version?
I unfortunately only have the commit hash but it said -dirty so I probably did something in there.
Though I find it weird, others had the same problem in the past, so it may have been related to that commit
hermes 1.7.4+dc498bbf-dirty
I'm btw not sure if it's related to this, but atm I'm not getting issues with the channel freezing
Should I again switch to that one and do the same tx and see if it freezes?
Wait let me try finding out what was different with that one. I can't really figure it out precisely since I only have the binary.
commit hash you're using now?
or app version I guess
Ah I remember, so back then I grabbed branch: yuji/1.7.4-namada-shielded
and changed the part in the code where the memo limit was upped.
sus haha
This is all speculation still though
Let me go back to that version and try the tx again
No wait, my client froze agan
again*
Okay this is confusing now lol.
I'm on hermes 1.7.4+1ede457f long memo and it froze ._.
recreating channels :)...! Gotta love bugtesting huh, Spork.
think that's the one I'm on too if memory serves
Redeployed my site btw, think it will auto show the channel I just made now
Will be short-lived tho lol.
Ah wait it's still building.
Are you freezing using the cli or your app? Could it be something your app is doing (no offense)
Hahahaha
None taken
Let me do it via CLI
And this issue happened before the app was around, but yes let me keep the env we test in consistent.
This made me laugh
If it is, then I definitely need to be labeled the destroyer
Solution is clear, we just need to keep zen away from our stuff and everything will be fine ๐
There's only one relayer running on these channels, right?
Yes, don't think anyone else joined
Okay I did the same CLI command 5 times
t froze
It
AAAAAAAAAHH
Perhaps there's something here
osmosisd tx ibc-transfer transfer transfer channel-6736 znam1qqtnyzu97zknt3sff74aj8fnxxx6lr5gke2vqp8w8pmxz7dp25rt7jsmq46dn2g2t0al2ps2paryv 500000uosmo --from osmrel --chain-id osmo-test-5 --node https://osmosis-testnet-rpc.polkachu.com:443 --fees 2000uosmo
Do you have misbehaviour set to true or false in your config?
Set to false
[mode.clients]
enabled = false
refresh = false
misbehaviour = false
Got a cronjob open with update client commands
Oh and can you please set log level to debug if you haven't already?
Oh, is it too late to do this?
For next time
You switched hermes versions, is it possible the cronjob commands are still pointing to the dirty version?
(At times I'm a noob, forgive me)
No worries, me too, this is advice from yuji
This is how my .sh file looks like:
#!/bin/bash
/root/.hermes/bin/hermes --config ~/.hermes/config.toml update client --client 07-tendermint-3705 --host-chain "shielded-expedition.88f17d1d14"
/root/.hermes/bin/hermes --config ~/.hermes/config.toml update client --client 07-tendermint-3706 --host-chain "shielded-expedition.88f17d1d14"
/root/.hermes/bin/hermes --config ~/.hermes/config.toml update client --client 07-tendermint-3737 --host-chain "shielded-expedition.88f17d1d14"
/root/.hermes/bin/hermes --config ~/.hermes/config.toml update client --client 07-tendermint-3587 --host-chain "theta-testnet-001"
/root/.hermes/bin/hermes --config ~/.hermes/config.toml update client --client 07-tendermint-3196 --host-chain "osmo-test-5"
cronjob:
0 */2 * * * /bin/bash /root/update-hermes.sh >> /root/update-hermes.txt 2>&1
my service file also points to:
ExecStart=/root/.hermes/bin/hermes --config /root/.hermes/config.toml start
I even daemon-reloaded btw.
/root/.hermes/bin/hermes version
2024-04-04T22:15:56.140305Z INFO ThreadId(01) running Hermes v1.7.4+1ede457f
hermes 1.7.4+1ede457f
So in conclusion everything points to 1.7.4 long memo branch.
Unless I need to do something bout that cronjob? Does it have caching or something?
Hmm, perhaps I should make a change to the crontab -e, save and then change it back, save again.
Don't think it caches the scripts it's supposed to run? That would actually be annoying...
Uhm how would I set debug on btw? Do I do this in the service file?
At the beginning of hermes config file [global] log_level = 'info'
facepalm
Thanks ๐.
Alright, step by step, how fitting: channel-1234 just got made.
Okay everything sorted, now let's spam till it freezes or not.
Hmm okay frozen in 3 min roughly.
Here's the log from start to end
Again I kept doing this to keep it consistent:
osmosisd tx ibc-transfer transfer transfer channel-6737 znam1qqtnyzu97zknt3sff74aj8fnxxx6lr5gke2vqp8w8pmxz7dp25rt7jsmq46dn2g2t0al2ps2paryv 500000uosmo --from osmrel --chain-id osmo-test-5 --node https://osmosis-testnet-rpc.polkachu.com:443 --fees 2000uosmo
Perhaps it might be related to refunding tokens?
The log's okay now right @quaint arch?
Ah btw, this might be useful as well. All my 9 tx's.
2024-04-04T22:31:34.397114Z DEBUG ThreadId(32) worker.batch{chain=osmo-test-5}:supervisor.handle_batch{chain=osmo-test-5}:supervisor.process_batch{chain=osmo-test-5}:worker.packet.cmd{src_chain=osmo-test-5 src_port=transfer src_channel=channel-6737 dst_chain=shielded-expedition.88f17d1d14}:update_schedule{batch.tracking_id=fa47b0c4 batch.height=5-6475416}:schedule{odata=fa47b0c4 ->Destination @5-6475416; len=1}: connection delay need not be taken into account: client update message will be prepended later
2024-04-04T22:31:34.482246Z DEBUG ThreadId(32) worker.batch{chain=osmo-test-5}:supervisor.handle_batch{chain=osmo-test-5}:supervisor.process_batch{chain=osmo-test-5}:worker.packet.cmd{src_chain=osmo-test-5 src_port=transfer src_channel=channel-6737 dst_chain=shielded-expedition.88f17d1d14}:relay{odata=fa47b0c4 ->Destination @5-6475416; len=1}: retrying retry.current=1 retry.max=5
2024-04-04T22:31:34.482264Z DEBUG ThreadId(32) worker.batch{chain=osmo-test-5}:supervisor.handle_batch{chain=osmo-test-5}:supervisor.process_batch{chain=osmo-test-5}:worker.packet.cmd{src_chain=osmo-test-5 src_port=transfer src_channel=channel-6737 dst_chain=shielded-expedition.88f17d1d14}:relay{odata=fa47b0c4 ->Destination @5-6475416; len=1}: prepending Destination client update at height 5-6475417
These messages look suspicious to me. Like some queue is building up.
But yeah, I will have to sleep now, lemme get some valid channels up and running again on my site though.
Well it's Greek to me but I'll forward it to yuji to see if it makes sense to them... tysm zen, you've been super helpful as always
THANK YOU for saying that, I was feeling the exact same way when those debug messages appeared XD!
And you're very welcome man!
Thank you for testing it out, it's just weird that I managed to instantly freeze my own channel back when I tried to recreate the problem. It made me think it was definitely caused by this transaction, but it isn't 'exactly' the case? I dunno. It's weird.
Yuji and others will speak some ancient greek and do some magic
Okay, redeploying now. Once Osmosis says channel-6738 on the site, it's updated.
Nah btw, this I also see in normal transactions.
same
Just received this with an unshielded IBC transaction Osmosis -> Namada through your app:
transfer/channel-1235/uosmo: 1000000
I wonder how one can rewrite this to a tnam address
Just received this with a shielded IBC transaction Osmosis -> Namada through your app:
transfer/channel-1235/uosmo : 1000000
For unshielded, if you know the tnam address instead of the 'transfer/channel-1235/uosmo' denom, then you could add it. Only for unshielded though.
Still need to figure out if there's a quick way to do this
Best case would be that it auto fetches all denoms.
Not sure I follow, this is what the CLI returns when querying balance.
Just to confirm that the transaction went through.
Yeah, transfer/channel-1235/uosmo actually has a tnam... address
Just like naan has a tnam...zee address
Oh
It ends with zee I believe? I'm not sure.
zcee
Ah yes, that one
I think that is a low priority UX thing
I could be really gay and just let balances get queried via CLI ๐.
I think the MASP algorithm has to be improved so it can run in a browser client
Starting with scanning backwards
Yeah, really hope to see that, will definitely implement it.
That is what ZCash light wallets do
you have a week to make protocol improvements:)
Interesting, I didn't know! I did write an issue on Github about starting the scan from the end of the chain.
But reading it back I just notice how ignorant I am to it all.
tldr; Zecwallet Lite can now sync the entire blockchain - from the 1st sapling block - in < 60 seconds; but wait, thereโs more Wallet funds are ready to be spent in seconds! No need to wait for sync to finish Requests the exact same data from LightwalletD, so no change in security/trust assumptions. BlazeSync Zecwallet is happy to introduce ...
That's genius.
There is another algorithm that I wanted to implement but I fear too short before the end: WarpSync
I already have points for protocol improvements so now I need to focus on security ๐
Good luck Rigorous!
I will need to summon my inner stampede
But to be honest I think implementing a fast sync would be more satisfying
I realized this really late, but the outro's of that anime had gems for life lessons
The English version also did a great job at this
Oh, I never realized
I think that these words of wisdom were great and I loved the show so here is a compilation of Vash's Words of Wisdom
I tried reading the manga too, the art strains my eyes trying to figure out what happens
Blame kind of the same, but I guess that is the charm
Hmm I never had this, but I may get it now ๐, I'm older now compared to back then.
Wow, I just always skipped to the next episode!
Me too lol
I never watch the spoilers
A friend of mine put this on once while he was smoking his weed and nodded like 'uhuh' 'uhuh', you didn't know this huh?
I wonder if BlazeSync can be translated to Namada though, because ZCash has a UXTO model while Namada has an account-based model
I'll have to lookup UXTO, not so well versed with these terms. Will check it out more tomorrow!
the team tracked down the cause to an issue in ibc-rs: https://github.com/cosmos/ibc-rs/issues/1080
so it should be resolved when ibc-rs is upgraded in Namada. (the ability to unfreeze clients should be possible in the newer version also)
hermes retries transactions when they're rejected by the destination chain (eg a znam address with no memo) and before each retry, a client update is requested. so it could be related to many client updates being requested... the consensus state of the latest client gets overwritten by an earlier one due to the bug, and on the next update the incongruency is detected as misbehaviour and the client is frozen.
for now, working with what we have, they suggest a partial workaround: set trusted_node true in the hermes config for the counterparty chain... this setting ensures only one update message is submitted per request. it will work for a single hermes, but does not perfectly avoid the issue when using multiple hermes for a single channel
Nice! Interesting. Glad it can be fixed in Namada itself btw eventually!
Just creates a bit of a problem here with the channels this temp workaround.
Means that if multiple relay the channel and this edge case gets done and a relayer without the workaround keeps relaying it, the chance is there the client could still freeze?
Well, my suspicions were right in regard to the ibc-rs ๐ค, great!
The counterparty chain being osmo/theta/any other chain btw?
Glad we stressed it out before mainnet, because we def need to have canonical channels with multiple operators supporting them
For sure man, really important. I got PTSD with expiring clients in another chain.
Hahaha we felt that way on Evmos a long time ago, almost all highly active ibc clients expired after a halt
But using ibc-go, ofc, ibc-rs has not been battle tested enough like the 1st one I guess
Damn, mine may have been related XD. The chain was a fork of evmos.
They really have a cool tech, it's really sad to see that some of its previous founders harmed the project like that. With Dymension launch, they have eaten almost all the market share of their tech, along with Kava, CRO, Canto, etc.
I got rugged on Evmos
Hm, they used to be Ethermint right?
Nomad exploit
Yes, that's right
They took measures to protect their work with licenses after all the drama
That was one of the things that slowed down and basically ruined its traction and trustness
That's a shame
Set my settings for osmo-test-5 and theta-testnet-001 to trusted_node = true for now.
If we still going to do the theta relaying over here, perhaps my open channel could be used. (channel-4157 - channel-1217).
I transferred back and forth between Cosmos and Nama with my public key as memo. The transactions show up on Mintscan, but they do not register on the extended NEBB.
via CLI?
Yes
Actually it would not register with your app either, since Namada as source does not work, right?
Yes
Can you see if it gets on my profile
Good idea
(only if I'm the only one relaying the channel tho)
Something weird going on with my shielded sync though...it keeps fetching like a minimum of 500 blocks.
This does work btw but only unshielded
Oh oops, I've also now done 2 unshielded transactions to double-check ._.
Dunno if you're able to distinguish. Apologies lol. Won't do anything now.
No memo_prefix, which does seem to register on extended nebb
looking at the nebb from Kintsugi, yes it is, coz I have ibc txs done today without doing actually them on my own
Or has Kintsugi switched over to only strictly 'memo_overwrite'?
Think this memo_overwrite is a new field in 1.8 ish version right?
Thanks. memo_overwrite throws an error even though it is described in the documentation
sitting on long-memo versions
Yeah coincidentally I was reading about that one for another chain, but think I saw that one being introduced in hermes v1.8.2
So for now we still just use memo_prefix
And yes like LiveRaveN said, long-memo branch
You'll set up own channels?
I am trying something else
invalid length 66, expected a string length of at most 50 I installed Heliax Hermes binary, at least I thought
Yes so you need the branch
you need long-memo branch
Dang
Hol up, what's it called exactly
That is not obvious at all
git status
On branch 1.7.4-namada-long-memo
Your branch is up to date with 'origin/1.7.4-namada-long-memo'.
hahahaha this all is not supposed to be obvious ๐๐
Hahahaha, yeah
Might save you time:
cargo build --release --bin hermes
If you're a dummy like me forgetting simple commands
It will then be in the target/release folder.
You are a psychic!
I actually already got the ROIDs for the Operating IBC task, but I want to play around.
Yes, yes, dance with it
Because it bugs me out that the transactions do not register
Curiosity is a powerful driver
Though actually unfair if that's the case, then a relayer could farm points made by others
Or perhaps the treat for providing such service ๐ฟ
I thought that was your plan ๐
My great masta plan unraveled by Rigorousss
I knew there was a reason why you made that website so nice
ahahahah, you want some candy? Come hereee, comee heereeeeee
Thank you though โค
Oh that's a different heart. Ah well, all hearts matter.
Actually I have a similar plan for a different purpose, but not sure I will be able to pull it off.
Keep at itt, there's a ton you can still do
I know, I have a huge to-do list, but not enough time
I just uploaded a fix so that you can't type a wrongly formatted address in the address field on the site
I have to create a new shielded address btw, just a moment. Let me see if I can.
Cause of this weird bug now:
Asset threshold of selected conversion for asset type bfe4922fe3da46887eaeedfc37dfd286c11f961cc37dbe285dd08dc241539020 is 0, this is a bug, please report it.
But you already saw it, saw your response on github!
The log made me laugh.
This is a bug, please report it. - I imagined a robot saying this. AI being self-conscious.
What happens when you do balance --owner YourSpendingKey?
Oh that's interesting, think last I tried this it asked for my viewing key
I never had that
Like literally gave a prompt to fill in my viewing key
It used to say something with not consumed or something right?
That is super weird, I never had to do anything with a Viewing Key to do the point I wonder what its purpose is
I think that is why you get the divide by 0 and I cannot replicate it
I dunno man, this divide by 0 just appeared outta nowhere
You have not shielded-synced that shielded pair?
Let see if I can replicate it with a new pair
It used to just give my balance, like 4 hours ago it worked
Maybe shielded.dat is corrupt, you can delete it but have to resync
What I do is perhaps really odd tho, I shielded sync without specifying viewing key, then right afterwards I do it with a --viewing-key flag
Yeah though odd if it got corrupted in two servers
Ah
I can find balance for another viewing key tho
Try querying balance of my viewing key
namada client balance --owner zvknam1qynmxyf5qqqqqq983j0nwgsc8zf0jhglrq3x49y05vz3vdhlwcw9taldce6apv73e3g8mpn57afyqdnkh8dpmp7v962l24m69f8aynp7sa02jsf93ftaehmlwtj9ak7hply4c93862sahqtprluapxda5p5x3gx4k6wzqedjuu8yhtyk5paxedw6gpfhfsatr96jeqh9tjh2258xtrnyz0f2pddhsr3ms6lwkywaphy687uvcnwc06jd32zu375437xe6p2yx6ets6c07r988
New shielded pair = context should contain viewing key
I wonder about something btw, you may perhaps know.
What's the difference between calling shielded sync and calling it with --viewing-keys and specifying one? And what happens if one does these two back to back.
My assumption was that shielded sync without --viewing-keys would look at all viewing keys you got in your wallet.toml and sync those.
That seems a reasonable assumption
So I tested a viewing key I didn't import (namely the one in the extension cause I still can't figure out how to import that one)
After doing a little scanning:
balance MyViewingKey
Last committed epoch: 79
No shielded balance found for given key
Ah so you do have to implicitly shielded-sync that one by specifying it in --viewing-keys
Don't though lol.
Why not?
You don't want your shielded sync to crap out now.
Or get corrupt or whatnot
Oh
You're talking bout your own?
It does not matter, the shielded actions besides unshielded->shielded are not working for me anyway.
Thought you tried my VK, nvm hehe.
Oh
This is your new shielded
Uhm what's the payment addr? can I try sending to you?
Or wait, let me do my own stuff first.
I have not created a payment address yet. Only created a new spending-key viewing-key pair, queried balance, synced a few hundred blocks, queried again.
You specified the from-height?
Yes
Like one really close I assume?
--from-height 310600
Yeah, ah well as long as you have one working addr
About to find out what the consequences are
Hehehe, anything to bugtest this
When you're an adult it's when you're on a rooftop and just want to go weeee
๐ hahahaha, too morbid.
๐donaciones AQUร https://www.paypal.me/mrtsilva16
๐Facebook https://www.facebook.com/silvasalomon.silva
๐Instagram @silva1158921735
๐Instagram https://www.instagram.com/invites/contact/?i=13vnccpmlb7v2&utm_content=3w871kk
Hahhahahaha weleleleel weeeee
Whenever I hear that I remember giving my lil niece math lessons via video calls
She kept doing this with all her other lil brothers and sisters
She picked up her phone and she just said that with her face all up in the camera
Oh shit someone just got knocked out by a tree
๐คฃ that one caught me off-guard
Straight from Looney Tunes. What are the odds?
This world can't be taken serious at times
transfer --source MySpendingKey --amount 1 --token naan
The balance of the source tnam1pcqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqzmefah is lower than the amount to be transferred.
balance --owner MySpendingKey
naan : 42
I spammed shielded sync after I got that
Though VP will probably reject anyways
You are right.
After syncing:
naan : 1042
Transfer:
The balance of the source tnam1pcqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqzmefah is lower than the amount to be transferred.
Can we fix the MASP storage or is that part of the buggy behavior that is not going to be fixed this SE?
Maybe resync from the fork
What type of transfer you're trying to do?
spending-key to transparent
Oh yeah, that was broken ๐คฆ
Yeah, also shielded -> shielded didn't work.
Maybe call it a day and get some sleep
Hehe, I'll also do that after I implemented copy to clipboard buttons, wanna add for viewing key as well.
Since the extension doesn't show this
I read the extension deliberately lacks features.
deliberately huh, hm.
More and more think it would have been better if I sticked to CLI hehe.
But nah, I liked to have made these applications. Can be used eventually, just need to keep up and keep adding on to it.
Yes, somewhere in specs > browser-extension
```The architecture of the extension and extension API somewhat resembles that of `@keplr-wallet/extension
There are a few key differences in functionality however. Our extension will only handle the creation of a seed and derived keypairs, as well as signing transactions. It will not be responsible for allowing the user to send transfer transactions, but should be responsible for submitting account initialization transactions```
Ah I see
The web app has to do that
Though I can let it do a transaction
Unshielded that is.
Hmm, things may have changed last this has been updated
Ah I perhaps understand what they mean
So the extension itself, just opening it won't offer much functionality
In Keplr you could do transactions, do IBC transfers, all that from within the screen.
Ah okay yeah, got it.
Yes, but I wonder if that is a design choice due to time constraints, technical limitations or expected performance issues.
Or just out of principle.
Hmm, asking a question thurrrr
I do not know
Could be a 'for now we keep it simple'
Say you want to make your own Namada wallet that behaves more fully featured like Keplr, would the organization try to talk you out of that?
Think you'll get thrown in a bonfire
๐
"YOU DIED"
๐, why do I think of that video of that dude singing.
"Before I was born, my motha died"
No I was thinking of emotional damage
#Comedy #Gaming #Asian
The ENTIRE neighborhood was staring at me ragdolling to the ground through their windows.
I love my job.
#Emotionaldamage
#emotionaldamagememe
Emotional Damage Meme
Officially wrapped on set and back to making videos. Haven't made a video in 7 weeks, felling a bit rusty, but we'll work on it.
FAILURE MANAGEMENT SWEATE...
Hahahahahahahah
Why why why why
My god, finally got those copy to clipboard buttons implemented. I hate styling + making everything responsive/mobile-friendly arghh...hope it's not too cluttered now tho. I actually just wanted to add a button to copy viewing key to clipboard but ended up adding all addresses.
5AM ๐ค...peace.
Shielded set rewards have been activated in theory at start of epoch 80. Unluckily I messed up keys and I can't find the one I used to receive the uatom from the frozen channel. Is there anyone here that managed to get uatom transfer/channel-1142/uatom? If so, please make a shielding transfer to test out the feature.
Hm, it looks like the two selected assets to receive shielded set rewards aren't appearing while running:
The following tokens may earn MASP rewards:```
@quaint arch
Ah wait, grace epoch is 78, so they should have been activated at start of epoch 79 in theory ๐ง
the channel is still live?
Do i need uatom too or just NAAN can give the rewards
It's frozen - the issue is related to ibc-rs. Follow the above conversation to further reference
NAAN as well
means both tokens need to have in same shielded add
ok
One of them could serve as well. Do you see any increase in the NAAN shielded balances in case of having shielded NAAN or uatom (the one that belongs to the frozen channel!)?
The rewards are in form of NAAN
In theory ๐
Perhaps it had to do with proposal wasm code?
I did sent that specific uatom (0.1 atom) to a shielded address, but I did it before this started I think
when im trying to check my shielded balance i just getting this
namadac balance --owner zvknam1qw0ufd22qqqqpqqn5pp03dkflh6w7m3rh8ut6mk9jefw2fy86v0hnphljl0n82t7x84hw02tumqeeqsa688rzw63f0cel739d6g2gy9g0gfrl2spcepv6yzyp0sllrajefj56nse0p60vdqut07m9qcvrj2gfza8pfrz3fxx4c6yd33swl3aqntn7d7x4jn7phth6mx03gfjkywhu07yxyex03wsfvmfn76356lc3pe594kku6x78apklmf5a0dwust9usx8fweng4s08hwmu
Last committed epoch: 80
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
and its not genrating any result
This seems an issue with not being shielded synced I believe
Not sure tho
There's no increase in the NAAN shielded balance?
just did 1 min before
Let me check this
Guys. Shielded to shielded transfers and unshielding transfers are broke for you as well?
didnt try yet
I can't get it to work now. It did before hardfork
The shielded sync thing seems to work but only to fetch balances and for shielding transfers
For me too...
Here's a current screenshot, I'll wait a bit and see if anything changes.
Doesn't look like my NAAN changed, think I already had this yesterday
It's auto shielded syncing every couple mins on my server.
Let's pray is just a display bug, but I'm afraid that code hasn't beene executed properly or something was missing/wrong
How long should I wait? You know how often these rewards come?
Yeah I read above you couldn't see the pair in the shielded reward set hm?