#theta-testnet-001 relayers

1 messages ยท Page 1 of 1 (latest)

urban stag
#

.

amber kite
#

We are running

paper pulsar
#

good

#

i'm running it

molten drum
#

can add to the update script any running channel or create new, whatever is needed)

pallid wolf
#

I can

molten drum
#

haha, almost everything expired after fork

minor solstice
#

I had a channel running in theory, but doing system work on indexer atm, so not sure how stable it is

molten drum
#

you just create it, it is leaving without you but can die without you ๐Ÿ™‚ need txs or updates

jade dust
#

can add any channel to hermes and make sure it wont be expired. just tell what

#

set up update txs every x hours

vivid sable
#

we also can add/open channel and back up it

minor solstice
#

actually, I could set up a channel too. I'd need some naan and atom testnet tokens tho

molten drum
#
  1. someone opens to don't spam with a lot
  2. others configure update scripts
    the only question is in naan for updating and test atom))
turbid remnant
#

how much naan and atom is required to run for 10 days properly

#

i have decent atom,

lament barn
#

Actually working on it as we speak

#

Having an issue getting test atom though, seems people are spamming the faucet.

urban stag
#

amazing! thank you!

question: assuming we support a specific channel and the relayers have lots of ATOM and NAAN, what could go wrong if hundreds or thousands of participants are trying to use the channel for transfers?

#

we have testnet ATOM for theta-testnet-001

lament barn
amber kite
molten drum
# urban stag amazing! thank you! question: assuming we support a specific channel and the re...

stuck txs that must be cleared from time to time I suppose

Query hermes for unreceived packets and acknowledgements with the following:

hermes query packet pending --chain <A> --port transfer --channel channel-A
hermes query packet pending --chain <B> --port transfer --channel channel-B

Clear the channel with the following:

hermes clear packets --chain <A> --port transfer --channel channel-A
hermes clear packets --chain <B> --port transfer --channel channel-B

Update clients with the following:

hermes update client --host-chain <A> --client 07-tendermint-A
hermes update client --host-chain <B> --client 07-tendermint-B
paper pulsar
turbid remnant
lament barn
urban stag
jade dust
lament barn
urban stag
amber kite
eternal osprey
#

I'm on board, and will provide the channel soon if still needed tomorrow.

jade dust
paper pulsar
urban stag
#

if all relayers ran out of NAAN, would the channel expire?

amber kite
jade dust
#

in case no any activity at all then yes

#

and there wont be any updates if out of balance

molten drum
paper pulsar
urban stag
paper pulsar
jade dust
#

they are not expensive. expensive tx on namada

urban stag
#

how are the ibc client update fees determined / set?

vivid sable
urban stag
#

ah!

paper pulsar
jade dust
urban stag
#

so Namada tx fees are high, making client update fees expensive

molten drum
urban stag
#

how are Namada gas fees set? validator operators? in their client

amber kite
paper pulsar
jade dust
paper pulsar
#

it's not corelated with the validator settings i think

urban stag
#

in Cosmos chains i recall that validators set a minimum gas fee in their config file

molten drum
#

++, but that is minimum

#

and max depends on the activity in the chain, afaik

urban stag
#

oh well, probably not worth pursuing lower tx fees rn
will just need to calculate how much relayers will each need in NAAN, assuming.. we happy assuming 2.5 NAAN per tx?

turbid remnant
#

a governances proposal for running a relayer for x naan would be cool!

jade dust
turbid remnant
urban stag
#

looks like there was an upgrade to theta-test-001 chain

jade dust
# urban stag wdym?

tx wont be really expensive. main issue is 2.5NAAN per tx. All other stuff like chain activity and so on wont cost much

paper pulsar
urban stag
#

to clarify, is the issue that any tx is ~2.5 NAAN? or specifically it will cost the relayer 2.5 NAAN per IBC tx?

cunning finch
minor solstice
urban stag
cunning finch
minor solstice
lament barn
jade dust
cunning finch
#

We have decided the canonical channels already?

cunning finch
#

For theta-testnet-001

lament barn
#

And just like that, NAAN became valuable hah

minor solstice
#

I'm sure there are people with some hundreds of k naan

cunning finch
#

If anyone already has one, I will kindly help funding the relayer address as well as updating both clients regularly

lament barn
median island
#

Well have no problem to fund relayer

paper pulsar
minor solstice
#

going offline for an hour or two, ping me if y'all need anything from me on this

lament barn
urban stag
lament barn
#

I just need some test atoms and i'll be up

molten drum
urban stag
molten drum
paper pulsar
urban stag
#

okay i've dropped some usernames into the sheet
we should probably limit it to 8 relayers, because we'll need to keep all of these funded

molten drum
#

do you want multiple channels?

cunning finch
#

Multiple operators in one canonical channel

crude timber
#

Seem like 8 is enough, so I won't request

molten drum
urban stag
#

when you get the chance, pls comment in:

  1. tnam address
  2. theta-testnet-001 address
jade dust
#

left comment

urban stag
jade dust
minor solstice
urban stag
frosty valve
#

I also can if needed

urban stag
#

but that's it, cut-off is 9

brazen bear
#

If there are still openings, please add me

urban stag
#

thanks SO much for volunteering!

paper pulsar
urban stag
#

really this is about the chance to work together a bit to advance this shielded expedition to its finality, haha

torpid gull
#

We have been capturing all open clients. We are happy to keep running.

urban stag
#

not incentivizing relaying here, just to be clear

median island
molten drum
solar fog
#

Just made a new one after hardfork

`Namada

            "channel-1137",

  Theta 
        
            "channel-4117",

`

jade dust
paper pulsar
solar fog
jade dust
#

no more questions

#

each chain has its own tursting period. for example if in axelar you create it with wrong , your channel won't be accepted
creating channel is not only run hermes with guide from chat

inland nebula
#

how can I check if my relayer is healthy?

paper pulsar
#

no no, i've created my own ibc channel, i only asked

jade dust
#

anyway this is testnet so we are free to do everything)

paper pulsar
#
shielded-expedition.88f17d1d14 client_id: ClientId : ClientId("07-tendermint-3540") , connection_id: ConnectionId("connection-1738")
theta-testnet-001 client_id: ClientId : ClientId("07-tendermint-3516") , connection_id: ConnectionId("connection-3622")```
molten drum
jade dust
gusty lintel
#

yes we were running it before fork, we can enable it again

molten drum
#

I am still wondering about the trusting period in Namada, using now smth like a bit more than 1 hour, but didn't try to find a border value

molten drum
urban stag
#

does it cost NAAN to relay an asset into Namada, out of Namada, or both?
if we put like 2500 NAAN on each relayer, that's like 1000 txs per relayer

molten drum
paper pulsar
inland nebula
#

how to fix this?client state is not valid: latest height is outside of trusting period!

molten drum
#

and update costs as well

jade dust
#

You need just 2-3 operators for just updating channel

molten drum
jade dust
#

without relaying

#

anyway the easiest way to track balance is just to run it ad see

molten drum
#

we should not overspend on updates, no need to have 8 updaters for 8 relayers, even one is enough, but if it is stable

urban stag
jade dust
#

you are not running relayer. You running just one bash script in cron)

inland nebula
#

what is the best value here?trusting_period = '4752s'

median island
molten drum
#

I recall in one of the projects there was a discord bot with notifications about clients close to expiration

urban stag
jade dust
#

/root/.hermes/bin/hermes update client --host-chain namada --client 00--tendermin--

jade dust
urban stag
#

must relayers always be updating? or can we just relegate that to the bash script

jade dust
molten drum
paper pulsar
#

i saw it in their official server

urban stag
molten drum
urban stag
# jade dust yes

this is the ~2.5 NAAN, yeah? or is it 2.5 NAAN for the update and 2.5 NAAN for the relay

cunning finch
#

Guys, take into account that in Namada we should use pipeline_length as a reference to set the trusting period instead of the unbonding_length

paper pulsar
gusty lintel
urban stag
#

is the NAAN cost for every IBC tx, or just relaying transactions away from Namada?

urban stag
urban stag
jade dust
#

if i sent tx from namada to cosmos there will be tx at namada, and at cosmos) aand someone should pay for them)

gusty lintel
cunning finch
#

Relayer would pay NAAN for recv tx (receiving in) and ack txs (sending out)

urban stag
#

how is this for a plan?

  1. four of us run an updater script and not a relayer
  • each set to update like 12x per day; each funded with 1000 NAAN
  1. five of us run relayers
  • updates set to manual; each funded with 5000 NAAN
#

time horizon being 7 days

paper pulsar
#

why don't we create our Namada <> Cosmos configurations similarly for each other? the only difference is in the memo

jade dust
#

this is a good plan
2nd group is the main in fact, and the 1st is just to make sure nothing gonna broke

cunning finch
#

It looks good to me

paper pulsar
#

seems good

paper pulsar
urban stag
#

great! thanks for all this support

cunning finch
urban stag
#

is there an example of a bash script for cron?

jade dust
#

you need config.toml

#

and channel frist of all

paper pulsar
jade dust
#

so command will be after we create channel; AFK for a couple of hours

cunning finch
toxic cave
#

We will, as we talked before ๐Ÿ™Œ๐Ÿผ

cunning finch
# cunning finch 2/3 of `pipeline_length`

We can take Min. epoch duration: 43200 to get an estimate in seconds of an epoch and then: 43200 * 2 = 86400 * 0.66 = 57024s -> this is the "ideal" trusting period on Namada's side

urban stag
inland nebula
paper pulsar
paper pulsar
jade dust
cunning finch
quaint arch
#

sent naan and testnet atom to everyone
(@minor solstice once you add your addresses i'll send you some too)

silk totem
#

don't forget to use filter packet to only relay your own channel messages

quaint arch
#

so now we just have to agree on a canonical channel-id, which bengt needs to compile the wasm tomorrow and make the governance proposal
and then keep it active during and after the proposal period or we have to start all over again

fathom bloom
#

I have atom test if needed and many naan (reward)

cunning finch
pallid wolf
#

I'm all set, I just need cosmos coins (naan is available).
ready

cunning finch
#

So now we have to agree on who will create the canonical channel?

quaint arch
#

sure, is anyone set up and ready to make a channel?

elder cipher
#

do i must change my hermes config to the same setting on google doc ?

#

oh i saw a cutoff

cunning finch
elder cipher
#

anyway if u need more volunteer, im ready

minor solstice
minor solstice
minor solstice
minor solstice
pallid wolf
#

You don't need access, post a comment and they'll add it all up

molten drum
pallid wolf
cunning finch
#

Yep, added

minor solstice
quaint arch
#

got a channel:

SUCCESS Channel {
    ordering: Unordered,
    a_side: ChannelSide {
        chain: BaseChainHandle {
            chain_id: ChainId {
                id: "shielded-expedition.88f17d1d14",
                version: 0,
            },
            runtime_sender: Sender { .. },
        },
        client_id: ClientId(
            "07-tendermint-3546",
        ),
        connection_id: ConnectionId(
            "connection-1743",
        ),
        port_id: PortId(
            "transfer",
        ),
        channel_id: Some(
            ChannelId(
                "channel-1142",
            ),
        ),
        version: None,
    },
    b_side: ChannelSide {
        chain: BaseChainHandle {
            chain_id: ChainId {
                id: "theta-testnet-001",
                version: 0,
            },
            runtime_sender: Sender { .. },
        },
        client_id: ClientId(
            "07-tendermint-3518",
        ),
        connection_id: ConnectionId(
            "connection-3624",
        ),
        port_id: PortId(
            "transfer",
        ),
        channel_id: Some(
            ChannelId(
                "channel-4118",
            ),
        ),
        version: None,
    },
    connection_delay: 0ns,
}
cunning finch
#

whoop, just made one as well haha

quaint arch
#

for the 'updaters', does this look right? we just have to run this in a cron job?

hermes --config ~/.hermes/config.toml update client --host-chain theta-testnet-001 --client 07-tendermint-3518
hermes --config ~/.hermes/config.toml update client --host-chain shielded-expedition.88f17d1d14 --client 07-tendermint-3546
cunning finch
#

Yeah, a loop in a bash script will do the trick as well ```#!/bin/bash

while true
do
hermes update client --host-chain shielded-expedition.88f17d1d14 --client 07-tendermint-3546
hermes update client --host-chain theta-testnet-001 --client 07-tendermint-3518
sleep 6000
done```

quaint arch
#

@minor solstice sent you funds
@pallid wolf @elder cipher did i get your addresses yet?

elder cipher
#

namada : tnam1qqd3z5qeg0pu0s5h24szxq4pe4dgd3naxsztstjw
cosmos : cosmos1tqzktq6ukyvu83r2sd8g3mjsjhp2pf9q08nxzc

minor solstice
quaint arch
#

yes should have come on both

#

oh hang on, one sec

minor solstice
#

as well

#

got my relayer set up with my pubkey in memo, assuming it's best if we remove that before going live?

elder cipher
#

okay , 2 IBC channels are healthy

minor solstice
cunning finch
#

Transfers from/to working fine

transfer/channel-1142/uatom: 160```

```gaiad q bank balances cosmos1ay642tntyt36kpgu7x2ynkxptq0gar4qenf7kt
balances:
- amount: "16"
  denom: ibc/F04FF8C3379F78D47F8839AE06C6EA217176BE98D0FA0550914195B4BF501E23```
elder cipher
#

i will comeback next 4 hours, its 4AM rn, sry guys ๐Ÿ˜ฆ

quaint arch
quaint arch
minor solstice
minor solstice
quaint arch
minor solstice
#

can track what goes through mine

cunning finch
#

In order to register it for shielded set rewards, do we need the tnam address-like denom of the (shielded?) testnet atoms, right?

#

If I'm not wrong

quaint arch
#

yep which depends on the channel (though the code will convert it from human readable)

const ATOM_BASE_TOKEN: &str = "uatom";
let ibc_atom_denom = format!("transfer/{ATOM_CHANNEL_ID}/{ATOM_BASE_TOKEN}");
let ibc_atom_token = ibc::ibc_token(&ibc_atom_denom);
# then use this to change various parameter values
warped holly
#

Omw home, just seeing this. Is the issue with clients randomly freezing resolved btw? Relayers here who had this happening? Or was this related to a specific hermes version?

minor solstice
molten drum
minor solstice
molten drum
minor solstice
#

I can boot up hermes fine ofc but have a feel it'll stall on relays for same reason. but definitely willing to give it a go

minor solstice
#

let me see how it behaves then..

molten drum
minor solstice
#

alright started relaying, let's see how this goes

molten drum
#

those channels are not active atm... actually, their clients have expired

knotty jacinth
mighty cloud
#

can you guys add me as well?

elder cipher
jade dust
#

relayer set up, updates and tx checked. working!

quaint arch
quaint arch
warped holly
cunning finch
minor solstice
#

created a gh issue on this, but so far hasn't gotten much attention (the more general issue)

quaint arch
#

are people still running v1.7.4-namada-beta7 or should we switch to v1.7.4-namada-beta8-rc from last week?

minor solstice
#

the long form memo branch

cunning finch
#

Same

#

Beta7

minor solstice
#

imma be out for a few hours, will check back here later if any developments

warped holly
#

beta-7 as well, haven't set up my relayer yet though. Are there enough people already? Saw that gavin preferred a small set.

cunning finch
#

I think I'm currently myself relaying, pretoro, and Gylijov from Nodiums

#

Sheet updated. @molten drum hey Liver, do you have Hermes running already?

warped holly
#

Aah, aah I read passed that, thank you!

cunning finch
#

Afaik the only active updater is Spork for now

#

I'm also running update commands though, just in case

quaint arch
warped holly
#

Still got like 10 testnet ATOM

#

Curious to see how quick that depletes

quaint arch
warped holly
#

Hehe yw and yes that's for sure the right choicee

#

Think it's on now. Channel-1142 <=> channel-4118.

#

How often do you update btw?

#

Could set a script up for that as well just in case

#

Ah 12x a day, so every 2hrs, got it.

elder cipher
warped holly
#

Awkwarddddd

molten drum
quaint arch
elder cipher
quaint arch
#

today we'll hopefully test the shielded rewards proposal code on campfire and then post a proposal on shielded expedition for voting next week (we don't want voting period to be during the long weekend)

quaint arch
elder cipher
#

ThreadId(01) connection handshake already finished for Connection { delay_period: 0ns, a_side: ConnectionSide { chain: BaseChainHandle { chain_id: shielded-expedition.88f17d1d14 }, client_id: 07-tendermint-3546, connection_id: connection-1760 }, b_side: ConnectionSide { chain: BaseChainHandle { chain_id: theta-testnet-001 }, client_id: 07-tendermint-3518, connection_id: connection-3631 } }

i updated hermes relayers to the same cliend id as google sheet, but the connection id is difference.
its still okay right ?

quaint arch
# elder cipher ThreadId(01) connection handshake already finished for Connection { delay_period...

hmm, i'm not sure why... it should look like this

~$ hermes update client --host-chain shielded-expedition.88f17d1d14 --client 07-tendermint-3546
2024-03-29T14:32:35.107647Z  INFO ThreadId(01) using default configuration from '/home/hermes/.hermes/config.toml'
2024-03-29T14:32:35.108255Z  INFO ThreadId(01) running Hermes v1.7.4+38f41c62
SUCCESS [
    UpdateClient(
        UpdateClient {
            common: Attributes {
                client_id: ClientId(
                    "07-tendermint-3546",
                ),
                client_type: Tendermint,
                consensus_height: Height {
                    revision: 0,
                    height: 20964457,
                },
            },
            header: Some(
                Tendermint(
                     Header {...},
                ),
            ),
        },
    ),
]
minor solstice
elder cipher
quaint arch
molten drum
molten drum
#

lol

#
2024-03-29T14:59:00.840454Z  INFO ThreadId(01) using default configuration from '/home/namada_rpc/.hermes/config.toml'
2024-03-29T14:59:00.841186Z  INFO ThreadId(01) running Hermes v1.7.4+1ede457f
SUCCESS ConnectionEnd {
    state: Open,
    client_id: ClientId(
        "07-tendermint-3546",
    ),
    counterparty: Counterparty {
        client_id: ClientId(
            "07-tendermint-3518",
        ),
        connection_id: Some(
            ConnectionId(
                "connection-3624",
            ),
        ),
        prefix: ibc,
    },
    versions: [
        Version {
            identifier: "1",
            features: [
                "ORDER_ORDERED",
                "ORDER_UNORDERED",
            ],
        },
    ],
    delay_period: 0ns,
}
2024-03-29T14:58:28.581937Z  INFO ThreadId(01) using default configuration from '/home/namada_rpc/.hermes/config.toml'
2024-03-29T14:58:28.582374Z  INFO ThreadId(01) running Hermes v1.7.4+1ede457f
SUCCESS ConnectionEnd {
    state: Open,
    client_id: ClientId(
        "07-tendermint-3546",
    ),
    counterparty: Counterparty {
        client_id: ClientId(
            "07-tendermint-3518",
        ),
        connection_id: Some(
            ConnectionId(
                "connection-3631",
            ),
        ),
        prefix: ibc,
    },
    versions: [
        Version {
            identifier: "1",
            features: [
                "ORDER_ORDERED",
                "ORDER_UNORDERED",
            ],
        },
    ],
    delay_period: 0ns,
}```
#

we have two connections on the same client 07-tendermint-3518 (cosmos side)

molten drum
#

and this makes me thinking I am missing something ๐Ÿ˜„

2024-03-29T15:01:59.428249Z  INFO ThreadId(01) using default configuration from '/home/namada_rpc/.hermes/config.toml'
2024-03-29T15:01:59.428729Z  INFO ThreadId(01) running Hermes v1.7.4+1ede457f
SUCCESS [
    PortChannelId {
        channel_id: ChannelId(
            "channel-1140",
        ),
        port_id: PortId(
            "transfer",
        ),
    },
    PortChannelId {
        channel_id: ChannelId(
            "channel-1141",
        ),
        port_id: PortId(
            "transfer",
        ),
    },
    PortChannelId {
        channel_id: ChannelId(
            "channel-1142",
        ),
        port_id: PortId(
            "transfer",
        ),
    },
]```
```hermes query connection channels --chain shielded-expedition.88f17d1d14 --connection connection-1760
2024-03-29T15:03:24.786621Z  INFO ThreadId(01) using default configuration from '/home/namada_rpc/.hermes/config.toml'
2024-03-29T15:03:24.787084Z  INFO ThreadId(01) running Hermes v1.7.4+1ede457f
SUCCESS []```
minor solstice
#

do I need to update client to the client listed in the canonical channels json?

molten drum
atomic tendon
#

Created a channel below.

tnam1qq7nfjqrsg8x9vssf87wamav883dw6eargagd763
cosmos1980eh8cnppjs6yn6wre7tgj9ywe6swwc75hn6e

SUCCESS Channel {
    ordering: Unordered,
    a_side: ChannelSide {
        chain: BaseChainHandle {
            chain_id: ChainId {
                id: "shielded-expedition.88f17d1d14",
                version: 0,
            },
            runtime_sender: Sender { .. },
        },
        client_id: ClientId(
            "07-tendermint-3589",
        ),
        connection_id: ConnectionId(
            "connection-1761",
        ),
        port_id: PortId(
            "transfer",
        ),
        channel_id: Some(
            ChannelId(
                "channel-1154",
            ),
        ),
        version: None,
    },
    b_side: ChannelSide {
        chain: BaseChainHandle {
            chain_id: ChainId {
                id: "theta-testnet-001",
                version: 0,
            },
            runtime_sender: Sender { .. },
        },
        client_id: ClientId(
            "07-tendermint-3529",
        ),
        connection_id: ConnectionId(
            "connection-3632",
        ),
        port_id: PortId(
            "transfer",
        ),
        channel_id: Some(
            ChannelId(
                "channel-4125",
            ),
        ),
        version: None,
    },
    connection_delay: 0ns,
}
molten drum
#

for what?

atomic tendon
#

Client will be updated everyday.

woven sky
#

i need chanel cosmos and se working for ibc dapp build

#

Who is doing well with it?

paper pulsar
#

its confusing

#

pleae just stick to the canonical channel

elder cipher
molten drum
elder cipher
molten drum
urban stag
urban stag
#

we're standing by for word from Brent to check our wasm code, discuss parameters (like inflation amount, target), and overall if we're good to go

i think we'll want the voting to begin mid-day Monday (i know it's a holiday for some) and have the voting period be active for validators all of Tuesday as well

ideally we'd have shielded set rewards active by Friday

lament barn
urban stag
minor solstice
cunning finch
#

Guys, please don't create more channels. We already supporting the canonical one - check spreadsheet on pinned messages for further reference

minor solstice
#

read the channel above..

lament barn
#

@quaint arch using update script now and updating canonical channels

molten drum
#

totally wrong channel...

minor solstice
swift grove
# quaint arch yes should have come on both

I have setup my relayer between selected channel shielded-expedition.88f17d1d14 channel-1142 and theta-testnet-001 channel-4118
My address
cosmos1l2hfmy3uengp2pnec9qhuz504j0m86y8slkgst
tnam1qqevylt0tatda2wzjz5v9r4u8gmm3tkptq9n4q7g

Can I get some gas ?
https://explorer.polypore.xyz/theta-testnet-001/tx/DD7E62867B44E3EEAE015327868FF88A6B6966AF940F43C21ABECB2944C97BC5

urban stag
warped holly
#

Just refactoring the code still and abstracting out logic so I can continue working on it with a clear mind.

#

I also relay, and I still got like 10.28 ATOM compared to 3 days ago ๐Ÿ˜ฎ (which was also around 10)! Though not many are probably using the channel.

#

(and also update), so it might be quite cheap. Though yeah the real deal starts when everyone will make use of it.

#

Edited: forgot to mention how much I had 3 days ago.

urban stag
urban stag
warped holly
minor solstice
#

let me check my wallets and see how they look

#

not sure mine has relayed a lot

#

looks like it did a few only

quaint arch
#

big thanks to everyone here for helping out on this! everything looks good ahead of the ssr proposal, hopefully coming later today
if anyone needs anything or has questions, lmk

cunning finch
#

Let's go ๐ŸคŸ

minor solstice
#

not sure why my relayer isn't picking up much of these

cunning finch
minor solstice
#

alright, I'll be the backstop then ๐Ÿ™‚

cedar otter
#

Has anyone manage to send shielded ATOM through the channel ? Or is it still not possible because shielded transfer are broken ?

wet obsidian
molten drum
quaint arch
#

anyone else seeing a frozen client?

ERROR foreign client error: client 07-tendermint-3546 on chain id shielded-expedition.88f17d1d14 is frozen: client state reports that client is frozen
urban stag
#

@here

warped holly
#

Just a sec, lemme check

#

Yeah crap, seeing it

molten drum
#

yep ++

warped holly
molten drum
#

btw, I recall that I used to update once per hour and the trusting period was something about a bit more than 1 hour, especially as saw that the client has expired in 2-3 days all the time
thought it was fixed somehow long time ago

#

ppl continue to create their own channels instead of using canonical...

warped holly
#

Freezing of client is connected to misbehavior last I checked out this problem.

#

Dunno how exactly it happens though.

molten drum
#

updated 11 minutes ago

molten drum
silk totem
#

i never experienced a frozen client on Noble, but happened to my osmosis client 3 times

misty groveBOT
#
liver23 has been warned

Reason: Duplicated text

warped holly
#

Did the freezing of clients start to happen ever since the memo size was increased? I don't remember this to happen before that long memo branch. But unsure, cause back then I had an unfiltered relayer on steroids relaying on all channels.

warped holly
molten drum
#

crap)

warped holly
molten drum
#

just before frozen error

#

nothing unusual

warped holly
#

Lemme check mine, see if something odd's in there.

molten drum
#

and those messages are from Cosmos side, looking to the height

fathom bloom
#

when i make ibc to cosmos osmo noble stargaze and celestia i found that client frozen after ~ trusted period and cosmos not living more 2 days

#

update not helping for me

molten drum
#

In uncommon situations, a highly valued client may become frozen due to uncontrollable circumstances ๐Ÿ˜„

warped holly
molten drum
#

I didn't see any misbehaviour evidence in the log also
When submitting evidence of Misbehaviour to freeze a malicious client

#

but updating it once per hour helped to keep it alive

#

If the one third of the validator set of the chain the client represents decides to collude, they can sign off on two valid but conflicting headers each signed by the other one third of the honest validator set. The light client can now be updated with two valid, but conflicting headers at the same height. The light client cannot know which header is trustworthy and therefore evidence of such misbehaviour is likely to be submitted resulting in a frozen light client.```
cunning finch
#

What was the trusting period on Namada's side?

#

The one I suggested in docs?

molten drum
#

yes, but can't answer for everyone
I used 4k+ smth and updated once per hour before, and didn't see frozen channels
but recall that the client had two connections as well, what I wrote on the first day, just that should not be the problem usually

cunning finch
molten drum
cunning finch
#

Yep

molten drum
#

it is like apphash in the chain seems

#

if we missed update it should be Expired and not Frozen

cunning finch
#

I think I already reported internally something related to frozen height on ibc clients on Namada's side one month ago or more

warped holly
jade dust
#

those with updating scripts, when was your last update from namada's side?

#

any chance to get tx?

#

hmm, weird tbh. something seems to be wrong on namada side

silk totem
cunning finch
#

I assume that frozen height can't still be fetched on Namada, and I think it's somehow related to the issue we are facing

silk totem
warped holly
#

Yeah, for some reason I'm seeing height 1, revision 0.

cunning finch
#

Wanna open the issue, but I don't know in which repo would fit better, Hermes or Namada? Had the same doubt when I reported it a while ago

warped holly
#

But Hermes might be better, cause it's related to relaying

#

We dunno what the actual problem is

jade dust
#

what if we try rly instead of hermes

warped holly
#

Might as well be something in the fork of hermes that's not taken care of well

warped holly
cunning finch
#

Unsure tho

warped holly
jade dust
#

cant it be related to hardfork?

warped holly
#

Tho we do isolate the issue then

#

It might not be the actual prob I mean to say

jade dust
#

i mean hermes could try to update height that is lower then earliest because we dont have history

cunning finch
#

Gonna open it once I get back to home, and let's see what team discovers

silk totem
warped holly
#

Cool! Thank you :)!

warped holly
molten drum
#

still have a suspicion it can be related to the multiple connections... dunno why ๐Ÿง

warped holly
#

I do still have an osmosis one open I think

#

3rd day now.

molten drum
#

as per that explanation when you get two correct hashes and can't decide which to use, then it can be frozen

pallid wolf
cunning finch
molten drum
quaint arch
#

last successful client update for me was apr 1, 19:00 utc

cunning finch
molten drum
#

as said before, why then this #1222959128629215262 message ๐Ÿค” I really didn't get clients frozen for a long time
we need to check 2 things as for me, with the new channel

  1. be sure that the client is unique, no multiple connections on it and still stick to the current trusting period from the file
  2. if it will be frozen again, reduce the update and period to ~1 hour and check again
    we can use two new channels for that to check in parallel
#

also if it is Frozen, it is not due to missing the trusting period, it is some non-deterministic misbehaviour

cunning finch
#

I'd wait for team to dig into it

silk totem
warped holly
#

Though atm I still have an osmosis channel open, not sure when it will freeze.

silk totem
warped holly
#

Yeah it's really weird, it might be due to a tx?

#

Keep thinking that it might be something with a wrong shielded tx, with an incorrect memo, but this is a leap.

silk totem
#

btw which hermes branch /version should we use now ?

warped holly
#

I'm using 1.7.4 beta 7 still

#

the long-memo version tho

#

Think most here do (either that branch or clean branch)

cunning finch
#

Same git status On branch 1.7.4-namada-long-memo Your branch is up to date with 'origin/1.7.4-namada-long-memo'.

warped holly
#
hermes 1.7.4+dc498bbf-dirty
silk totem
cunning finch
warped holly
#

Ah I think I did something dirty then

#

I'll recompile, cause that commit version I gave is totally off btw lol, wth I do.

cedar otter
#

@warped holly checkout using the tag version (from the docs) to be sure. Lankou also had that kind of issue at some point because he compiled at the wrong commit

warped holly
cedar otter
#

I feel you pain

minor solstice
#

may be on an older version here..

#

but thought I checked out the long-memo branch

minor solstice
#

made some infra changes, so assume my relayer should be more stable now

minor solstice
cedar otter
minor solstice
#

I believe the faq lists another version?

#

can't check atm but thought it prefered the long-memo for SE

cedar otter
#
  1. Is the latest hermes branch v1.7.4-namada-beta7 compatible with Namada +v0.31.0?
    It's not up to date with +0.31.0 but it's based on a version that is compatible with +0.31.0.
#

oh ๐Ÿ˜ฎ I didnt know there was that long memo version !

#

I've done all my test with the version from the docs. got no trouble with it

molten drum
#

do we have a new canonical channel pair?

minor solstice
molten drum
cedar otter
#

Is there a way to unfreeze the thing?
I've since governance proposal on some IBC chains to restore channels, is this it? It frozen=dead= create new one ?

molten drum
cunning finch
#

Also, there's no such proposal type in Namada yet. It wouldn't solve the issue though

molten drum
cunning finch
molten drum
quaint arch
#

does anyone have anything in their logs that would give an idea of what height the client froze at? even approximate?

molten drum
pallid wolf
warped holly
#

This one didn't freeze

2024-04-02T06:48:42.499482Z  INFO ThreadId(1157) worker.batch{chain=theta-testne
t-001}:supervisor.handle_batch{chain=theta-testnet-001}:supervisor.process_batch
{chain=theta-testnet-001}:worker.packet.cmd{src_chain=theta-testnet-001 src_port
=transfer src_channel=channel-4118 dst_chain=shielded-expedition.88f17d1d14}:rel
ay{odata=cleared/78a458bd ->Destination @0-21020899; len=1}: response(s): 2; Ok:
A8CF032D7E60AC2DACC1AB3990763852B095E0562F583848539A0DB8625FB43F; Ok:7C297721334
37DFC30F09159FD1D30ABD58253AB57FF2C9E4CD2D0021D06F8C0 target_chain=shielded-expe
dition.88f17d1d14 
#

This one did freeze:

2024-04-02T06:58:04.460934Z  INFO ThreadId(1157) worker.batch{chain=theta-testne
t-001}:supervisor.handle_batch{chain=theta-testnet-001}:supervisor.process_batch
{chain=theta-testnet-001}:worker.packet.cmd{src_chain=theta-testnet-001 src_port
=transfer src_channel=channel-4118 dst_chain=shielded-expedition.88f17d1d14}:rel
ay{odata=cleared/2cda6347 ->Source @0-281973; len=1}: response(s): 1; Ok:E589293
A28347ECBB4685D38375CAC7977AE237EA51B721871B0878A01A03ADB target_chain=theta-tes
tnet-001
#

I'm on my phone, think the copy paste is screwed up.

#

I'm comparing two different directions here tho if I check the target_chain value.

#

Actually the last one before the frozen one that had target chain theta testnet 001 had an error. But I've seen that error appear more often

4-04-02T06:47:52.878993Z ERROR ThreadId(18) worker.batch{chain=shielded-exped
ition.88f17d1d14}:supervisor.handle_batch{chain=shielded-expedition.88f17d1d14}:
supervisor.process_batch{chain=shielded-expedition.88f17d1d14}:worker.packet.cmd
{src_chain=shielded-expedition.88f17d1d14 src_port=transfer src_channel=channel-
1142 dst_chain=theta-testnet-001}:relay{odata=2bd66fb8 ->Destination @0-281918;
len=1}:send_messages_and_wait_check_tx{chain=theta-testnet-001 tracking_id=2bd66
fb8}:send_tx_with_account_sequence_retry{chain=theta-testnet-001 account.sequenc
e=190}: failed to broadcast tx with unrecoverable error response=Response { code
: Err(22), data: b"", log: "packet messages are redundant", hash: Hash::Sha256(7
8B9529F856E4CF0A6154457068669D45BCAEF680F354F0FE833CA87B14C6C00) } diagnostic=un
known TX sync response error: 22
2024-04-02T06:47:52.879074Z  INFO ThreadId(1177) worker.batch{chain=shielded-exp
edition.88f17d1d14}:supervisor.handle_batch{chain=shielded-expedition.88f17d1d14
}:supervisor.process_batch{chain=shielded-expedition.88f17d1d14}:worker.packet.c
md{src_chain=shielded-expedition.88f17d1d14 src_port=transfer src_channel=channe
l-1142 dst_chain=theta-testnet-001}:relay{odata=2bd66fb8 ->Destination @0-281918
; len=1}: response(s): 1; Error with code 22:78B9529F856E4CF0A6154457068669D45BC
AEF680F354F0FE833CA87B14C6C00 target_chain=theta-testnet-001
#

Ima go behind the pc and cut a segment of my logs, this copy pasting is probably not looking okay on a desktop.

jade dust
warped holly
#

Ah right!

#

Made sure not to narrow it down too much, the 'surrounding' txs before and after might be useful.

quaint arch
#

amazing, thanks! are the timestamps in utc?

jade dust
#

nothing special at logs. have tons of such at all relayers(

warped holly
warped holly
#

I'll fix switching between chains today, then redeploy my ibc app with osmo-test-5/theta-testnet-001 => namada-se shielded fix.

Will then continue to experiment with the SDK, see what's possible for namada-se => the other chains in a shielded manner.

cunning finch
#

Honestly don't think it has to do with config as frozen height isn't being emitted - this prob has to do with how ibc-rs is integrated in Namada

#

But who knows

jovial compass
#

is everything working with channel-1142/channel-4118? I sent some uatom (both to a shielded and non-shielded addr) but not sure if I did it correctly and nothing appeared on the Namada side. Sending from Namada gets rejected by VPs

molten drum
jovial compass
molten drum
jovial compass
warped holly
#

@quaint arch I'm not sure if this is a coincidence, but my osmosis client froze the moment I accidentally did a non-shielded IBC transfer to a znam address. This simply means I left the IBC memo empty in the transfer.

warped holly
#

Hmm, I should create a new channel and try to replicate this.

#

Brb.

#

BINGO

#
2024-04-03T19:33:47.708799Z ERROR ThreadId(20) spawn:chain{chain=osmo-test-5}:client{client=07-tendermint-3191}:connection{connection=connection-2869}:channel{channel=channel-6731}:worker.packet.cmd{src_chain=osmo-test-5 src_port=transfer src_channel=channel-6731 dst_chain=shielded-expedition.88f17d1d14}: task aborting after encountering fatal error: link error: failed during a client operation: client 07-tendermint-3704 on chain id shielded-expedition.88f17d1d14 is frozen: client state reports that client is frozen
#

It immediately froze

#

So okay, uhm I can prevent it in the frontend, but this requires fixing on-chain.

#

This is what I did, as you can see it's set to UNSHIELDED, but I'm sending the tokens to a znam address.

#

Unshielded simply means it leaves the ICS-20 memo field blank, so this whole freezing thing is related to either the memo being empty/faulty or the address format being off. Or ofc both.

cunning finch
#

Great, hope that this save time and helps devs to identify and resolve the reported issue ๐ŸคŸ

warped holly
#

I wanted to fix it in my frontend already, but now think it's better to leave it like this for now. That way the edge case can be tested.

#

Deployed latest version of the IBC app btw, shielded from osmo or theta-testnet => namada working.

#

Also assets get auto-converted to known denoms + shows which channel they come from.

jovial compass
warped holly
#

I'm creating new channels for both chains atm, takes a bit.

#

But you can use other people's channels aswell. My default channels are just not working now.

warped holly
#

It's okay if you accidentally do, cause I did the same by accident. Just make sure to toggle it to SHIELDED if you need to do a shielded tx.

jovial compass
#

the edge case is just leaving the memo empty?

warped holly
#

The latter is actually something I have to try still, a foreign random address.

#

But if you toggle to SHIELDED, the IBC memo generation is taken care of automatically.

jovial compass
#

on a related note, I'm wondering how to import the extension's shielded address into the CLI. no worries if you don't know, I can just set it manually

warped holly
#

viewing key or the pyment address? (payment address you can see in the extension under view keys)

#

Ah I get what you mean

#

No, I haven't gotten that solved, I keep getting a different Viewing Key if I import it

ionic ravine
#

if i am not wrong the memo is generated by keplr> or namada side

#

or it use a api to generate it somewhere

#

i guess it is a remote api

warped holly
#

I for now have that done via API, but next step is to get that shifted to SDK. Will deep-dive into the SDK tomorrow, cause I wanna tackle most stuff concerning namada => external chains.

#

Hope it's possible tho

ionic ravine
#

just want to confirm that

#

nice work anyway

warped holly
#

It's no biggy to have this generated via an api, but I really, like really dislike CLI usage whatsoever lol.

warped holly
#

Lemme redeploy with different channels.

#

Ah wait it already shifted

#

ah phew, glad to have made the default channels inside of an .env file. That way I can just change those in vercel's env settings and click 'Redeploy' on the latest deployment.

#

Might need to CTRL+F5, channel should say 6732 for osmosis.

ionic ravine
jovial compass
warped holly
warped holly
median island
#

๐Ÿซก๐Ÿซก salute you zen.

warped holly
vivid sable
#

Hey guys! Did someone manage to do shielded-ibc (using memo via ibc-gen-shielded) after fork and receive NAAN or UATOM tokens on shielded address?

urban stag
#

whoa @warped holly i'm just seeing all this now ๐Ÿ‘€

warped holly
urban stag
#

looks pretty exciting! @forest condor check this out

warped holly
#

So many threads/channels ๐Ÿ˜ฅ!

#

I do have to say, please only replicate the freezing of channels on own channels ๐Ÿคฃ...else if @quaint arch's going to test shielded tx's it might fail due to channels not working anymore.

#

The channel field is open tho, so it's also possible to type a different channel

unique aspen
warped holly
#

Hmm not getting decoded by namadexer?

#

Though it does get over to the other side?

unique aspen
#

I will try again

#

Yesterday I was not sure if the app was supposed to be functional.

#

Because of the discussions.

warped holly
#

Depends btw which direction you're trying. Some transactions will of course be on the other chain.

warped holly
unique aspen
#

Some things were freezing up, like the Vault.

warped holly
#

Namada => other chain shielded is not implemented btw.

unique aspen
#

Now I see I have NAAN on different channels

warped holly
#

Ah yes, yes, this is the chaos and mess we created after letting so many create channels ๐Ÿ˜‚.

#

I am guilty of it as well.

unique aspen
#

That was to be expected when the docs say you have to create channels to run a relayer, but is not clear about reusing existing channels.

warped holly
#

And testnets are there to be made a mess out of

#

So yeah, this eventually is all good.

unique aspen
#

And to prove the S Task it is also safer and easier to create new channels, although the format document says you can also submit an update transaction

#

I did too, just to be sure

warped holly
unique aspen
#

But it is kind of ambiguous if that could be considered Operating IBC infrastructure

#

So I totally get why people are creating new channels

unique aspen
warped holly
# unique aspen Is that also why setting From to Namada and enabling Shielded throws the error `...

Yeah the extension doesn't have this implemented, it tries to get the balance for the shielded address, but this doesn't work (at least in my experience atm). That's where the No results have been found on Vault comes from.

I'm playing around with the SDK now, see if I can figure something out. Though I don't think sending actually from Shielded namada to an external chain will work with the extension.

#

So I'll either come up with something temporary, but this will likely mean having to handle the keys outside of the extension...

unique aspen
warped holly
#

Yeah, so right now:

  • All things unshielded works, but who cares.
  • Shielded works from external to namada.
  • Balance fetching for osmosis and theta works (all assets). And for transparent namada addresses, though this is limited to only those you added and NAAN ofc.
#

Though hearing the latest in the validator circle, I'm not sure whether we'll be able to get something working properly since they stopped the SE development.

#

Shielded => shielded or shielded => transparent not working for me either, so I'm not even sure if that direction is doable now.

#

๐Ÿ˜ฅ...

#

I'm ripping the SDK apart as we speak lol, so I'll see what I can get out of it.

quaint arch
# warped holly It's either: - sending to a znam address and having the memo empty. - sending to...

sorry zen, not sure i understand...

are you talking about something like this?

gaiad tx ibc-transfer transfer transfer channel-4152 znam1qrylpn9848mz9v06sqefs9nekgqrj9hxa5v7p4e3l46j3q02sxsxymyjzyw9wt0fggtpn6qw2gpe3 100000uatom --from hub-relayer --keyring-backend test --node http://localhost:46657 --fees 7000uatom --chain-id theta-testnet-001 --memo ""

because if so, i haven't been able to replicate. or is it something specific to your app?

warped holly
#

Forgive me, I'll possibly destroy my osmo channel now.

#

Okay, very interesting

#

It froze just now when I used my relayer address

#

to transact with

minor solstice
#

I wonder if using a wrong version could cause someth like this?

warped holly
#

This, so that translates to:

osmosisd tx ibc-transfer transfer transfer channel-6732 znam1qqtnyzu97zknt3sff74aj8fnxxx6lr5gke2vqp8w8pmxz7dp25rt7jsmq46dn2g2t0al2ps2paryv 100000uosmo --from osmorelayer --chain-id osmo-test-5
#

I was trying all sorts of combi's with another address and it didn't freeze.

#

But now that I tried it with my relayer address that's relaying the osmo-test-5 channel it froze.

warped holly
#

Or is that --from another address

warped holly
#

But aint that messed up if someone could freeze a whole channel just by being on an incorrect version?

#

I'm creating a new channel, will try all sorts of combinations again.

minor solstice
#

we were all using at least three different versions I think

quaint arch
warped holly
#

I changed my version to long-memo branch, my hermes was dirty...

#

I'm not getting the issue anymore

#

Though, ain't that a big problem? If my hermes caused this, then just one bad actor can destroy a channel.

#

If it's related to hermes version

#

(btw channel-6735 can be used for osmosis)

quaint arch
warped holly
#

I unfortunately only have the commit hash but it said -dirty so I probably did something in there.

#

Though I find it weird, others had the same problem in the past, so it may have been related to that commit

#

hermes 1.7.4+dc498bbf-dirty

#

I'm btw not sure if it's related to this, but atm I'm not getting issues with the channel freezing

#

Should I again switch to that one and do the same tx and see if it freezes?

#

Wait let me try finding out what was different with that one. I can't really figure it out precisely since I only have the binary.

minor solstice
#

or app version I guess

warped holly
#

Ah I remember, so back then I grabbed branch: yuji/1.7.4-namada-shielded
and changed the part in the code where the memo limit was upped.

minor solstice
#

sus haha

warped holly
#

This is all speculation still though

#

Let me go back to that version and try the tx again

#

No wait, my client froze agan

#

again*

#

Okay this is confusing now lol.

#

I'm on hermes 1.7.4+1ede457f long memo and it froze ._.

#

recreating channels :)...! Gotta love bugtesting huh, Spork.

minor solstice
warped holly
#

Redeployed my site btw, think it will auto show the channel I just made now

#

Will be short-lived tho lol.

#

Ah wait it's still building.

quaint arch
#

Are you freezing using the cli or your app? Could it be something your app is doing (no offense)

warped holly
#

Hahahaha

#

None taken

#

Let me do it via CLI

#

And this issue happened before the app was around, but yes let me keep the env we test in consistent.

warped holly
#

If it is, then I definitely need to be labeled the destroyer

quaint arch
#

Solution is clear, we just need to keep zen away from our stuff and everything will be fine ๐Ÿ˜‚

#

There's only one relayer running on these channels, right?

warped holly
#

Yes, don't think anyone else joined

#

Okay I did the same CLI command 5 times

#

t froze

#

It

#

AAAAAAAAAHH

#
osmosisd tx ibc-transfer transfer transfer channel-6736 znam1qqtnyzu97zknt3sff74aj8fnxxx6lr5gke2vqp8w8pmxz7dp25rt7jsmq46dn2g2t0al2ps2paryv 500000uosmo --from osmrel --chain-id osmo-test-5 --node https://osmosis-testnet-rpc.polkachu.com:443 --fees 2000uosmo
quaint arch
#

Do you have misbehaviour set to true or false in your config?

warped holly
#

Set to false

#
[mode.clients]
enabled = false
refresh = false
misbehaviour = false
#

Got a cronjob open with update client commands

quaint arch
#

Oh and can you please set log level to debug if you haven't already?

warped holly
#

Oh, is it too late to do this?

quaint arch
#

For next time
You switched hermes versions, is it possible the cronjob commands are still pointing to the dirty version?

warped holly
#

(At times I'm a noob, forgive me)

quaint arch
#

No worries, me too, this is advice from yuji

warped holly
#

This is how my .sh file looks like:

#!/bin/bash
/root/.hermes/bin/hermes --config ~/.hermes/config.toml update client --client 07-tendermint-3705 --host-chain "shielded-expedition.88f17d1d14"
/root/.hermes/bin/hermes  --config ~/.hermes/config.toml update client --client 07-tendermint-3706 --host-chain "shielded-expedition.88f17d1d14"
/root/.hermes/bin/hermes  --config ~/.hermes/config.toml update client --client 07-tendermint-3737 --host-chain "shielded-expedition.88f17d1d14"
/root/.hermes/bin/hermes  --config ~/.hermes/config.toml update client --client 07-tendermint-3587 --host-chain "theta-testnet-001"
/root/.hermes/bin/hermes --config ~/.hermes/config.toml update client --client 07-tendermint-3196 --host-chain "osmo-test-5"

cronjob:
0 */2 * * * /bin/bash /root/update-hermes.sh >> /root/update-hermes.txt 2>&1

my service file also points to:

ExecStart=/root/.hermes/bin/hermes --config /root/.hermes/config.toml start

I even daemon-reloaded btw.

/root/.hermes/bin/hermes version
2024-04-04T22:15:56.140305Z  INFO ThreadId(01) running Hermes v1.7.4+1ede457f
hermes 1.7.4+1ede457f
#

So in conclusion everything points to 1.7.4 long memo branch.

#

Unless I need to do something bout that cronjob? Does it have caching or something?

#

Hmm, perhaps I should make a change to the crontab -e, save and then change it back, save again.

#

Don't think it caches the scripts it's supposed to run? That would actually be annoying...

#

Uhm how would I set debug on btw? Do I do this in the service file?

cunning finch
warped holly
#

Thanks ๐Ÿ˜‚.

#

Alright, step by step, how fitting: channel-1234 just got made.

#

Okay everything sorted, now let's spam till it freezes or not.

#

Hmm okay frozen in 3 min roughly.

#

Here's the log from start to end

#

Again I kept doing this to keep it consistent:

osmosisd tx ibc-transfer transfer transfer channel-6737 znam1qqtnyzu97zknt3sff74aj8fnxxx6lr5gke2vqp8w8pmxz7dp25rt7jsmq46dn2g2t0al2ps2paryv 500000uosmo --from osmrel --chain-id osmo-test-5 --node https://osmosis-testnet-rpc.polkachu.com:443 --fees 2000uosmo
#

Perhaps it might be related to refunding tokens?

#

The log's okay now right @quaint arch?

#
2024-04-04T22:31:34.397114Z DEBUG ThreadId(32) worker.batch{chain=osmo-test-5}:supervisor.handle_batch{chain=osmo-test-5}:supervisor.process_batch{chain=osmo-test-5}:worker.packet.cmd{src_chain=osmo-test-5 src_port=transfer src_channel=channel-6737 dst_chain=shielded-expedition.88f17d1d14}:update_schedule{batch.tracking_id=fa47b0c4 batch.height=5-6475416}:schedule{odata=fa47b0c4 ->Destination @5-6475416; len=1}: connection delay need not be taken into account: client update message will be prepended later
2024-04-04T22:31:34.482246Z DEBUG ThreadId(32) worker.batch{chain=osmo-test-5}:supervisor.handle_batch{chain=osmo-test-5}:supervisor.process_batch{chain=osmo-test-5}:worker.packet.cmd{src_chain=osmo-test-5 src_port=transfer src_channel=channel-6737 dst_chain=shielded-expedition.88f17d1d14}:relay{odata=fa47b0c4 ->Destination @5-6475416; len=1}: retrying retry.current=1 retry.max=5
2024-04-04T22:31:34.482264Z DEBUG ThreadId(32) worker.batch{chain=osmo-test-5}:supervisor.handle_batch{chain=osmo-test-5}:supervisor.process_batch{chain=osmo-test-5}:worker.packet.cmd{src_chain=osmo-test-5 src_port=transfer src_channel=channel-6737 dst_chain=shielded-expedition.88f17d1d14}:relay{odata=fa47b0c4 ->Destination @5-6475416; len=1}: prepending Destination client update at height 5-6475417

These messages look suspicious to me. Like some queue is building up.

#

But yeah, I will have to sleep now, lemme get some valid channels up and running again on my site though.

quaint arch
warped holly
#

And you're very welcome man!

#

Thank you for testing it out, it's just weird that I managed to instantly freeze my own channel back when I tried to recreate the problem. It made me think it was definitely caused by this transaction, but it isn't 'exactly' the case? I dunno. It's weird.

#

Yuji and others will speak some ancient greek and do some magic

#

Okay, redeploying now. Once Osmosis says channel-6738 on the site, it's updated.

warped holly
minor solstice
unique aspen
warped holly
unique aspen
#

Just received this with a shielded IBC transaction Osmosis -> Namada through your app:
transfer/channel-1235/uosmo : 1000000

warped holly
#

Still need to figure out if there's a quick way to do this

#

Best case would be that it auto fetches all denoms.

unique aspen
#

Not sure I follow, this is what the CLI returns when querying balance.

#

Just to confirm that the transaction went through.

warped holly
#

Yeah, transfer/channel-1235/uosmo actually has a tnam... address

#

Just like naan has a tnam...zee address

unique aspen
#

Oh

warped holly
#

It ends with zee I believe? I'm not sure.

unique aspen
#

zcee

warped holly
#

Ah yes, that one

unique aspen
#

I think that is a low priority UX thing

warped holly
#

I could be really gay and just let balances get queried via CLI ๐Ÿ˜‚.

unique aspen
#

I think the MASP algorithm has to be improved so it can run in a browser client

#

Starting with scanning backwards

warped holly
#

Yeah, really hope to see that, will definitely implement it.

unique aspen
#

That is what ZCash light wallets do

minor solstice
warped holly
#

But reading it back I just notice how ignorant I am to it all.

unique aspen
#
warped holly
#

That's genius.

unique aspen
#

There is another algorithm that I wanted to implement but I fear too short before the end: WarpSync

unique aspen
unique aspen
#

But to be honest I think implementing a fast sync would be more satisfying

warped holly
#

The English version also did a great job at this

warped holly
unique aspen
#

I tried reading the manga too, the art strains my eyes trying to figure out what happens

#

Blame kind of the same, but I guess that is the charm

warped holly
unique aspen
warped holly
unique aspen
#

I never watch the spoilers

warped holly
#

A friend of mine put this on once while he was smoking his weed and nodded like 'uhuh' 'uhuh', you didn't know this huh?

unique aspen
# warped holly That's genius.

I wonder if BlazeSync can be translated to Namada though, because ZCash has a UXTO model while Namada has an account-based model

warped holly
quaint arch
#

the team tracked down the cause to an issue in ibc-rs: https://github.com/cosmos/ibc-rs/issues/1080
so it should be resolved when ibc-rs is upgraded in Namada. (the ability to unfreeze clients should be possible in the newer version also)

hermes retries transactions when they're rejected by the destination chain (eg a znam address with no memo) and before each retry, a client update is requested. so it could be related to many client updates being requested... the consensus state of the latest client gets overwritten by an earlier one due to the bug, and on the next update the incongruency is detected as misbehaviour and the client is frozen.

for now, working with what we have, they suggest a partial workaround: set trusted_node true in the hermes config for the counterparty chain... this setting ensures only one update message is submitted per request. it will work for a single hermes, but does not perfectly avoid the issue when using multiple hermes for a single channel

GitHub

Bug Summary Reported by @vmarkushin When a header with a height lower than the current client height is submitted for the first time, we store the consensus state at the height of the current clien...

warped holly
#

Just creates a bit of a problem here with the channels this temp workaround.

Means that if multiple relay the channel and this edge case gets done and a relayer without the workaround keeps relaying it, the chance is there the client could still freeze?

cunning finch
warped holly
cunning finch
#

Glad we stressed it out before mainnet, because we def need to have canonical channels with multiple operators supporting them

warped holly
cunning finch
#

But using ibc-go, ofc, ibc-rs has not been battle tested enough like the 1st one I guess

warped holly
#

Damn, mine may have been related XD. The chain was a fork of evmos.

cunning finch
unique aspen
#

I got rugged on Evmos

warped holly
unique aspen
#

Nomad exploit

cunning finch
#

They took measures to protect their work with licenses after all the drama

cunning finch
warped holly
#

That's a shame

warped holly
#

Set my settings for osmo-test-5 and theta-testnet-001 to trusted_node = true for now.

If we still going to do the theta relaying over here, perhaps my open channel could be used. (channel-4157 - channel-1217).

warped holly
unique aspen
#

I transferred back and forth between Cosmos and Nama with my public key as memo. The transactions show up on Mintscan, but they do not register on the extended NEBB.

unique aspen
#

Actually it would not register with your app either, since Namada as source does not work, right?

warped holly
#

I think the relayer who transacts the package gets registered

#

You used my channel?

unique aspen
#

Yes

warped holly
#

Can you see if it gets on my profile

unique aspen
#

Good idea

warped holly
#

(only if I'm the only one relaying the channel tho)

#

Something weird going on with my shielded sync though...it keeps fetching like a minimum of 500 blocks.

warped holly
#

Oh oops, I've also now done 2 unshielded transactions to double-check ._.

Dunno if you're able to distinguish. Apologies lol. Won't do anything now.

unique aspen
#

Could not find it

#

Are you using memo_overwrite in Hermes config.toml?

warped holly
#

No memo_prefix, which does seem to register on extended nebb

molten drum
warped holly
#

Or has Kintsugi switched over to only strictly 'memo_overwrite'?

#

Think this memo_overwrite is a new field in 1.8 ish version right?

unique aspen
molten drum
#

sitting on long-memo versions

warped holly
#

So for now we still just use memo_prefix

#

And yes like LiveRaveN said, long-memo branch

#

You'll set up own channels?

unique aspen
#

I am trying something else

unique aspen
unique aspen
warped holly
#

Hol up, what's it called exactly

unique aspen
#

That is not obvious at all

warped holly
#
git status
On branch 1.7.4-namada-long-memo
Your branch is up to date with 'origin/1.7.4-namada-long-memo'.
#

hahahaha this all is not supposed to be obvious ๐Ÿ‘๐Ÿ‘

unique aspen
#

Yeah, found it.

#

"One can download the latest binary release"

#

Yeah, no

warped holly
#

Hahahaha, yeah

#

Might save you time:

cargo build --release --bin hermes
#

If you're a dummy like me forgetting simple commands

#

It will then be in the target/release folder.

unique aspen
#

You are a psychic!

#

I actually already got the ROIDs for the Operating IBC task, but I want to play around.

warped holly
#

Yes, yes, dance with it

unique aspen
#

Because it bugs me out that the transactions do not register

warped holly
#

I likely need to create a new shielded address

#

Yeah I feel ya

#

Had the same

unique aspen
#

Curiosity is a powerful driver

warped holly
#

Though actually unfair if that's the case, then a relayer could farm points made by others

#

Or perhaps the treat for providing such service ๐Ÿ‘ฟ

unique aspen
warped holly
#

My great masta plan unraveled by Rigorousss

unique aspen
#

I knew there was a reason why you made that website so nice

warped holly
#

Thank you though โค

#

Oh that's a different heart. Ah well, all hearts matter.

unique aspen
#

Actually I have a similar plan for a different purpose, but not sure I will be able to pull it off.

warped holly
#

Keep at itt, there's a ton you can still do

unique aspen
#

I know, I have a huge to-do list, but not enough time

warped holly
#

I just uploaded a fix so that you can't type a wrongly formatted address in the address field on the site

#

I have to create a new shielded address btw, just a moment. Let me see if I can.

#

Cause of this weird bug now:
Asset threshold of selected conversion for asset type bfe4922fe3da46887eaeedfc37dfd286c11f961cc37dbe285dd08dc241539020 is 0, this is a bug, please report it.

But you already saw it, saw your response on github!

#

The log made me laugh.

#

This is a bug, please report it. - I imagined a robot saying this. AI being self-conscious.

unique aspen
#

What happens when you do balance --owner YourSpendingKey?

warped holly
#

Oh that's interesting, think last I tried this it asked for my viewing key

unique aspen
#

I never had that

warped holly
#

Like literally gave a prompt to fill in my viewing key

#

It used to say something with not consumed or something right?

unique aspen
#

That is super weird, I never had to do anything with a Viewing Key to do the point I wonder what its purpose is

unique aspen
warped holly
#

I dunno man, this divide by 0 just appeared outta nowhere

unique aspen
#

You have not shielded-synced that shielded pair?

#

Let see if I can replicate it with a new pair

warped holly
#

It used to just give my balance, like 4 hours ago it worked

unique aspen
#

Maybe shielded.dat is corrupt, you can delete it but have to resync

warped holly
#

What I do is perhaps really odd tho, I shielded sync without specifying viewing key, then right afterwards I do it with a --viewing-key flag

#

Yeah though odd if it got corrupted in two servers

unique aspen
#

Ah

warped holly
#

I can find balance for another viewing key tho

#

Try querying balance of my viewing key

#
namada client balance --owner zvknam1qynmxyf5qqqqqq983j0nwgsc8zf0jhglrq3x49y05vz3vdhlwcw9taldce6apv73e3g8mpn57afyqdnkh8dpmp7v962l24m69f8aynp7sa02jsf93ftaehmlwtj9ak7hply4c93862sahqtprluapxda5p5x3gx4k6wzqedjuu8yhtyk5paxedw6gpfhfsatr96jeqh9tjh2258xtrnyz0f2pddhsr3ms6lwkywaphy687uvcnwc06jd32zu375437xe6p2yx6ets6c07r988
unique aspen
#

New shielded pair = context should contain viewing key

warped holly
#

I wonder about something btw, you may perhaps know.

What's the difference between calling shielded sync and calling it with --viewing-keys and specifying one? And what happens if one does these two back to back.

#

My assumption was that shielded sync without --viewing-keys would look at all viewing keys you got in your wallet.toml and sync those.

unique aspen
warped holly
#

So I tested a viewing key I didn't import (namely the one in the extension cause I still can't figure out how to import that one)

unique aspen
#

After doing a little scanning:
balance MyViewingKey
Last committed epoch: 79
No shielded balance found for given key

warped holly
#

Ah so you do have to implicitly shielded-sync that one by specifying it in --viewing-keys

#

Don't though lol.

unique aspen
#

Why not?

warped holly
#

You don't want your shielded sync to crap out now.

#

Or get corrupt or whatnot

#

Oh

#

You're talking bout your own?

unique aspen
#

It does not matter, the shielded actions besides unshielded->shielded are not working for me anyway.

warped holly
#

Thought you tried my VK, nvm hehe.

unique aspen
#

Oh

warped holly
#

This is your new shielded

#

Uhm what's the payment addr? can I try sending to you?

#

Or wait, let me do my own stuff first.

unique aspen
#

I have not created a payment address yet. Only created a new spending-key viewing-key pair, queried balance, synced a few hundred blocks, queried again.

warped holly
#

You specified the from-height?

unique aspen
#

Yes

warped holly
#

Like one really close I assume?

unique aspen
#

--from-height 310600

warped holly
#

Did this cause trouble with your other shielded addresses?

#

(if you have any)

unique aspen
#

I imagine

#

I mean I just skipped over a couple thousand blocks

warped holly
#

Yeah, ah well as long as you have one working addr

unique aspen
#

About to find out what the consequences are

warped holly
#

Hehehe, anything to bugtest this

unique aspen
#

Weeeee

#

When you're a kid and you want to go weeeee

warped holly
#

๐Ÿ˜‚ hahahaha, too morbid.

warped holly
#

Hahhahahaha weleleleel weeeee

#

Whenever I hear that I remember giving my lil niece math lessons via video calls

#

She kept doing this with all her other lil brothers and sisters

#

She picked up her phone and she just said that with her face all up in the camera

#

Oh shit someone just got knocked out by a tree

#

๐Ÿคฃ that one caught me off-guard

unique aspen
warped holly
unique aspen
#

transfer --source MySpendingKey --amount 1 --token naan
The balance of the source tnam1pcqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqzmefah is lower than the amount to be transferred.

balance --owner MySpendingKey
naan : 42

warped holly
#

Though VP will probably reject anyways

unique aspen
#

You are right.

After syncing:
naan : 1042

Transfer:
The balance of the source tnam1pcqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqzmefah is lower than the amount to be transferred.

#

Can we fix the MASP storage or is that part of the buggy behavior that is not going to be fixed this SE?

#

Maybe resync from the fork

warped holly
#

What type of transfer you're trying to do?

unique aspen
#

spending-key to transparent

warped holly
#

Ah so unshielding

#

Don't think that works

unique aspen
#

Oh yeah, that was broken ๐Ÿคฆ

warped holly
#

Yeah, also shielded -> shielded didn't work.

unique aspen
#

Maybe call it a day and get some sleep

warped holly
#

Hehe, I'll also do that after I implemented copy to clipboard buttons, wanna add for viewing key as well.

#

Since the extension doesn't show this

unique aspen
#

I read the extension deliberately lacks features.

warped holly
#

deliberately huh, hm.

#

More and more think it would have been better if I sticked to CLI hehe.

#

But nah, I liked to have made these applications. Can be used eventually, just need to keep up and keep adding on to it.

unique aspen
#

```The architecture of the extension and extension API somewhat resembles that of `@keplr-wallet/extension

There are a few key differences in functionality however. Our extension will only handle the creation of a seed and derived keypairs, as well as signing transactions. It will not be responsible for allowing the user to send transfer transactions, but should be responsible for submitting account initialization transactions```

warped holly
#

Ah I see

unique aspen
#

The web app has to do that

warped holly
#

Though I can let it do a transaction

#

Unshielded that is.

#

Hmm, things may have changed last this has been updated

#

Ah I perhaps understand what they mean

#

So the extension itself, just opening it won't offer much functionality

#

In Keplr you could do transactions, do IBC transfers, all that from within the screen.

#

Ah okay yeah, got it.

unique aspen
#

Yes, but I wonder if that is a design choice due to time constraints, technical limitations or expected performance issues.

#

Or just out of principle.

warped holly
#

Hmm, asking a question thurrrr

#

I do not know

#

Could be a 'for now we keep it simple'

unique aspen
#

Say you want to make your own Namada wallet that behaves more fully featured like Keplr, would the organization try to talk you out of that?

warped holly
#

Think you'll get thrown in a bonfire

unique aspen
#

Haha

#

Ouch

warped holly
#

๐Ÿ˜‚

unique aspen
#

"YOU DIED"

warped holly
#

๐Ÿ˜‚, why do I think of that video of that dude singing.

#

"Before I was born, my motha died"

unique aspen
#

No I was thinking of emotional damage

warped holly
#

hahaha ๐Ÿ˜‚

#

EEEEEEEMOOOOOOOTIONALL DAAAAAMAAGEEEE

#

wullullululuppp weeeeeee

unique aspen
warped holly
#

Hahahahahahahah

unique aspen
warped holly
# unique aspen Why why why why

My god, finally got those copy to clipboard buttons implemented. I hate styling + making everything responsive/mobile-friendly arghh...hope it's not too cluttered now tho. I actually just wanted to add a button to copy viewing key to clipboard but ended up adding all addresses.

#

5AM ๐Ÿ’ค...peace.

cunning finch
#

Shielded set rewards have been activated in theory at start of epoch 80. Unluckily I messed up keys and I can't find the one I used to receive the uatom from the frozen channel. Is there anyone here that managed to get uatom transfer/channel-1142/uatom? If so, please make a shielding transfer to test out the feature.

#

Hm, it looks like the two selected assets to receive shielded set rewards aren't appearing while running:

The following tokens may earn MASP rewards:```
cunning finch
#

Ah wait, grace epoch is 78, so they should have been activated at start of epoch 79 in theory ๐Ÿง

paper pulsar
#

the channel is still live?

median island
cunning finch
cunning finch
median island
cunning finch
#

The rewards are in form of NAAN

#

In theory ๐Ÿ™„

#

Perhaps it had to do with proposal wasm code?

warped holly
#

I did sent that specific uatom (0.1 atom) to a shielded address, but I did it before this started I think

median island
#

namadac balance --owner zvknam1qw0ufd22qqqqpqqn5pp03dkflh6w7m3rh8ut6mk9jefw2fy86v0hnphljl0n82t7x84hw02tumqeeqsa688rzw63f0cel739d6g2gy9g0gfrl2spcepv6yzyp0sllrajefj56nse0p60vdqut07m9qcvrj2gfza8pfrz3fxx4c6yd33swl3aqntn7d7x4jn7phth6mx03gfjkywhu07yxyex03wsfvmfn76356lc3pe594kku6x78apklmf5a0dwust9usx8fweng4s08hwmu
Last committed epoch: 80
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...
converting current asset type to latest asset type...

#

and its not genrating any result

warped holly
#

Not sure tho

cunning finch
median island
warped holly
cunning finch
#

Guys. Shielded to shielded transfers and unshielding transfers are broke for you as well?

carmine trail
cunning finch
#

The shielded sync thing seems to work but only to fetch balances and for shielding transfers

cunning finch
warped holly
#

Here's a current screenshot, I'll wait a bit and see if anything changes.

#

Doesn't look like my NAAN changed, think I already had this yesterday

#

It's auto shielded syncing every couple mins on my server.

cunning finch
warped holly
#

How long should I wait? You know how often these rewards come?

warped holly