tooldev-general

[daring moss]

I used the active sheet ?

I'm still not scaling it properly though, hm

[worthy cape]

Wish had some side effects:

[rapid pagoda]

Path of Building, Heavy Metal Edition

[daring moss]

Does POB get its textures by unpacking the GGPK? I've been using the sheets included in https://github.com/grindinggear/skilltree-export but they seem to be much lower quality than what POB has?

[worthy cape]

We use those public sprites, afaik.

[daring moss]

Oh, huh, interesting

[worthy cape]

A bit too much effort to mine out and match the assets when there's sufficiently decent ones.
There's also the problem that there's no game data files pre-launch, while the JSON+sheets are often available early.

Same kind of idea as PSG+table use vs. JSON.

[daring moss]

because I've been using https://github.com/grindinggear/skilltree-export/blob/master/assets/skills-3.jpg and it looks distinctly worse than what POB does

(ignore the awful lines)

[worthy cape]

You can see them in-situ at say PoB\src\TreeData\3_24 in a PoB installation.

I can see the quality difference there for sure.

(don't mind PoB's connectors btw, those are still the old 3.19 (3.16?) ones as we haven't made it draw the new ones yet)

[daring moss]

Hrm, you're right though, going purely off of the resources in TreeData/3_24 it should be the same

[worthy cape]

I wonder if it's up to filtering (nearest vs. bilinear) and how yours seem to be a bit enlarged?

[daring moss]

I've tried it with both, but I also think I'm just not rendering nodes properly

because for example notables were the same size as regular nodes, so I just... scaled them to look approximately the correct size

Oh god I think that is the problem. I'm taking everything from normalInactive 💀

Sorry for being so dumb lmao

[worthy cape]

Ever forward, sometimes learning.

[daring moss]

And that solved it

man, why are the notables and keystones included in the other thingy

[lusty musk]

@fickle yew > If you have constructive criticism on how the configuration could be better with additional rules

Regarding configuration on poe.ninja, I think it would be better overall if guard skills were turned off by default for EHP calculations. Right now you can make a pretty mediocre character with 30k armour, toss on molten shell and suddenly show up in everyone's search with minimum EHP thresholds because that's like adding three kaom's hearts worth of raw HP to your setup, despite that only being up occasionally. I think EHP numbers without taking into account guard skills is more realistic.

e.g. a profile like this: https://poe.ninja/builds/necropolis/character/vianderuspoe456/Veyshatropolis?type=exp&timemachine=day-6
goes from 91k EHP to 32k when you turn off molten shell (I'm not saying this is a mediocre character, just took a random example)

[fickle yew]

Yeah that would probably make sense.

[primal pewter]

Hi, I have a question about Veiled modifiers. I am trying to figure out how to get a list of possible unveils from the data and it mostly works, but then I came across this mod: https://www.poewiki.net/wiki/Modifier:JunMasterVeiledSpellDodgePercentage~~

It has the unveiled mod domain, it can spawn on body armours, and it's not a signature mod. But neither poedb nor craftofexile show it as a mod that can be unveiled. Why? Is it somehow filtered out? If so, based on what is it filtered and are there other mods like it?

[bright ridge]

Howdy howdy I know I've asked this before but any news on (o-auth enabled) endpoints for Guild Stash tabs?

No rush on this - the current plan is to re-implement a session-id based auth to use with the existing endpoints

[hexed mesa]

given the id I assume it's old dodge veiled mod, which were retroactively changed into spell suppression. if I were to guess it's filtered out by "old" in mod type or just done manually

[primal pewter]

Thanks, that's what I figured. I am just a bit worried to filter out all the mod types that end in "Old" because there are a bunch of them... I wonder if they are all invalid?

[velvet fog]

Veiled mods are not trusted and they may not be available. you need to manual list it.

[primal pewter]

Thanks! And it's not documented anywhere which ones are invalid?

[frank drift]

in games files, generally not

on wiki potentially if someone manually listed them

[fast beacon]

https://www.youtube.com/watch?v=5-Zu_WNY4Dw
random showcase of my filter

[compact isle]

the patch mid-next-week should improve this, providing a ISO timestamp and including the history entry id in the CSV

eg:

Date,Id,League,Account,Action,Stash,Item
"2024-07-16T23:18:47.000Z",29057,"Settlers","Novynn","added","1","Pit Map (T15)"

[flat star]

The schema in poe-dat-viewer hasn't loaded for several days now. Does everyone have this problem?

[faint remnant]

That's so nice 🙂 thank you very much

[crisp kestrel]

Hey guys. Here is my presentation of yet another divination cards website
https://www.reddit.com/r/pathofexile/comments/1e4ivbs/divination_cards_resource/

[worthy cape]

used the site a few days ago, don't recall noticing

I would assume it fetches from GitHub directly, does the network tab in the dev tools say anything?

Ah, it's via the workers - https://poe-bundles.snos.workers.dev/schema.min.json.
Just checked, works fine for me.

[crisp kestrel]

.pages and .workers are blocked in RU. Maybe this

[bright ridge]

Any place I could easily find and download the Filter Icon assets?

I was able to scrape the attached Image from the FilterBlade site. Might just have to do it manually?

[worthy cape]

Squinting at game files, there's art/2dart/minimap/player.png, which probably is indexed by some table somewhere.

Ah yes, data/minimapicons.dat64.

[bright ridge]

Oh I've never really messed around with the game data. Is there a (legal) way to easily extract the image content from that?

Given you just crossed it out I'm guessing no heheh

[worthy cape]

More that I didn't find where the coordinates are defined, that table only has data like:

[bright ridge]

Oh gotcha gotcha

[worthy cape]

Actually, the icons in that image are in the same order as the table.

I don't know if/how you'd obtain them from the CDN and figure out which one is which there.

[bright ridge]

I'm gonna use this image and write a python script or something to manually chop it up. It's easier to use this over the one I found from FilterBlade since it's even length / width for each column

[worthy cape]

A possible workflow from scratch using my Bun to extract files and and poe-dat-viewer to export tables to JSON:

• bun_extract_file extract-files --regex Contents.ggpk outdir "art/2dart/minimap/player.png"
• Visit https://snosme.github.io/poe-dat-viewer/, put in the current game version as shown below the text field, hit "Import", open data/minimapicons.dat64, hit "Export data" in the table header to get minimapicons.json.
• Correlate them.

It's likely that whatever icons are added next league are going to appear in the image and table in the same manner.

[frank drift]

feel free to use the sheet from FilterBlade of course; Zoey thinks it was originally from a GGG newspost

using the game files is probably preferable though to keep up to date

[bright ridge]

i love code

https://github.com/HiMarioLopez/PoEMinimapIcons

solved my problem! if anyone wants the full set of minimaps based on this sprite sheet you can find them here: https://github.com/HiMarioLopez/PoEMinimapIcons/tree/main/Extracted Icons

[bright ridge]

i was actually able to use this data in another script to dynamically rename all the files they are now updated as well

some small clipping on the fancier icons but can't complain, did 99% of what i needed it to do for the map icons hehe.

[worthy cape]

The game seems to draw 64x64 sections of the texture, fwiw.
A bit surprised that there's any bleeding but at the magnifications you typically have your minimap, it's probably not super noticeable and might be coming from the source data.

[bright ridge]

@worthy cape do you mind explanining how you got the game data files for the full sprite sheet and icon metadata so i can update this when 3.25 launches?

[worthy cape]

The game files (inside the GGPK or loose in the Steam game directory) are compressed in bundle files.
I've got a tool to list or extract them given a game installation, bun_extract_file. Other extraction tools exist as well.
With that you can get that player.png file.

The data tables are also contained in the bundles and are in a custom binary format.
Tooling like poe-dat-viewer and PyPoE/RePoE can given a user-defined schema map the rows to fields and export them to JSON tables like the one I linked.

The schema may change over time, which needs us tooldevs to figure it out but for these it's likely quite stable.

[bright ridge]

oh man ty so much for the explanation.

[worthy cape]

This data won't be available until the launch patch, the one that comes ~3h before the league starts.
The torrents typically omit all or almost all of the data tables, and often times many other files by collateral damage.

[bright ridge]

regarding filter imports (https://www.pathofexile.com/item-filter/about) does anyone know if it works for filters that are local vs online?

do both filters have to be on the poe account, or both filters be a local file, or what are the limitations here?

[compact isle]

it can only import files on disk

[compact isle]

just one more day 👀

[daring moss]

When was it we could expect the atlas passive export to happen again? Was it around the same time patchnotes come out or much later?

[velvet fog]

soontm

[frozen wagon]

Anyone know if there are docs for poecdn.com ? I noticed poe.ninja uses it for client-side asset loading and it's super fast obviously.

[worthy cape]

In general, you find links in the wild from places like trade or articles, which contain the relevant base64 JSON and opaque hashes needed to acquire the file.

It's designed so that you can't generally synthesise URLs from known or guessed facts like asset paths.

[frozen wagon]

😭

[civic crane]

ok im removing all code for bulk trade 😄

[bright ridge]

[compact isle]

bulk trade still required for some items, like those with item levels

[worthy cape]

website fire in 3.. 2..

[carmine merlin]

PoE 2 website is down

haha

How long until the new skill tree?

[hazy fiber]

after patch notes?

[compact isle]

in theory today, I haven't received the go-ahead yet

[compact wigeon]

And with the new skill tree we'll get the atlas at the same time, right??

[compact isle]

hmm let me find out

my PC is on stream o.o

[compact wigeon]

oh deer

[bright ridge]

we c u

[formal kraken]

@compact isle wave for us 👋

[civic crane]

caught

[compact isle]

yeah atlas tree should be at the same time

[compact wigeon]

Excellent, time to refresh my memory on how I process the atlas tree for PoP

[bright ridge]

patch notes are after Q&A right?

[crude bane]

Very nice wave, I completely missed what they were talking about

[compact wigeon]

I missed the wave, sad.

[worthy cape]

Was noted as such in the schedule slide.

[fickle yew]

Will items on the currency exchange still be visible in the river / trade site?

[compact isle]

nope

[bright ridge]

oh that's huge

[fickle yew]

Ouch.

[civic crane]

i hope there will be anough people to use classic trade to infer exchange rate lol

[hazy fiber]

just need to sit there with a character and update it live yourself 😆

[compact isle]

we'll likely explore how to expose the information, but it won't be bulk

oh no... sorry in advance

[worthy cape]

[fickle yew]

Still id Raider?

[hazy fiber]

this should be fine for PoB

[compact isle]

yeep

[carmine merlin]

Ahh just the display text is changed

[compact isle]

ascendancyName will still be Raider too

yeah... poorly named cruft

[fickle yew]

Ah, so I guess only display changes on all community tools.. If Raider -> Warden.

[compact isle]

I also removed wildwood ascendacies from the export

mostly to reduce Warden confusion

[carmine merlin]

Ahh we just disabled them from the tree in PoB

[hazy fiber]

we cant even remove that code, if he removed them from the export, becouse of the jewel socket issue

Ill just update the comment on it I guess

[carmine merlin]

Rare Rory wave

[compact isle]

https://github.com/grindinggear/skilltree-export/releases/tag/3.25.0

will wait til after the Q&A to do atlas tree

[compact wigeon]

[hazy fiber]

is speed intended? (not attack and cast speed?)

[carmine merlin]

Also can we have the new Oil image?

[thick breach]

?

[worthy cape]

We're not game support, see the issue over in #ggg-tracker about it.

[compact wigeon]

It's known and they're working on it though

[carmine merlin]

Thanks!

[compact isle]

yep seems intentional

[compact wigeon]

https://pathofpathing.com/?v=3.25.0-pre#AAAABgMAAgEA1K_UrwAA initial tree now available with cool pathfinding

Now gimme atlas

[gilded tree]

Awr

[carmine merlin]

@compact isle This node is missing stats

[compact wigeon]

Was literally about to mention that

[carmine merlin]

haha

was just checking to see if any other nodes had the same issue

[compact wigeon]

tool devs frothing at the mouth

[worthy cape]

Flex anoint.

[bright ridge]

Voices at home

[formal kraken]

when you cant decide what to annoint, use that node

[compact isle]

hmm let me chase that up

[rain pasture]

do we have any information on the value of Prismatic Oil?

[carmine merlin]

Also does the new triple Prismatic Keystone use a blighted keystone frame or just the normal one?

[rain pasture]

I guess I'll just try it with 3^13 😄

[compact isle]

https://github.com/grindinggear/atlastree-export/releases/tag/3.25.0

[compact wigeon]

King

[compact isle]

just regular as far as I know

[rain pasture]

do we have a drop level for Prismatic Oil?

[hazy fiber]

this isnt the place to ask that

[rain pasture]

I'm displaying the drop levels for oils in my tool

[compact isle]

that isn't the sort of information we provide

[hazy fiber]

^

that kind of info is always gathered by the community

[compact isle]

just waiting for this to finish building z.z

[hazy fiber]

this isnt the place to ask that
yet***

[compact wigeon]

https://pathofpathing.com/?v=3.25.0-pre-atlas#AAAABgAAAgEAcXVxdQAA atlas tree, woo.

[rain pasture]

understood

[primal schooner]

did GGG say anything about exposing an endpoint for marketplace data ? anybody got that inside scoop

[worthy cape]

#tooldev-general message

"yes, but also no"

[primal schooner]

ew

what's he mean 'it won't be bulk' ?

context is light

[worthy cape]

In that currency market trades won't be on the trade site, in the bulk section.

[primal schooner]

oh

enh not a fan of that

[worthy cape]

Listing in the CM seems to be a separate place.

[rain pasture]

well that was a painless update. just need to wait for patch notes for some additional data. ❤️ to GGG for making the data available early!

[compact isle]

by it won't be bulk I mean, we won't provide each individual order or anything like that. Any data will be aggregated history

[worthy cape]

ah

[primal schooner]

oh so we won't have access to all transactions, it'll be a modified endpoint of data

[compact isle]

github updated

[carmine merlin]

Thanks

[hazy fiber]

this node does not do what it says it does (or what the nodes around it with the same name do)

wrong name or missing stat?

[compact isle]

appears to be missing stat, passed along

[primal schooner]

are all teh crys / banners worded correctly on the patch notes? some say 'nearby allied players' and some say 'nearby allies' just wondering if we know if those changes were intended?

[hazy fiber]

the only one which says nearby allied players is enduring cry, which is obviously not meant to affect minions

[compact isle]

fixed in https://github.com/grindinggear/skilltree-export now

[hazy fiber]

ty

[lunar crypt]

Sorry for the question and I understand if you don’t want to disclose too much, but will there be an order book? Will it be publicly visible? Any metrics like liquidity?

[hazy fiber]

^ @lunar crypt

[lunar crypt]

Yeah that doesn’t answer any of that

I guess the “historical” does

Rip my dreams of Vaal street bets

[hazy fiber]

sounds like just history, so

order book
sorta
publicly visible
yes
Any metrics like liquidity
only if you calculate it yourself

[lunar crypt]

Kinda sucks for high amount trading

You wouldn’t be able to realistically sell a lot of something without tanking the price

I had dreams of arbitrage, otc trading, market making

[gilded tree]

arbitrage trading was always possible(?)

[lunar crypt]

Yeah but it’s jank

I guess what I’m saying is I wish we get a real exchange implementation since it’s a player driven economy, it would be interesting to let it play

Only other game like this is eve but there botting is the norm

[worthy cape]

I've noted this elsewhere, but I hope that the market serves actual game players and not economy enthusiasts. It seems like the least horrible implementation I've seen thus far which is good.

While it's assumedly fun to play with such things, I'd rather not have it in my games 😛

[lunar crypt]

While I agree, economy enthusiasts are players

[worthy cape]

Emphasis on the "game", there.

[lunar crypt]

That I fully agree with

But I do think poe is unique in that sense

You could absolutely “play the “”game””” like that

[waxen musk]

azmery ascendancy nodes in skilltree-export are no longer identified as such?

i guess theyre just gone now

[worthy cape]

The secondary ascendancies are removed to reduce confusion with the new Warden: #tooldev-general message

[waxen musk]

the nodes are still there i think?

            "skill": 2275,
            "name": "Nature's Concoction",
            "icon": "Art/2DArt/SkillIcons/passives/TinctureFlaskNotable1.png",
            "isNotable": true,
            "recipe": [
                "TealOil",
                "TealOil",
                "IndigoOil"
            ],
            "stats": [
                "Flasks adjacent to applied Tincture gain 2 charges when\nyou Hit an Enemy with a Weapon, no more than once every second"
            ],
            "group": 482,
            "orbit": 2,
            "orbitIndex": 8,
            "out": [
                "44330"
            ],
            "in": [
                "53809",
                "62721"
            ]
        },

[worthy cape]

That one seems to be in a regular wheel now, even anointable:

Several of those were probably cannibalized from the descendancies.

[hoary storm]

how do i get the beta version of pob?

[worthy cape]

There is no release yet. Running a development version has risks of your builds being incompatible if they are made with functionality that turns out to need to be backed out, or such.

[hoary storm]

i found the beta option in settings so nvm

[worthy cape]

There's also the "beta", which is an opt-in function in release PoB, which sometimes gets newer functionality as it's made periodically. Not sure where that's at at the moment, it can sometimes be a bit behind.

[oak estuary]

It releases weekly from the dev branch. I try to push it more often during the hectic week leading up to league start, but it doesn't always get done

Right now it has the tree update as the main thing

[twilit field]

is there any guide showing how to datamine poe?

[velvet fog]

https://poedb.tw/us/GGPK

[worthy cape]

It depends on what kind of things you're after, there's a lot of formats and types of data inside.

[hazy fiber]

@compact isle node 12095 is connected to 51976 instead of 58214 causing incorrect pathing

https://private-user-images.githubusercontent.com/176108374/350667042-78060da3-40a8-4590-ac0b-a268be16f7d6.PNG?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE0NTUwMDMsIm5iZiI6MTcyMTQ1NDcwMywicGF0aCI6Ii8xNzYxMDgzNzQvMzUwNjY3MDQyLTc4MDYwZGEzLTQwYTgtNDU5MC1hYzBiLWEyNjhiZTE2ZjdkNi5QTkc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjQwNzIwJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI0MDcyMFQwNTUxNDNaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT03NDEwNjJlODUxZTE1YzBiMWM4MTE1ZDA0Y2E1ZDdmNDZiYjQ0MDAwYjY5YzkzZTFlYWVhY2ZiYzQ0NjNlZGIyJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCZhY3Rvcl9pZD0wJmtleV9pZD0wJnJlcG9faWQ9MCJ9.djZdVHvXt_U5m99QQ9PKAJ3cQmd2JBsaV7LMno4rT-o

[compact wigeon]

Can confirm

You'll be pleased to know that it's the only node on the tree that is not a notable, keystone, mastery, proxy, ascendancy, or jewel socket that has only one neighbour, with exceptions for the three branches by scion start.

[tranquil pagoda]

Is the beta opt-in working as it should on the flatpak version of PoB? Or am I just missing how to get it to update?

[worthy cape]

It depends on how the flatpak package is made, I've only heard about it and have no idea about the tech involved.
It is likely to only work for Windows releases of PoB, anything built around pobfrontend is quite likely to not have implemented it correctly.

[tranquil pagoda]

That's a shame, guess I'll wait for the release then - thanks!

[worthy cape]

I looked into the manifest at https://github.com/flathub/community.pathofbuilding.PathOfBuilding, it seems to be built in pretty much the same way as path-of-building-community-git from the Arch Linux AUR with the pobfrontend runtime, but based off the last release instead of devmode.
With their kind of package, it cannot self-update itself. The beta mechanism is built around self-updates as well so it's out of the question for this third party flatpak packaging.

[velvet fog]

Since there is an automatic trading currency function in 3.25, will the ratio API be provided in this way, because poe.ninja will not be the most correct one?

[pallid wraith]

See
#tooldev-general message
And
#tooldev-general message

[crude bane]

Anyone want to rate, or make educated guesses, how my average time spent per request to the psapi stream will keep up?

I fear I cannot push it any further with my python knowledge. I have no clue if it will keep up during early league. Currently a mini batch consists of 30 requests. Data was processed by a different thread while requests were still being made. Data was gathered over ~2hrs.

[trail cradle]

what's PSAPI?

[tranquil pagoda]

https://learn.microsoft.com/en-us/windows/win32/psapi/process-status-helper if I had to guess
Terrible guess

[formal kraken]

public stash api

[crude bane]

I assumed any one who would be able to answer would be familiar 😁

[hexed mesa]

isnt rate limit like 2 requests a second anyway?

realistically speaking the requests will be much larger than they are right now too, so unlikely its representative of anything

[crude bane]

I am using a quite old next change id , don't know much is left in those tabs. But as mentioned, all data processing happens in another thread, so the impact shouldn't be that big.

[pearl sierra]

Hard to make guesses without seeing the code, but asynchronous requests may speed it up considerably. That said, peak players during league launch was around 20 times more. It might make sense to assume a linear correlation. (But then again, more people may use the service, I don't know) As you said requests and processing were in different threads, it should be less than 30 seconds per request.

[crude bane]

Currently yes, but it is dynamic. I hit the rate limit six times during testing (but was never actually rate limited)

[pearl sierra]

The ideal way would be to have one thread make request asynchronously and queue them while another x threads listen to the queue to process them.

[crude bane]

I do use an asynchronous request library as it's the best way I could find to not wait to receive the body before reading the headers. But it's impossible to do a new request before reading the headers.

[pearl sierra]

Reading the docs now, 1 sec 🙂

[crude bane]

I am currently doing this sort of. But instead of passing the body between two requests I instead pass the next change id between them. Both threads send five requests each before spending some time reading the bodies of the requests. Unfortunately the library I use does not allow for passing the body to another thread (to the best of my knowledge)

[pearl sierra]

From the way the api is set up and the way you described your algorithm, it shouldn't really increase as the bottleneck appears to be the poe api rather than your code.

[pearl sierra]

Don't really use python anymore but I remember some multiprocessing libraries that could call a method with given parametre on a new cpu thread.

Still, if the cpu usage isn't high on the core your program is working, it isn't the bottleneck. If it is, making a thread pool and sharing the load should help significantly.

[crude bane]

Correct, the usual way I have been passing data between threads didn't allow for passing the request body, but I suppose I should look into more ways of passing data between threads.

[pearl sierra]

https://docs.python.org/3/library/concurrent.futures.html

This is appearently the current thread pool implementation. It is different from the one I used so I can't really help with it.

[crude bane]

I have made the it easy to scale threads, but I am also trying to keep resource use low.

[pearl sierra]

Multithreading will increase the cpu usage, so keep that in mind.

There is some overhead in creating threads and passing data. Also with more threads you will see more idle time and higher peak usage.

I don't really work with cloud, but if you use it, these are worth considering.

[crude bane]

I'll look into this once I have the chance, thank you.

[pearl sierra]

Glad to help 🙂

[crude bane]

The plan is to use a much worse virtual machine, where I have dedicated but less resources.

[primal schooner]

are the bandits on poeplanner.com not updated for anyone else? I thought I saw they were... maybe i'm using the wrong (direct site) version of the planner?

[oak estuary]

Looks like they're not updated, yeah. There's a contact link on that site to let them know

[frank drift]

they are on here (or were) but I forget the name

[meager quail]

Hi! I'm using gems.json from RePoE, is there data available for where each of these gems can be first acquired, for each class? Either quest name or vendor name that sells it. I'm seeing a tool that has this data in the JSON, but I'm not sure if they hard-coded this data manually, or pulled it from somewhere.

[zenith zodiac]

repoe can't produce that data automatically as it is not in the game files. There is usually up-to-date data at https://poegems.com/json

[oak estuary]

Quest rewards are in the game files again actually, iirc. I believe it's in questrewards.dat64

[zenith zodiac]

oh nice

[compact isle]

pushed the fix for this out now

[hazy fiber]

ty

[oak estuary]

Literally just merged the PR that fixes this manually in PoB 😄

[compact isle]

👏 it will likely be the same fix

[hazy fiber]

tree node 59976 uses ’ instead of ' in "10% chance to Block Attack Damage if you’ve used a Retaliation Skill Recently" (count 2), which is different to every other case of you've (count 117)

[dapper wigeon]

is there an updated analog of Emmitt's https://poeskilltree.com/ ? For skill tree versions comparing purposes

[zenith zodiac]

wait quest rewards are already in gems.json, it's the vendor rewards l can't add. @meager quail are you looking at the old repoe? there's a fork at https://lvlvllvlvllvlvl.github.io/RePoE/

[compact wigeon]

I don't know of any that have skill tree comparisons, no.

[compact wigeon]

I did fork PoP from it but I've disabled the comparison features, I wonder how much work it'd be to get it working in PoP.. I have made some changes.

[meager quail]

Oh good catch. But it seems like the RePoE json only has rewards, not info about what class can buy the gem after the quest is done? For example Ice Shot is given as a reward to Ranger, but Duelist/Scion can buy it. Anyway I already integrated the poegems JSON which seems to have what I need.

[worthy cape]

The purchase part is "vendor rewards", while the "pick one" is "quest rewards".

[oak estuary]

I don't think vendor rewards have ever been in the game data, at least not for a long time

[cobalt wolf]

i'm trying to query data about weapons.
https://www.poewiki.net/w/api.php?action=cargoquery&tables=weapons&format=json&fields=attack_speed
i'm getting attack speed here, but i need name of the item too.

i suspect that i'm supposed to join on the items table, but i don't know which field can be used to join them

[hexed mesa]

https://www.poewiki.net/wiki/Path_of_Exile_Wiki:Data_query_API

[cobalt wolf]

yes i've seen this page, maybe you could point to the part that helps me with finding a solution to my question?

[frank drift]

you can sometimes look at the wiki source to find out what table names are being used, what joins are being done, etc

[cobalt wolf]

i've spend the past hours trying to do that 🙂
which is what led me to ask here

[frank drift]

as an alternative, you could consider using the game data directly through RePoE etc

[cobalt wolf]

sounds interesting, where can i find more information about this?

[frank drift]

https://lvlvllvlvllvlvl.github.io/RePoE/ is the output, or some of it

https://github.com/lvlvllvlvllvlvl/RePoE/

[hexed mesa]

well, given the example of joins https://www.poewiki.net/w/api.php?action=cargoquery&tables=items,skill_levels&join_on=items._pageID=skill_levels._pageID&fields=items.name,skill_levels.level,skill_levels.experience&where=items.name=%22Blood%20Rage%22&order_by=skill_levels.level&limit=5, looks like we join on _pageID, whatever that is, seems to work tho https://www.poewiki.net/w/api.php?action=cargoquery&tables=weapons,items&join_on=items._pageID=weapons._pageID&format=json&fields=attack_speed,items.name

[cobalt wolf]

thank you, think i will probably use this instead.
the cargoquery feels like a nightmare to work with.
How frequently is the data updated here?

[hexed mesa]

pretty much whenever there is an update

at least ever since lvlvl took over repoe

[cobalt wolf]

is pob using this aswell?

[frank drift]

one of the PoB people could tell you for sure, they might have their own fork

most of the projects tend to collaborate on tooling though

[oak estuary]

PoB doesn't use RePoE, we have our own scripts, but we both base them off of the game files

[frank drift]

the wiki / cargo API is most useful for things that aren't in game data

[carmine merlin]

@cobalt wolf all the bases PoB uses are here https://github.com/PathOfBuildingCommunity/PathOfBuilding/tree/dev/src/Data/Bases
format if each item looks like this

itemBases["Short Bow"] = {
    type = "Bow",
    socketLimit = 6,
    tags = { two_hand_weapon = true, ranged = true, weapon = true, default = true, twohand = true, bow = true, },
    influenceTags = { shaper = "bow_shaper", elder = "bow_elder", adjudicator = "bow_adjudicator", basilisk = "bow_basilisk", crusader = "bow_crusader", eyrie = "bow_eyrie", cleansing = "bow_cleansing", tangle = "bow_tangle" },
    implicitModTypes = { },
    weapon = { PhysicalMin = 6, PhysicalMax = 16, CritChanceBase = 5, AttackRateBase = 1.5, Range = 120, },
    req = { level = 5, dex = 26, },
}```

[cobalt wolf]

yes, i actually used this is my last iteration of my project.
Ended up writing a simplified lua parser to extract the data and then convert it into json.
then i fed my json file to the remaining part of the program.

Figured that for my next attempt i wanted to see if i could find a simpler approach.

if there wasn't an existing json file out there with the data from PoB then i would probably asked the PoB guys if they could share their data as json files

[daring moss]

Why didn't you use a json library in Lua to "directly" convert the objects instead of parsing?

[primal schooner]

are we gonna get the data for the new bench crafts, etc before ggpk on launch day?

[bright ridge]

wtb access to this exchange ratio api

[oak estuary]

Nonono, we want the opposite of p2w mechanics!

[bright ridge]

i wonder if GGG devs would ever charge for API access. it'd be kind of like private league funding. big community tools could probably still be sustained by their supporters

[hazy fiber]

tbh PoB doesnt even do that to convert json to lua, we just to string replacment, you could maybe just do the reverse

https://github.com/PathOfBuildingCommunity/PathOfBuilding/blob/dev/src/Modules/Common.lua#L328-L331

[oak estuary]

We just do that for the tree, other files might not even convert to json, like the skills with their custom functions. In general yeah use the reverse of that

[green rose]

WTB as well. Would solve all issues of having to consume the river api

[bright ridge]

Have we gotten any confirmation on if gold will be account or character bound?

[frozen pulsar]

no

[formal kraken]

Mutable api access please, so that we can have real life trading bots

[primal schooner]

in POB, is there any way to link a tree-set with an item-set with a skill-set, so when you change any of the 3, it sets the other 2 to the respective linked sets?

[primal schooner]

Novynn said we'll have an API end-point for Currency Marketplace data. it will be read-only and it will only consist of aggregated data.

[carmine merlin]

read the help text for the feature. Tells you how to format it

[oak estuary]

Just use the loadout dropdown, yeah

[primal schooner]

ok thnx

tbh i put that in the wrong channel

[oak estuary]

If your set doesn't appear there, add a link for the config set too

[primal schooner]

but thanks for answering

what's the 4th set ?

oh config

k

[primal schooner]

I renamed and recolored all of my sets, and only have 1 config set named 'Default' and sync'ing doesn't render any loadouts. something I missed?

[carmine merlin]

I'm not sure unfortunately

[past moss]

anyone else getting stuck on this on POB ?

[oak estuary]

Close any other open POB

[past moss]

already done this three times : D

[oak estuary]

Check in Task Manager and see if one is hiding there

[oak estuary]

Paste a build code for me and I'll look

[formal kraken]

checked with task manager?

[past moss]

i click the below update button as usual it used to always work and now it brings this screen i click the second update button but gets stuck on UpdateApply.lua

[past moss]

ok this worked. found and closed it via task manager, but never seen this lua page before

[primal schooner]

like an export of my build? or some other code export?

[oak estuary]

Yeah, build export via the Import Tab

[primal schooner]

pm'd

[oak estuary]

That update popup will be blank if you already had an updated manifest.xml, which seems to be the case here

[primal schooner]

we're you using hte dev update before the 3.25 release update? I got the same blank screen when i updated the normal POB

[past moss]

no i did the normal update. i did not tick it until now.

[primal schooner]

oh, well either way, it was just a blank update screen because the XML had already been loaded, like Wire said. shouldn't cause any issues.

[primal schooner]

I PM'd it to you

[primal schooner]

weird. i tried syncing, restarting, etc. nothing created the premade loadout I had pre-created. so I just created a new loadout set from scratch from the 'create new loadout' option for another leveling build, and it created the previous loadout set as well..

[oak estuary]

I haven't had a chance to try it yet on your build, but yeah that sounds strange, sync should've done it for sure

[primal schooner]

🤷

[primal schooner]

can you manage loadouts ? (rename, delete, move, etc?)

[oak estuary]

Not yet, they're all based on the tree set's name right now

[primal schooner]

kk thnx

[green rose]

Oh wow, do you have a link to the source? This is amazing news

[frank drift]

ctrl + f Novynn

[bright ridge]

#tooldev-general message

it was very much like - "Soon ™️ " vibes not something this league it seems. if i had to guess

[green rose]

Awesome, yea I saw the discussion

[primal schooner]

I didn't get that sense

[green rose]

Whenever it is i can gladly wait

[compact isle]

no plans for it yet it's just something we might be able to do

updated the skilltree export and now it has ruthless data side-by-side instead of in a separate branch:
https://github.com/grindinggear/skilltree-export/releases/tag/3.25.0

[primal schooner]

so, there's no plans on giving any 3rd party access to CM data this league?

[compact isle]

not at this stage, no

[primal schooner]

how are all the apps going to operate?

[compact isle]

I assume the same as they always have

[primal schooner]

well, they used tade data from the stream

to give realtime evals

if there's no more currency data in the stream because CM isn't included

poe.ninja, Awakened, etc won't have currency data

save ppl using old method

or manually updating the currency ratios

i think at a minimum the endpoint should be created and expose the ratios you guys are providing to the clients. that isn't a huge amt of work, and will at least give the app guys what they need to continue to operate LARGE portions of their systems

[bright ridge]

brother chill

let the man focus on a good league start

i'd rather a stable first-part experience

3rd part tooling always comes second, it needs to

[primal schooner]

I mean i guess, but there's a LARGE portion of the playerbase that relies on AwakenedPOE, and other apps, for currency pricing, etc

[wise ether]

The trade website will still supports the bulk exchange that it currently does. Nothing has changed for those players.

[oak estuary]

There's an even larger portion that cares about the video game being good

[bright ridge]

Exactly - he already told you he'll look into it

i think at a minimum the endpoint should be created and expose the ratios you guys are providing to the clients. that isn't a huge amt of work

This is a slap in the face lmfao. Want to see something wild?

https://www.pathofexile.com/forum/view-thread/527675

We used to have to do all trades through the forum

The players will find a way to play the game, man.

[primal schooner]

numbering them w/ the { } works instantly in all scenarios.

[worthy cape]

The league start is going to be a nice chill information void without both early poedb and market internals.

[oak estuary]

@compact isle FYI Multishot mastery is connected to the small node in addition to the notable

[primal schooner]

anybody got a non-pathofexile.com link to the new gems ?

[worthy cape]

Not much of interest in this patch it seems: https://pale-court.github.io/dat-scope/index.html?from=15083440&to=15109161

[faint spade]

According to the patch notes, item.extended.category is being removed. Does that change go live on 3.25 release? I still see it in current API data.
Also, whyyyyy. I found that to be the most helpful piece of data in the entire API 😦

[compact isle]

on release, yes. As for why, it matched absolutely nothing else (it was supposed to match the trade site categories, but never did)

[faint spade]

Fair enough, and thanks for the response! glhf

[zenith zodiac]

looks like the small nodes next to rallying icon are named 'banner area of effect' but grant 'banner aura effect'

[compact isle]

good catch, passed this along

[empty nexus]

hey guys, is there any way to get a list of all known items? any resources publicly available?

[hexed mesa]

define item

[compact wigeon]

What is the usecase? What are you trying to accomplish?

There are various people who have done datamining with the data publically accessible, but the formats vary depending on the intended use.

[empty nexus]

i want to get a list of all the uniques, gems, currencies, div cards and weapon bases, for.... reasons 😈

thx for the response btw 😄

[worthy cape]

Uniques are generally the odd one out, as pretty much everything else are base types.
Uniques are hand-assembled from trade or finds in the common sites, using collection tables to tell which ones there are and what item visual they have.

RePoE may have some of the basic information for them, the wiki is quite well populated, and poedb has most if not all but has no data access interface.

[empty nexus]

ty!

[worthy cape]

If eyeing the wiki, there's some sort of API that's way less impact than dumping or scraping.

[formal kraken]

All of that list should be in the game files accessible through RePoE or some other tools

[worthy cape]

See the uniques* files in RePoE.

Those of course only include the game data aspects of it, not the modifiers as those aren't associated in the client.

[oak estuary]

There's also the official pages for some items. Weapons, for example: https://www.pathofexile.com/item-data/weapon

[empty nexus]

wanna avoid scraping if possible lol but thanks

[primal schooner]

is there a tool/overlay that has all the checkpoints you need to hit for the campaign, and actively updates them via the log.txt (w/e it's called) using zone/encounter emotes? (sort of like questie for wow) ?

[carmine merlin]

I think Lailloken UI does it https://www.reddit.com/r/pathofexile/comments/1ea8q6u/showcasing_some_325_and_leaguestart_qol_features/

[primal schooner]

oh it needs AHK ... 😕

[woeful cloak]

Heya folks. Complete neophyte here, but seeking to learn how to do datamining of monster stats.

Specifically, how to get the appropriate statlines for spectre stats for minions. I was directed here 🙂

[woeful cloak]

Effectively: I need to figure out how to data mine and interpret the corpses from affliction. With PoEDB gone, and it being build defining for many summoner builds; having accurate information is super key.

[gilded tree]

"Removed category and subcategories from Item→extended."
eh. That's ... bad.

[crude bane]

Is it normal to have this many (or any I should say) changes to the stash api? With both the category issue and the whole bulk currency not being available. Its my first league as a tool developer

[frank drift]

there is no normal

[crude bane]

I am really hoping the poe ninja currency prices will be somewhat accurate. Its a very integral part of my app

[worthy cape]

Novynn motivated it earlier, did you have a good use case? #tooldev-general message

[worthy cape]

It's normally very dull unless the changes happen to expand the API. Don't remember if we ever called functionality.

[gilded tree]

I am using it to match categories e.g. Weapons, Armour etc. That means you directly know if a new item called xx is a weapon for example.
Without that piece of information it's unclear which category an item belongs to. Years ago there was the name inside the icon url, then the category and now there's no way anymore. Is it possible to keep it?

The categories always made sense so I feel like they are good how they are.

[neon plume]

Torrent usually drops 24h before the launch, right?

[frank drift]

roughly yeah

rarely anything interesting in it of course

[neon plume]

very interesting to me though

(for timeless jewel calc)

especially when they update the tree

[crude bane]

Personally I used it to easily categorize items as they were coming in the stream. But should'nt be too hard to just compare basetype with a separate list. The main annoying part is having to deal with a changing API when I am stressed about getting everything else to work.

[gilded tree]

agree with the last part, would be great to have it listed as deprecated but fixing that part in 2 days is just ... a bit too much. With that we would have a bit of time to adjust. Would that be possible? @compact isle But still, I actually like the categories. Easy to categorise items.

[compact isle]

hmmm it might be possible to resurrect for a league

[compact isle]

another day another passive tree export:
https://github.com/grindinggear/skilltree-export/commit/8f200d4c8f97864801f31c21b78c2fd3afb03298

[carmine merlin]

Another banner node fixed to not be scaled by aura effect 😆

[compact isle]

these are just description fixes 😄

[compact isle]

@crude bane @gilded tree updated to just be deprecated

[dapper wigeon]

Looks like Fungal Ground description differs in skill tree json and the patch notes
"Fungal Ground now causes Allies on your Fungal Ground to have +25% Chaos Resistance, while Enemies on your Fungal Ground have -10% Chaos Resistance (previously Allies gained 10% of Non-Chaos Damage as extra Chaos Damage, while Enemies on your Fungal Ground dealt 10% less Damage)."
vs
Allies on your Fungal Ground have +25% to Chaos Resistance. Enemies on your Fungal Ground have -10% to all Resistances in the json

[dapper wigeon]

the patch note have been just updated, so it's -10% to all Resistances

[gilded tree]

Appreciate it! 🤝

Will adjust till next league.

[peak forum]

I downloaded LibGLPK but there is no executable in the folder, do I have to open it using vscode?

[faint remnant]

CSV download is so beautiful now

actually machine processable

[worthy cape]

If downloading from GitHub, make sure to go to Releases and not download the source tree, unless you want to develop on/with it.
It would build with proper Visual Studio then.

Not super familiar with the competition 😉

[peak forum]

ok, it worked, I'm feeling dumb now

xD

tnks so much ❤️

[haughty steppe]

Kinda weirdge how PoB now has a weird feature

[worthy cape]

The overall message has been seen and its a focus. No need to crusade.

[eager rivet]

Hey, haven't done datamining before does torrent usually include new spectre information or do I need to wait for patch?

[worthy cape]

Everything from the data tables is missing from the torrents by tradition. All their skills are in there.
While there may be the odd AI script or other data file, a lot of small files are missing as collateral damage.

[violet hearth]

I agree with Big Ducks. PoB shouldn't be showing a list of builds that can be boosted by paying money. https://www.youtube.com/watch?v=zSEyHGtrWmo

[loud flint]

I haven't been paying attention in here - but what's the deal with Auction House and API availability? Are we shit out of luck?

[frank drift]

this isn't the place for that

[worthy cape]

No news since last mention, see history around reveal from Novynn and onward.

In short, assume no individual order access, more like aggregate historical trends.

[violet hearth]

This channel is for tool development discussion.

[worthy cape]

Kindly don't, I expect better from you.

[loud flint]

Aggregated per category or per item? Eg. would I be able to see aggregated pricing for the last x timeframe for a specific card/essence/whatever?

Or not known yet

Trying to search backwards while chatting, so sorry if I ask questions asked several times before

[worthy cape]

I don't recall, but feels like it'd might be a soup of ratios much like what you see suggested in the client.

[frank drift]

I don't think it's even been designed yet

[worthy cape]

Depends on what they pull out of their hat.

[loud flint]

Let's see. Hoping for something, but functioning League > functioning 3rd party support always

[worthy cape]

Probably a good idea to go into the league assuming nothing is available from the get go.

[loud flint]

Yeah for sure

[worthy cape]

I'd dig up the messages but I'm without a computer for at least another day now.
Someone sold my computer chair and table 😉

[loud flint]

Huh

No worries, I'll look back in the history

[peak forum]

How long before league does ggpk update?

[frank drift]

torrent soon™️, patch something like ~3 hours before

[worthy cape]

Typically 3h, I believe.

With queues opening up as the maintenance concludes at around 2h prior.

Longer maint if Fun Times occur. Shorter to keep you on your toes.
For us it's the patch that matters anyway.

dat-scope will pull and process the patch automatically when it lands to get an idea of changes in DAT64 shapes.

[peak forum]

🙏 tnks

[peak forum]

@worthy cape From what I understand to use RePoe, I need to use PyPoe

Is this right?

[peak forum]

I think I'm doing something wrong, but when I try to start the user interface this happens

[zenith zodiac]

repoe has pypoe as a relative dependency https://github.com/lvlvllvlvllvlvl/RePoE/blob/master/pyproject.toml#L19 - check the pypoe repo out into the same parent directory that you cloned repoe into

in general it shouldn't be necessary to run repoe - all of its outputs are available in json format. what is your goal?

[peak forum]

I'm venturing into data mining, trying to learn how to do it

For some reason my PyPoe doesn't work, I've tried everything to open it and it won't work.

When I try to open it, it opens for 1 second and then closes

If I open it through vs code it shows that module error

[cursive musk]

ui is broke right now if you're trying to use that

[peak forum]

and how can I convert a .dat64 to json?

[cursive musk]

repoe? i think

I can't figure out how to get dat from the ggpk yet

[zenith zodiac]

best way to explore the dat files is https://snosme.github.io/poe-dat-viewer/

[peak forum]

I already discovered that

[peak forum]

what is the difference between it and RePoe?

[zenith zodiac]

it shows the data files directly, falling back to binary data for columns with unknown data types. on league start the schemas will need to be updated for any new files or changed columns. dat-viewer has ui for updating the schema based on the raw data - if you want to get familiar with that you can click the names of columns in a table then click 'delete' in the panel that pops up to see what they look like in the binary view

repoe uses the same schemas that dat viewer does, it won't be able to process anything until the schemas are updated. its outputs are more processed (each json file might pull data from several tables)

[cursive musk]

did you just use pypoe_exporter dat json to get the datfiles?

[peak forum]

i use the ggpk3

[peak forum]

So basically RePoe is just more "complete"?

[zenith zodiac]

l guess? the dat-viewer is what l use to look at the raw data when l am working on changes pypoe or repoe

[peak forum]

I'll use it for now then, until I can understand how to make RePoe work

xD

Thanks for the tips and explanation, it was a big help 🙏

[cursive musk]

were you getting errors with extracting some files in data/ with ggpk3?

[peak forum]

in this new content.ggpk yes but in the old one no

Apparently some bundles.bin are missing

[cursive musk]

yeah I saw error message with Bundle2/something

[peak forum]

look at the difference, the one on the right is the old one and the one on the left is the new one

[cursive musk]

hmm yeah

[carmine merlin]

GGG always remove the important data from the torrent GGPK

[peak forum]

😭

[carmine merlin]

Will need to wait until the patching server goes up in 11.5 hours for you to start grabbing the data

[cursive musk]

at least I found some cool new art 🙂

[hazy fog]

real question is how will we survive without poedb

chuan on vacation

[grave wren]

become the new chuan

[rich kettle]

I just wanted to share a tool I made that grabs some data from poeninja and based on that calculates what gem should be the most profitable to transfigure. Now, I've spent a few hours to convert this tool into a very janky website that anybody can use. https://poegem.smallapp.cc/ (right now it uses 3.24, ill update it when 3.25 releases hoping it will still work)

Does anybody have some input for me?

I won't promise this site will stay up, or even survive until league start, so here is the github repo if you want to run it locally or improve the currently very spaghetti and suboptimal codebase.

[faint remnant]

The only thing I can think of: Cite your sources. As a user I'd like to see a detailed info on how this is calculated.
If there was a catergory with only a handful of VERY valuable gems and a ton of not so valuable gems and another category with many valuable gems but only slightly less average value, I'd take the 2nd catergory

Even if it is just a breakdown of the value of the top/middle/bottom 33% of gems in a category.

[peak forum]

I really liked your idea, good job bro

[rich kettle]

Good idea! This is actually already implemented into the calculation, I just haven't added it to the front end ¯_(ツ)_/¯

[topaz mica]

why is the EV on blue 20/23 higher than 21/23? is it due to significantly lower volume?

im not sure my guess even makes sense though

[rich kettle]

late season poeninja weirdness. the low confidence listing has one green one red gem that are incredibly valuable that pulls the average upwards.

it was reasonably accurate the first half of this season

[rich kettle]

i decided to allow people to set their own breakpoint, but the idea is now implemented :D

[faint remnant]

That's similar to what I recommended but as a user I'd still feel that this would be too opaque

It doesn't get rid of the issue that outliers can skew the data to a high average, which would then rely on luck to be pulled.

I also haven't checked the ninja data, maybe overall the distribution of valuable gems is so similar that it doesn't matter

[rich kettle]

Yeah, I might implement this properly at some point. Ive looked into it and it seems like I have to make somewhat bigger changes to the way I currently calculate the value for each gem and I don't feel like doing that rn ¯_(ツ)_/¯

[faint remnant]

Valid. It's not a huge concern. This will surely be very useful for a lot of people

[haughty steppe]

My only concerns are security related but I am gonna wait for the final implementation

[vague aurora]

that topic lemme think about writing a free build index website and put it into pob :-D

[peak forum]

On what dat.64 is the information about the craft bench enchants? @carmine merlin @worthy cape

[primal schooner]

Has GGG solved the issue where if you DL the preload ggpk, swap it in, and then open POE before the new patch servers are up, it de-patches it?

[hexed mesa]

doesnt sound like an issue tbh, sounds like intended thing

[primal schooner]

i get it should checksum for current version, but if it's specifically a later patch for something going live, all that does is waste users time that downloaded the 40g file and put undue stress on their DL servers now that those users need to repatch. just checksum for the newer patch, and don't depatch it...

[rich kettle]

I'd very much like to hear your input so I can resolve them before launch. I'm not planning on working much more on the project after season launch since it does what I wanted it to.

[carmine merlin]

No idea where the new ones are as that data wouldn’t be in the ggpk until patching server goes live in 3 hours. The normal crafting table stuff is in craftingtableoptions.dat. They might make a new dat for kalguurcraftingbenchoptions.dat though

Once the patch goes live. Have a look on https://snosme.github.io/poe-dat-viewer/ and see if there are any new crafting bench dats that look like they could be the one

I won’t be around right at league launch as I’m not at home atm so won’t be able to help much

[peak forum]

No problem, your explanation has already helped me a lot

Thank u 🙏🏻

[primal schooner]

welcome to the minions/spectres data dilemma

[worthy cape]

Largely by design, it has a single target release for players and until downtime it's the current one, not the preload.

The patch server and protocol doesn't know about versions, it works off hierarchical hashes.

I don't think a version is checked until login handshake.

[primal schooner]

Yeah, i mean they could at least inform users to not swap it in until after the servers go up otherwise it'll revet their file and waste all that time they spent DLing it...

[worthy cape]

They constantly do in the torrent posts.

I don't have any links handy, mobile warrior.

[primal schooner]

i don't see any on their post this time around. 🤷

[carmine merlin]

I saw it in the post somewhere

[primal schooner]

ah yes

This torrent only includes the GGPK file, so you’ll need to copy it into your actual install folder once the patching server is up, no earlier than three hours before Path of Exile: Settlers of Kalguur launches. Please note that you can’t use this GGPK file with the Steam client, Epic client and macOS.

[carmine merlin]

I’ve made the mistake before so now keep an extra copy in the ssd until the patch succeeds

[primal schooner]

yeah i did it two leagues in a row so i know the pain

[bright ridge]

Wishing all tool devs a stellar, bug free, and stable league launch.

Thank you for all your hard word, continuing to make some stellar contributions to improve the community's experience and interaction with the game we love so very much. Cheers to us 🍻

P.S. Shoutout to Novynn/Rory for allowing some pretty stellar integrations for us to leverage for our 3rd party tooling. It would quite literally not be possible without you

[frank drift]

ty to you Meatbox for taking up the CRE mantle

[worthy cape]

It begins.

[faint remnant]

This is the datamine process?

[worthy cape]

The automatic release ingestion on my side, which powers the Inya CDN and dat-scope (https://pale-court.github.io/dat-scope/index.html)

[faint remnant]

I understood some of those words.

[worthy cape]

I've got a dedicated server that follows the big firehose of Steam announcements, looking for PoE updates.
It downloads the updates automatically, cracks them up into individual files and stores them in a database.
dat-scope is a tool that compares how the shape of the DAT64 data tables changes between releases, powered by this data.

It's useful for data miners to tell which tables have changed aspects like the row count, the row byte size, and so on. This to know that they need to look into new data or removed data.

[faint remnant]

Ah. I think I stumbled upon that when I took a look at all the tools earlier

https://snosme.github.io/poe-dat-viewer/ is this also automatically fed by the patch?

[worthy cape]

Yes, it obtains bundles (in)directly from the game patch server.

It uses the schema from the shared dat-schema repository, which people contribute table specifications to.

[primal schooner]

standalone patch servers up too (same time as steam vs. console)?

[worthy cape]

It's also the tool that many use to figure out said schemas.

[faint remnant]

So there'll be a bit of back and forth when people use the dat-viewer to figure out the format of the new tables, then they publish those changes to the dat-schema repo and then the dat-viewer can use the updated schema to better visualise the data?

[worthy cape]

Indeed.

The wiki converts the dat-schema into its own representation, PoB has our own DAT schema editor and format, etc.

Jul 26 19:33:40 inya-syn.zao.se poetry[2392673]: [19:33:40] INFO     flushing 210926660 bytes over 338 items, 338 new   store.py:333
Jul 26 19:33:45 inya-syn.zao.se poetry[2392673]: [19:33:45] INFO     flushing 210148787 bytes over 599 items, 599 new   store.py:333
Jul 26 19:33:55 inya-syn.zao.se poetry[2392673]: [19:33:55] INFO     flushing 210227241 bytes over 170 items, 170 new   store.py:333
Jul 26 19:34:12 inya-syn.zao.se poetry[2392673]: [19:34:12] INFO     flushing 209982188 bytes over 219 items, 219 new   store.py:333

I wish this would be faster, feels like I could do better than what, 200 megs every 5-10 seconds.

[faint remnant]

Did you ever attempt to optimise its performance?

[worthy cape]

Sometimes, but it's hard to test in prod and patches tend to be too seldom unless I want to rewind a bit and pretend I'm missing some assets.

It's hard to manipulate when you've got half a terabyte of state.

[primal schooner]

is the Steam patch servers being up synonomous with the standalone client patch servers being ready as well?

[worthy cape]

https://pale-court.github.io/dat-scope/index.html?from=15109161&to=15160630

[primal schooner]

is that response to me or what you were talking about with Lil ?

[worthy cape]

Standalone was available before Steam this time.

[primal schooner]

👍 thnx

[worthy cape]

At the core of it, I've got a whole bunch of loose files on a spinning rust HDD and have to stream+decompress them in, cut into virtual files and jam them into a DB running on the same spinning rust HDD on another VM.

PoE's files are a bit weird in that bundles can contain tons of smol files, or very few large ones.

[faint remnant]

Yeah, no amount of tuning will make a spinning rust hdd a lot faster

[worthy cape]

It's somewhat optimized, but could get much better. It's all in single-threaded Pythong too.

[faint remnant]

Multi threading won't do much if it's mostly I/O bound, I'd guess.

Like... No amount of code changes will do as much as moving all this onto a SSD

[worthy cape]

The most it'd do would be to let me separate the disk load, the decompression+cutting, and the peristence with some sponge queues inbetween.

Kind of sucks to leave disks "idle" while you process.

[faint remnant]

Yeah, depends on how long those processes work compared to the work on the disk though

[worthy cape]

A pipeline with bounded queues would kind of let you move at the pace of the slowest part, even if there's some overhead.

But as it's in Python, not gonna happen soon.

[faint remnant]

is it reasonable to assume we got 162 enchants?

[worthy cape]

Depends on what kinds of things are in the bench, but the row count is definitely the row count.

835-996 involve Runes at least.

[faint remnant]

Ah. The cost_baseitemtypes > 11k are the runes?

[worthy cape]

You can see this in poe-dat-viewer even with the current schema.

(unless I've got a custom one and the upstream one isn't up to date)

[faint remnant]

Ah, I'm trying the online one like this

[worthy cape]

Ah, you can change for each column what aspect of the target row it displays.

The default is the Row ID, but you can do this:

You may have to go for Data Tables in the top right and "Preload Data tables".

[faint remnant]

Ah yeah. I did that earlier and now I can select the foreign table column too

I could really use this as a database. No idea how to quickly figure out stuff from those tables 😄

[worthy cape]

Some peeps have tried to jam it into SQL RDBMSes, mostly works.

The list fields are a bit wonky to work with and there's a lot of circular references.

[civic crane]

Preload only needed to change table

[worthy cape]

Ah, right.

[faint remnant]

Hey, you are the name in the url of that thing I am staring at!

So, why are the values for AddMod in the craftingbenchoptions null for the new enchants? Do GGG ever reference different tables in the same column?

[worthy cape]

There's some new data at the end of the rows, so there may be a new list of something.

Ah, there's an AddEnchantment column in the middle.

[faint remnant]

Ah!

[worthy cape]

This is the "fun" part of data mining, where there's just a soup of bytes you have to find structure and purpose for.

[faint remnant]

But this is it? With the Add Enchantment and the Type limit I can figure out what goes on what base?

[worthy cape]

Likely.

[faint remnant]

Damn.

Fire damage per resist is on two hand axe

That's particular.

I cant extract the json WITH the extracted values from a table, right? If I do export data I get just the referenced IDs?

[peak forum]

Can you see the name of AddEnchantment?

[worthy cape]

I assume it's raw.

[faint remnant]

I can

[worthy cape]

Yep.

[peak forum]

ok i got it

xD

[worthy cape]

Scroll down to the new entries 🙂

Things are usually added at the end, except when they're not.

[loud flint]

waiting for novynn to swoop in and tell us the auction house api is ready

[peak forum]

How can you increase the column size to see the entire mod name?

[worthy cape]

I'd like a pony while at it.

Scroll the header to resize.

Modifier keys to do it faster/slower.

[peak forum]

tnks ❤️

[compact isle]

everytime someone calls it an auction house the API gets delayed another month

[peak forum]

Is there a way to export to json with this change in the column?

[worthy cape]

I believe it always exports the raw row-IDs. You get to correlate different JSON files separately.

[peak forum]

https://pastebin.com/Kgpxs9xQ

[loud flint]

You might THINK it's called a currency exchange market, but that's just corporate propaganda

[rain pasture]

gotdangit bobby

-    "name": "King of the Hill",
+    "name": "No Forgiveness",

[peak forum]

@worthy cape Did you manage to find which beasts will be captured on normal world?

[primal schooner]

Anybody got a parse / spreadsheet of all the Corpse spectres ? (text is fine)

poedb.tw isn't responding

[primal schooner]

🤣

[worthy cape]

I don't really look into much about actual data.

[crude bane]

Anyone know what the name for the league is called in the public stash api stream?

[bright ridge]

Settlers

[primal schooner]

/leagues will tell you, and I think now it even has a UID for which one is the current league

[bright ridge]

  {
    "id": "Settlers",
    "realm": "pc",
    "url": "https://www.pathofexile.com/ladders/league/Settlers",
    "startAt": "2024-07-26T20:00:00Z",
    "endAt": null,
    "description": "Build the town of Kingsmarch alongside Kalguuran Settlers to establish their place in Wraeclast.",
    "category": {
      "id": "Settlers",
      "current": true
    },
    "registerAt": "2024-07-26T17:10:00Z",
    "delveEvent": true,
    "rules": []
  }

[primal schooner]

I was trying to automate getting the 'current league name' via the api and could only do it by finding it through unique text / date

[woeful cloak]

Looks like alot of aura spectres cap at aura level 10 now.

[primal schooner]

you got the list?

[primal schooner]

can i get a CSV or something w/ all the corpses data ?

XML / JSON / CSV / XLS / text... lol

[worthy cape]

@faint remnant I'm sure you've figured it out, but there's suggestions that item classes may not be relevant for these enchants.

[faint remnant]

Wait what

[worthy cape]

I don't know more.

[faint remnant]

As in: The classes we currently see are not the actual classes we can use them on in game?

[worthy cape]

Possibly.

[faint remnant]

That would make so much sense

Right now they are exactly where they shouldn't be

[primal schooner]

what enchants? Runes? or the other bench enchants ?

[worthy cape]

The fun new ones.

[primal schooner]

runes and bench enchates are both new

[faint remnant]

That could seriously reinvigorate my hype

[worthy cape]

See how much I have followed this launch 😄

[faint remnant]

I was getting desperate scrolling through this

[primal schooner]

runecrafting is weapons only

[worthy cape]

Play the game like intended.

[primal schooner]

which are the unqiues

[faint remnant]

Any reason why you believe this might be the case?

Besides how silly the placement of some of those mods is

[primal schooner]

where you geting that info from

[worthy cape]

#666519736007262240 message

[faint remnant]

Rebooting my hype engine

Also that bait and switch gave me 35 psychic damage

[woeful cloak]

PoEdb

[primal schooner]

yeah trying to find another source. website keep crashing on me

[cobalt wolf]

Anyone know when https://lvlvllvlvllvlvl.github.io/RePoE/base_items.json will be updated?

[faint remnant]

Perfect Hydra has a Hatred that still has phys added as cold and %cold damage

20 and 16%

[primal schooner]

are you guys outside the US able to access poedb ?

[faint remnant]

Yeah, got it open and can refresh. but it's getting swarmed

[primal schooner]

I don't wanna turn on my VPN and risk loosing conn for hte queue

:-p

[worthy cape]

@zenith zodiac How's it hanging? 😄

[worthy cape]

Wurst case you can try running it yourself, maybe having to update the PyPoE spec.

[gilded tree]

yes

[worthy cape]

PoEDB has a white empty document for me.

[gilded tree]

ah, but not flawlessly

[primal schooner]

yeah i can't connect either

def having issues

if Chuan is on vacay, who did the scrape and parse for the ggpk data?

probably automated from a git upload of the data ?

[worthy cape]

Might not have resisted the temptation 😛

[primal schooner]

well he needs to call his web admin / host, cause 🔥

lol

[zenith zodiac]

l'll launch a run now, so far it doesn't look like too much changes so should be ready within an hour or 2

[cobalt wolf]

worst case i may consider it, so are you saying there is a python script somewhere that i can run on the game files?

[zenith zodiac]

best case 30 minutes

[cobalt wolf]

ah cool, thanks!

i wrote a tool that uses this data to create a very detailed item filter for my own personal use in rust

was a lot of fun

[velvet fog]

poedb should be stable right now

[primal schooner]

how's vacation so far? 🙂

[woeful cloak]

I gotta say, I am PRAYING you're wrong on these numbers. 😦

[primal schooner]

it's all parsed from the ggpk nobody (very rarely) enters the data

[velvet fog]

runes have strange itemclasses, no idea

[cobalt wolf]

on a side note i see that if item filters matches with the '==' operator then the client will actually give error if things are not spelled correctly, this seems very useful.

I see people are editing their item filters and they are not using these, so it defaults to some sort of wildcard matching.
I don't understand why.

[golden knot]

Fuzzy matching is good when you want to capture lots of similar bases at once like Talisman, but those rules should be infrequent. I use == for almost everything

GGG's validator is pretty robust, it will give fuzzy matching errors as well if it can't find a match

For a long time the Sai basetype was raising hell because without exact matching it was capturing Corsair Sword, Saint's Hauberk, Saintly Chainmail, and Mosaic Kite Shield

and lots of people were confused

[cobalt wolf]

do you think a lot of people writing filters are just not aware of the '==' operator?

[golden knot]

Most people use Filterblade, which for a long time only used fuzzy matching. I think they've been slowly changing over

But yes I'd say there's a lot of filter syntax stuff that lots of people don't know, even if they write their own filter

[frank drift]

not true, FB has been using exact match where relevant since the operator was created

is the wrong operator sometimes used, sure

if you see a potential bug please report it

[cobalt wolf]

Hey, sorry to disturb but how is that update coming along?

[jovial lark]

i keep having my poe crash and in the logs i get this: 2024/07/26 22:42:29 14044843 e0a9b589 [CRIT Client 7036] [D3D12] swap_chain->Present() failed, anyone know how to fix this?

[worthy cape]

This place isn't for end-user game support, we deal in the horrors of tools.

[jovial lark]

oh my bad, where would be best to ask?

[worthy cape]

Not sure, one of the help channels or the forums. Maybe try changing renderers.

[jovial lark]

thanks, ive tried between the 3 and no difference

[zenith zodiac]

hopefully not long https://github.com/lvlvllvlvllvlvl/RePoE/actions/runs/10117979126/job/27983984610

[cobalt wolf]

thanks for the update, i appreciate your effort 🙂

[zenith zodiac]

idk why it's so slow to commit in the gh-action, l've done a manual export on my machine and pushed it

[cobalt wolf]

Did you start another github action with that push?
or are you trying to bypass the build action?

[zenith zodiac]

yes, it triggered another build. the json files in the repo should be up-to-date, but the gh-pages need to be updated from the action

[cobalt wolf]

@zenith zodiac Looks like it got updated now, many thanks

[lilac arrow]

are there any tool dev folks who could check to see if an item exists this league or not? specficially half remembered goliath?

[ashen charm]

hello

wassup?

[waxen musk]

can we make PRs to dat-schema? some types havent been updated for many patches now so i have to keep manually fixing them every time i download latest version. do we edit the GQLs?

[fickle yew]

@compact isle Did something change in the subgraph for cluster jewels? For ones without nodes the nodes is now [] which is a bit funky to parse for an empty dictionary.

"11": {
    "type": "JewelPassiveTreeExpansionSmall",
    "subgraph": {
        "groups": {
            "expansion_11": {
                "proxy": "43989",
                "nodes": [],
                "x": -4708.05,
                "y": -8281.17,
                "orbits": [
                    3
                ]
            }
        },
        "nodes": []
    }
}

[waxen musk]

thats from api?

[fickle yew]

Yes

I wrote a custom json converter to deal it so more of a heads up.

[zenith zodiac]

yes, edit the gqls then you can do npm run generate to check that it outputs the right json

[waxen musk]

did they just rename nearly all GrantedEffect's? all my gems have mismatching IDs now -_-

[worthy cape]

PoB had some Fun Times with this, I believe. The gang has sorted that "PITA" out and are testing stuff out to see if anything broke doing so.

We had an extra spicy process with surprise horrors like this:

[waxen musk]

yea i just finished mapping them together, 413 gems renamed. yay

[idle island]

peeps..does awakened POE trade show you tinktures or heist contracts? for me it just returns some Unknown item for both

tinktures i'd understand since they are newish items but even heist contracts?

[worthy cape]

Contracts ring a small bell, didn't they become largely uninteresting the other league when the rewards were disconnected from the types?

[idle island]

no idea, i tried googling the problem and there had been same error few years ago, but it was so old posts i thought it might have been fixed

but reason i thought it should work is just that people sell contracts and blueprints quite a lot

HMM...now that you said about contracts. I tried with contract AND blueprint and contract gives error, but blueprint works. So maybe conracts are just whatever bubblegum trash these days

i am still in act 10 so i only have had 1 blueprint drop so didnt check first. Ok so that works then

[turbid thunder]

the game is pretty laggy on PlayStation, I've done everything possible to fix it like port forwarding and using Ethernet and still lags 😭

[hazy fiber]

not the right channel for it, would recomend the forums

[strange fjord]

where can i download the latest version of awaekend poe trade

[hexed mesa]

for latest, either here https://github.com/SnosMe/awakened-poe-trade/releases or simply go into the about tab in the tool and click update
if you are asking about 3.25 update though, it seems like snosme just pushed the data update half an hour ago, so might take a while longer until its actually updateable https://github.com/SnosMe/awakened-poe-trade/commit/b9ae476bb290f6285b466ead27c6c37ed0644d03

[outer jay]

Hi,

I've got some tool to pull character data from the API and then make a poe.ninja like view from it. However since 3.25 the oauth refreshing started failing without making changes to the code.

The code is as follow:

        var httpClient = new HttpClient();
        using HttpResponseMessage response = await httpClient.PostAsync("https://www.pathofexile.com/oauth/token", new FormUrlEncodedContent(new Dictionary<string, string>()
        {
            { "client_id", clientId },
            { "client_secret", clientSecret },
            { "grant_type", "refresh_token" },
            { "refresh_token", refreshToken }
        }));

        response.EnsureSuccessStatusCode();

        OAuthResponse content = await response.Content.ReadFromJsonAsync<OAuthResponse>();

        return (content.AccessToken, content.RefreshToken);

Weirdly enough, it does work when doing a similar request manually in postman, so I'm guessing there's some auto-added headers that are automatically included in postman but not in C#'s httpclient. I don't see any smoking gun though :/

(even doing a code snippet export from postman experiences the same issues :/)

[zenith zodiac]

l think you need to set the useragent https://www.pathofexile.com/developer/docs#guidelines

[outer jay]

Hmm, my other requests do but not this for some reason, I'll try when I get back home but I don't think my postman does either

[worthy cape]

The UA is definitely mandatory.

[outer jay]

Postman definitely adds one but doesn't follow the right format, so maybe it's accepted

Yeah adding it seems to work

Thanks, guess it got made mandatory

Would be nice if it gave a better error than just a forbidden 403

😅

[zenith zodiac]

do you know what the strategy was? we'll probably need to fix it for the wiki (more for non-gem skills like aspects) and it would be nice if that wheel was already invented

[oak estuary]

Run our scripts, see what broke, manually change it to the new ID. Most of them are just their display names stripped of spaces and symbols and CamelCased, if that helps

[zenith zodiac]

awesome, should be possible to do similar on the wiki. thanks

[jolly mist]

Hello, sorry if it's wrong chan but i got this error for the awakened poe trade macro. tried to clean the folder in the cache, download the last version but cannot make it works

[lofty stag]

That's a list buddy.

[fickle yew]

I'm aware. But it's an object / dictionary when it has content and an array when it is empty...

[compact isle]

classic PHP

[worthy cape]

Sounds rather exciting for some schema parsers.

[fickle yew]

also wtf.. lazy league start and I randomly find a Ralakesh's Impatience that sells for 21 div..

[worthy cape]

I had a scare where my skill of choice was 1d minimum... turns out the trade site also does Standard inbetween the Internal Errors.

[fickle yew]

Hehe

[loud flint]

To be fair, this sounds like something JS would do as well

I think I see a trend

[compact isle]

will fix

[loud flint]

where api

(didnt call it AH this time, no more delay)

jokes aside, stable league > 3rd party support - but i had to build my own API using a spreadsheet I update every hour, not optimal but works

[smoky nebula]

yo my poe woke trade wont register ctrl + D after new update

[candid tapir]

i cant login in website
Ray ID: 8aaada0f4ceef895
Производителност и сигурност от Cloudflare

[zenith zodiac]

repoe no longer commits minified json files to the repo - l think those were what was causing the performance issues on build. they can still be found in the gh-pages, e.g. https://lvlvllvlvllvlvl.github.io/RePoE/base_items.min.json (and the pretty-printed jsons are still in the repo)

[rare void]

is there a way I could emulate the new retal gems in pob?

[hazy fiber]

they exist in pob, what would you emulate?

[rare void]

they dont?

[oak estuary]

What version are you on and what gems are you looking for?

[rare void]

ah the 2.47 out 8 hours ago.
Saves me time.
Thanks Reg.

[random fjord]

Made a spreadsheet that helps me with Workers' hiring, so I can quickly see and compare the highest and lowest wage of the tier I currently have in my settlement.

https://docs.google.com/spreadsheets/d/1lMM8fXULL-DcIvmR35c0M36T_KD8FR-qcramoEPL-J8/edit?usp=sharing

You can just duplicate the spreadsheet and input your own values.
(File -> Make a Copy)

All you have to do is change the numerical value of the tier in the "Check" column. The spreadsheet will automatically display and highlight the maximum and minimum wage for the checked tier of the worker.
https://i.imgur.com/zAUDzjA.png

The highest **wage **of the selected tier in the "Check" column will be highlighted in a **red **🟥 color, and the lowest in a **white **⬜ color for the selected tier.
https://i.imgur.com/46Pg51j.png

IMPORTANT, you have to input the values of your current **tier **and the corresponding **wage **for each of your current worker(s).
So the only thing you need, and should change (unless you know what you are doing) is the "Check" column cells and "Worker 1(Wage, Tier), Worker 2, Worker 3, etc." column cells.
https://i.imgur.com/1GUtbyV.png

And I added a dropdown worker tier version of the spreadsheet, that you can select at the bottom labeled "Tier Dropdown Version". As well as empty template sheets that you can just duplicate (Right click -> Copy to -> New spreadsheet), *IF YOU ARE LOGED INTO A GOOGLE ACCOUNT *.

[late schooner]

somebody forgot to add Scarab of Bisection to /trade/exchange/

[compact isle]

they also forgot to bump the map series

smh

[formal kraken]

Tradesiteguy take my energy

[compact isle]

should be in there now

[real shoal]

Hey team, been browsing through here but haven't found an answer yet; is there any place where there are discussions on people working on implementing new features/skills to PoB? Or is it just a free-chat here?

[worthy cape]

There's a dedicated Discord server for contributors wanting to do active development on features, it's outlined in the docs at https://github.com/PathOfBuildingCommunity/PathOfBuilding/blob/dev/CONTRIBUTING.md#contributing-code.

[real shoal]

Thank you very much, I appreciate it!

[fathom dagger]

How do I post prices like this

[frank drift]

this is not a support channel, post in the PoE forums or email GGG support

[cold dust]

Hey hey, anyone here that is using CrossOver to play on mac and using APT?

[river rain]

please add options for employees whether they should help in, for example, melting other metals to which they are assigned or not. Currently, the option of constantly helping other positions is burdensome, e.g. to develop a lvl 4 port, you need amber ore and employees automatically turn it into bars. If someone has already mentioned this, I apologize for the spam. Regards

[worthy cape]

I thought this was about GGG employees at first 😄

[gilded tree]

Same

[crisp kestrel]

Updated Divicards site with 3.25 data
https://www.reddit.com/r/pathofexile/comments/1ei3nqx/divicards_site_is_updated_with_325_data/

[patent notch]

@fickle yew base-type page has been like this, checked few hours ago and now (dont know in between). Just in case anyone missed it

[fickle yew]

Not for me... But I've cleared the CDN cache. Maybe that will clear up the issue for you?

[patent notch]

hmm, all other pages load fine except that one so I didn't try it. will do and report back

yup, my issue. No worries, Thanks.

[tranquil token]

@velvet fog https://poedb.tw/us/NPCs

I'm sorry I think I've asked for this before. Could you please update the Text Audio of the NPCs in this league?

[velvet fog]

added

[tranquil token]

Thank you so much!

[cobalt wolf]

https://lvlvllvlvllvlvl.github.io/RePoE/base_items.json

Is this missing data about tincture items?

@zenith zodiac (Hope you won't mind that i ping you about this issue)

[oak estuary]

You're looking for @zenith zodiac

[cobalt wolf]

yes, i think i pinged him (?)

[oak estuary]

Oh sorry, discord must've bugged because it said Ivy earlier

[zenith zodiac]

sorry, guess l've been lazy about adding new item classes. update is building now, should be ready in about half an hour. tinctures without mana_burn_ms and cooldown_ms in the properties are the deleted ones from azmeri league and can be ignored

[cobalt wolf]

thank you very much 🙂

[crimson basin]

Hey folks! I've been having issues with Awakened PoE Trade since league start and I was hoping someone might know what's going on.

System Info
OS: Arch Linux w/ 6.10.2 Zen kernel
Compositor: Hyprland 0.41.2
PoE through Steam with Proton-GE-9-10.
APT appimage executed with --no-overlay

I ran APT for all of Necropolis with little issue. When I started Settlers, I was having trouble getting it to search an item with CTRL+[ALT]+D.

I noticed in the logs that every keybind/shortcut was failing to register, and this repeted every time I focused/unfocused the game.

Example log (this repeats for all of the keybinds)

[12:20:18 PM] error [Shortcuts] Failed to register a shortcut "Ctrl + D". It is already registered by another application.

I've tried using Hyprland binds to pass the keys into APT, but that doesn't seem to make a difference. APT worked in Necropolis without any modifications/tweaks, so I don't think this is the issue.

I did some debugging with the APT repo, but haven't been able to find a workaround or cause. APT uses electron's globalShortcut.register(), which doesn't give anything other than a bool indicating success/failure. That bool is false for every keybind.

I don't have any other apps (that I'm aware of) which have any global shortcuts. I also haven't been able to find which global shortcuts have been registered that would conflict with this. Maybe there's a way to list all global shortcuts that I've missed?

Does anyone have any ideas or troubleshooting advice? My absolute last resort is to boot to Windows for PoE, but otherwise I'm all ears on things to try.

[worthy cape]

Wayland is in general a bit opinionated on cross-application keyboard logging and sending.
Does it generally work for other Wayland peeps?

[crimson basin]

It worked on this same setup (slightly older versions of course) for all of Necropolis.

I'm having trouble figuring out what changed. The one thing that I'm most suspicious of is ydotool, which I got to make pasting work with PoE. I uninstalled it and rebooted, but the problem persisted. If only I had kept up with my regular config file git commits 🙃

[iron spindle]

Hi, I've recently change my pc and i want to migrate all the "Map Rolling" regex from the old pc to the new one, but i cant find its anywhere in the POE Awakened Trade folder.
Some help would be very appreciate ❤️

[worthy cape]

I would expect it to live in config.json with all the other settings, but don't have a computer to look.

[clever thistle]

C:\Users\Nighty\AppData\Roaming\awakened-poe-trade\apt-data is where my config.json lives

[worthy cape]

It may not be immediately obvious if it's encoded or escaped to fit into JSON.

[mellow ferry]

are there any public api available to generate the pob code given the account and character name?

[loud flint]

I wonder what's up with the trade website this league, makes me think the currency exchange market uses the same server and overloads it somehow 🤔

[frank drift]

I don't see anything happening with trade that doesn't happen every league

[loud flint]

Feels wayyy worse this League

[late schooner]

it is worse

more than an hour delay on items yesterday night

[worthy cape]

Seems to fall over around peak EU, so if you're in those timezones it'll probably feel worse.

[wraith jasper]

Anyone seeing errors on Wealthy Exile?

Status Code: 500 Internal Server Error

[loud flint]

Literally says right there - GGG issues

[crude bane]

I'm having a weird problem with ratelimit for the public stash api. Occasionally, when I break the rule, the headers I receive from 429 response have no Retry-After field. Ideally I wouldn't break the rule of course, but my current multithread version does not work very well with the X-Rate-Limit-Ip field unfortunately.

Anyone know why this would occur? I could use the ZZ from 'X-Rate-Limit-Ip': 'XX:YY:ZZ' in these cases as a fix, but that seems a bit clunky.
This is an example of my headers

{'Date': 'Tue, 06 Aug 2024 12:51:12 GMT', 'Content-Type': 'application/json', 'Transfer-Encoding': 'chunked', 'Connection': 'keep-alive', 'Access-Control-Expose-Headers': 'X-Rate-Limit-Policy, X-Rate-Limit-Rules, X-Rate-Limit-Ip, X-Rate-Limit-Ip-State', 'X-Rate-Limit-Policy': 'public-stash-tabs-request-limit-pc', 'X-Rate-Limit-Rules': 'Ip', 'X-Rate-Limit-Ip': '2:1:60', 'X-Rate-Limit-Ip-State': '0:1:0', 'Strict-Transport-Security': 'max-age=63115200; includeSubDomains; preload', 'Access-Control-Allow-Origin': '*', 'CF-Cache-Status': 'DYNAMIC', 'Server': 'cloudflare', 'CF-RAY': 'dont know if this is sensitive`}

[velvet fog]

https://www.pathofexile.com/developer/docs#ratelimits

[crude bane]

Yes I read it, but it says there is supposed to be a Retry-After field. But sometimes the headers are missing it on 429 responses

Such as the one above

I must not be understanding something

[clever thistle]

looks like you've not gone over the limit? 'X-Rate-Limit-Ip-State': '0:1:0',

[crude bane]

This header is only printed if the response code is exactly 429, so I must have right?

[timber path]

Does anyone know what reference resolution is used for the x and y offset values in the stashtab layout dat files? -> when plotting them from the top-left of the stash tab, they dont align at all it seems. Probably I'm missing some kind of scaling factor, just not sure where to find it.

[worthy cape]

Gut feeling says 1920x1080, but I could be completely off. Never looked at layout logic past "oh gods, the buff bar is horrible".

[timber path]

I play on 1920x1080, but the offsets dont match. E.g. de currency tabs first and second box are about 36px apart if using a 52x52px box. While they're only 6px apart when taking a screenshot ingame and measure the distance 🤔

[crude bane]

Are you not allowed to send head requests to the public stash API? Couldnt find anything about it in docs or on google. But I keep getting a 403 request when I attempt it, so unless I am doing something wrong that must be the case.

[sharp totem]

😭 this best league ever and i cant even play it, please make a giga shitty setting new stuff make my pc not be able to run game anymore i cant even do maps anymore

[oak estuary]

This is not a game feedback channel, read the description

[zenith zodiac]

ime you basically can't use multi threading for api requests because the limit can change at any time and when it does any other requests that are in progress are counted as over-limit. l would recommend to use a single thread per rate limit policy if possible

[sharp totem]

where is game feedback channel?

[frank drift]

https://www.pathofexile.com/forum/view-forum/feedback

[daring moss]

As long as you have some sort of atomic way of keeping track of your current rate limit I think multithreading the requests themselves should be fine? Just lock the rate limit, increment and potentially wait for it to free up if you hit a limit, then kick off a thread, no?

[timber path]

That would only work if the rate limit is specific for your app. If you're using the general/public end-points, the rate limit is shared between all apps that make use of it. So even if you keep track of it, another app might still do their own requests and "eat away" at the limit without you being able to track that at all.

[daring moss]

Right, but then you couldn't keep track of it no matter if you're single or multi-threaded

As you'll only know the current state after sending a request

[zenith zodiac]

you can't have multiple requests active for the same policy. if the limit is lowered while handling the first request, the other active requests will fail if they are now over the new limit. you need to send one request at a time, and check the headers before sending the next one.

[crude bane]

The response headers, for the public stash api at least, return the current state for how many requests you've sent within the last test period. So it's very easy to track. My theory for how I hit is due to a/multiple threads crashing and not therefore skipping the step I have for waiting if I am about to overstep the rate limit

[daring moss]

Ah, right, I forgot that GGG dynamically tightening the rate limits was a possibility

Requests have to happen in sequence then, but you can process them in parallel

[obtuse crag]

Do you have ever just bang your head into the wall over something that is probably something really simple and stupid?

Any idea why you'd get:

Forbidden; You must use an OAuth client to access this endpoint

When using something like:

"Authorization: Bearer ". GGG_BEARER_TOKEN

as a header?

[worthy cape]

Don't forget the user agent, just in case it's that 😉

(I know nada of OAuth)

[obtuse crag]

Yeah I set the user agent when i was getting rejected by cloudflare as that was part of that solution

(i.e. no user agent = cannot get oauth tokens from the api)

Appreciate the thought though

[worthy cape]

In case anyone happens to rely on any of my tooling or feel lonely, I'll be flying until Friday and then be abroad on potato computers for weeks to come.
Honk if anyone needs anything but I'll probably be busy.
New job, ho!

[obtuse crag]

good luck with the new job

[obtuse crag]

Just in case anyone searches for it, your user agent needs to include an e-mail address or the public stash tab api rejects it

[compact isle]

you do indeed need to follow the User Agent format as described in the docs

[rare gulch]

does anyone know if i pass a posseid do i even need to look at ip limits on trade reqeuests?

ahh nvm i see

its so you get double the requests on ip by providing but still need to respect i plimits

[worthy cape]

Yeah, all policies listed in the header for which policies apply, apply.
The limits are just more generous if you're cool.

[glad stone]

Can anyone help me? I'm having trouble with awakened poe trade. Whenever I try to check prices, the overlay opens just fine, but I can't check any stats on the overlay and it does not go away, I have to tab out of the game.
Tried to reinstall awakened poe trade, game is in window mode, tried opening with/without admin.
Any ideas?

[manic crag]

Choose windowed fullscreen mode

[glad stone]

Already is, sry wasnt clear enough, just said window

[wraith jasper]

Anyone got some links or examples on how to render the poe skill tree on web?
I haven't worked with sprite sheets with web too much so an example would be super handy

[flat star]

who can help me make Oauth on my site? I don't understand why I get this error

[loud flint]

Wild guess, but probably because you don't have cookies enabled (see top message)

[daring moss]

That looks like CF blocking you because you're missing a proper User Agent

[compact wigeon]

https://github.com/EmmittJ/SkillTree_TypeScript seems like it'd fit the bill, it's what I based Path of Pathing on

[fiery apex]

I'm curious btw, how exactly would I go about getting access to the % weight of each mod and etc, things that craft of exile has access to?

To be more specific, I'm looking to get access to the % weight of each Rog craft option appearing for specific items

[hazy fiber]

the weights are available in multiple places, easiest is looing at craft of exile or poeDB, but you can export them yourself, and then to calc the %weight you would just sum the total weights and divide by that

weight of each Rog craft option
I dont think those exist

[fiery apex]

yeah I get that, but was wondering how poedb for example gets access to them? Is poedb built by the poe devs (in which case, that makes sense)?

[hazy fiber]

or atleast I dont remeber seeing them in the ggpk

but you can export them yourself,
in the ggpk

[fiery apex]

where do I find the ggpk? don't see anything with that extension or name in the poe folder

ill try look myself, otherwise I guess its RE time

[hexed mesa]

.ggpk file is on standalone client only, for steam we have bundles2 folder which is just unpacked ggpk

[fiery apex]

ah

I see, tyty

[zenith zodiac]

you can view the data files with https://snosme.github.io/poe-dat-viewer/

[hexed mesa]

if you just want the mods and their weights lvlvl is maintaining repoe https://lvlvllvlvllvlvl.github.io/RePoE/

but yeah, rog weights dont exist in the client as far as we know

[hazy fiber]

anything the client doesnt need to know isnt guaranteed to be in ggpk (eg drop weights, rog weights, etc)

[zenith zodiac]

rog crafts are in data/expiditiondeals.dat64, but l don't know where you're seeing weights for them? can you link the page?

[fiery apex]

ah yeah true if its fetched from the server then I guess there's no way to know

nah im not seeing them anywhere ivy, I was looking to see if I could find them anywhere

had an idea to make a rog craft emulator, just as a side project

[hexed mesa]

well i doubt its fetched from the server either, the client doesnt need to know the weights, the server just gives the next crafting option i guess

[zenith zodiac]

yeah a lot of stuff is server side 😦 keeping track of which delve-only mods can still drop is a nightmare

[fiery apex]

well the option would have to be randomly picked somehow, I guess it might be completely random, but I assume certain options (like upgrading a prefix to t1 unconditionally) is lower weighted than others

[hexed mesa]

yeah, delve only mods, incursion mods, elevated influenced mods

[fiery apex]

so ye if the server does that calculation and tells the client what option to show to the player, then thats a no go ig

[hexed mesa]

and stuff like that doesnt have weights

the best you can do is just use rog a lot and gather the weights yourself

[fiery apex]

yeah but then i gotta play the game and grind it out to be able to rog craft enough times 💀

but ye i guess no other way

[frank drift]

you could check Prohibited Library discord for existing data

[hexed mesa]

yeah, theres a chance there was some community movement to gather this kind of data

[fiery apex]

shall check it out, havent heard of that server

ty guys appreciate it

[hexed mesa]

or you could just start it yourself, but thats barely better than just gathering it yourself probably

[fast beacon]

Made a new feature in my tool! It now includes an auto-correction mechanism for the override price formula, ensuring that any incorrect entries are automatically adjusted.
Additionally, I’ve set a high initial price to safeguard against selling items at undervalued prices in case of any issues.

to save the running time, I decided not to sort the price again after correction, it will be sorted on the next run

[proper frost]

Is there an API for the currency exchange?

[loud flint]

Not yet

[oak wadi]

can someone help me out when i try and press my hot keys it doesnt work for the poe tool instead it turns my brightness up and down... im on a laptop using GeForce

[pallid wraith]

Feels a bit offtopic, but the answer is because you're not pressing the bound key.
Hold Fn, or change settings in your laptop to prioritise f-keys over the other function

[cobalt pollen]

Does POE or its website have a public API documentation of any sort?

[oak estuary]

Check the pinned messages https://www.pathofexile.com/developer/docs

[worthy cape]

The docs cover the proper API with OAuth and all.
The website itself while using various endpoints is a different beast, as is the trade site.

[cobalt pollen]

Ah thank you I will do so.

[worthy cape]

Are you looking for something in particular?

[cobalt pollen]

Not currently, I am mostly just curious what sort of API is exposed to get some ideas, I am unsure what is allowed to be done with tools so I won't be making anything until I have learned that.

My account is ancient and I do not want to get myself in trouble before I know what isn't allowed. But I guess if I was to speculate I am hoping to make some kind of "track my drops for fun" kind of thing?

[worthy cape]

Your own stash tabs are accessible via various methods.
There's the proper API outlined in those docs, which is used by services like PoeHub, WealthyExile, Exilence CE, etc. This is using OAuth and more geared towards building a widely available hosted (web) service.
There's also the jankier one on the website that powers the account/character pages, which is used by tools like Acquisition which auths via POESESSID.

In general, use an user-agent with your tool name, tool version and contact information so that the gang can get hold of you if it's being naughty.
Look for and understand the rate limit headers and pace your program accordingly.

[cobalt pollen]

Much appreciated, I will go forward with this all in mind.

[zenith zodiac]

lol

[molten thicket]

guys. is there an external hideout editor to fix, modify or generate .hideout files?

[oak estuary]

I hear @worthy cape is working on one for GGG now 😉

[formal kraken]

Nonono he's our agent at GGG

[frank drift]

not that I'm aware of, zao probably got the closest

[worthy cape]

Started on one, harder than it looks apparently.

[molten thicket]

alr. i literally just spend 10 hours working on a python script. without chadgpt it would be plain inpossible for me. i currently got a few basic features working and looking how far i can push it. sadly im out of promts and some issues are too unique which i lack the coding experience

let me parse the latest promt, then i can look into dropping a screenshot

on a side notice without asking the ai i wouldnt know that the .hideouts files are .json files appended to a BOM. with that BOM the json parser from python left the chat. chatgpt hinted me to skip the BOM and then pass to the parser.
thinking about this if i wouldnt have known that i would have spent maybe 2 hours figuring out why the parser goes nuts and i just might have alt f4 ragequitted

naturally my code now contains strong language. i mean frustration is what drives us after all right?

current features:

• load a hideout file and draw a canvas & object tree
• open objects individually and option to modify attributes of objects. the input promt defaults to the given value the attribute of the bespoke object has
• a context menu for the tree viewer, which allows the above feature and 3 more. those need to be tested
• the ability to save the file (not tested at all)
• a view setting in the toolbar to draw all object names on the canvas. this feature is by default toggled off, since i inentionally only want the name to be drawn when an object is selected on the canvas or tree vice versa (currently not working for some random ass reason)
• a zoom slider bottom right of the screen. a x-y scroll of the canvas is still to be implemented

obligatory pings @frank drift @worthy cape

[frank drift]

idk why you're pinging

[molten thicket]

oh sorry i thought you were interested

[loud flint]

I hope I didn't do any double work here, but initial searches turned up futile. I've been working on a tooltip item renderer for a project I'm working on, which just renders item based on the item text copied from game. Would there be any interest in me open sourcing this? Currently will only work with React but I'll also add bindings for other frameworks since it's all raw HTML anyways

I assume most who needs this have just written their own adaptation at this point

[molten thicket]

would be banger if it could work as a discord app

[loud flint]

so just something like /render <parsed item> outputs a generated picture like that?

hm that's actually a great idea

[molten thicket]

with the goal to cut down data traffic

and for some people like me the screenshot tools fail since they cant handle 10bit

[loud flint]

[worthy cape]

Watch out for that the dictionary contains duplicate keys as there may be more than one decoration of the same type. Many JSON parsers just pick arbitrarily or the last.

[loud flint]

Don't send them into the rabbit hole of writing their own JSON parser

That's deeper than Steves Delve mine

[molten thicket]

steves mine at least has a depth limit

[formal kraken]

@loud flint this exists https://github.com/meta-is-beta/horadric-helper?tab=readme-ov-file

[loud flint]

Ah cool! That didn't show up on my radar at all while I was doing stuff, thanks

[formal forum]

i wanna mess around with the API (i use python), are there any libraries out there that can basically render someone's character sheet / skill tree? or do people usually roll their own solution for that?

see, i'm trying to learn Angular and I wanna build a sort of mini-poe.ninja/builds with it as an exercise

[grave wren]

People usually roll it themselves, sounds like you'd want to do it too if you want to learn angular more in-depth anyway

[formal forum]

ok, so basically the skilltree-export is all i need. basically just rendering a giant graph? seems they've got coords and everything in the json

[formal kraken]

you can either render the skill tree pretty on a canvas (done that before with pixijs) or you can do a trimmed down version using an SVG (the preview you see in pobbin and poe.ninja)

[formal forum]

@formal kraken thanks! i was just about to ask for lib recommendations lol. pixi js is as good a start as any

[pliant vale]

i am having an issue with Awakened POE trade this league. i get the error cannot load leagues with the debug error of error [cors-proxy] read ECONNRESET (www.pathofexile.com) i can access POE trade fine in a browser. I have tried different DNS proxies, i have tried to use it with anti virus and firewall disabled. i did have some success in installing older versions Awakened POE trade but now that no longer works. i have read through and tried all in the failed to load leagues guide. When i try to use the browser option in the tool nothing loads. i have used the tool for many leagues without issue this is the first time i am experiencing this. Any help would be greatly appreciated. @civic crane

[modest path]

Is there any source of the .it files, specifically the base abstract item types to inherit from, pre-parsed and inherited as json key values for easy reference while dealing with .dat64 data? I see RePoE uses PyPoE to do this, but am hoping to avoid too many dependencies, or rewriting the parsing

Trying to get the inherited data available in rust - Already have all the tabular data available via poe-tool-dev/dat-schema's exporter tool, with code generated from the same repo's schema json

[velvet fog]

you can extract .it files from content.ggpk

[modest path]

Yep, more looking for the recursive extraction, parsing, and merging being done so I can just slurp it from json or something

Can definitely reimplement that if necessary, just curious if something already exists

[velvet fog]

Not seen outside of PyPoE

[modest path]

The cli options of PyPoE are a bit deep given it seems pretty wiki-centric - is there a cli method of dumping that data or is it just used as part of the flow of doing other things?

[velvet fog]

you can use https://github.com/zao/ooz/releases/ to recursive extract .it files, write a .it parser, profit.

bun_extract_file extract-files --regex "C:\Games\Path of Exile\Content.ggpk" outdir ".*[.]it"

[worthy cape]

I found a bug in bun today, nothing critical.

If you try to extract a missing file, it uses uninitialized stack data for things like the bundle index, path hash, file offset and file size.
Most of the time it's sufficiently out of bounds, but today I managed to get four unrelated files extracted.
Might fix that once I get hold of a computer that can compile things again.

[loud flint]

I keep finding smaller bugs in Bun sadly

[worthy cape]

My bun or the ursurper heathen Node.js thingiemabob?

[loud flint]

Ah, the usurper

Just now checked the repo to see you have a different Bun

[zenith zodiac]

does this help?
https://lvlvllvlvllvlvl.github.io/RePoE/Metadata/Items/Amulets/AbstractAmulet.json
https://github.com/lvlvllvlvllvlvl/RePoE/commit/4b6f3069af3500d099e49305426e524387da1b8b

[cobalt pollen]

I went to start working on my tool and realized POB was open source and now I am never getting anything done ever again.

[oak estuary]

https://tenor.com/view/simpsons-homer-bart-lisa-join-us-gif-17846376318791889140

[cobalt pollen]

Looks comfy I shall sit.

Unless I'm missing one that exists it seems like nobody has made the tool idea I had?

Tool just tracks your loot over a session, displays it in various arbitrary comparisons of the users choice (Chaos, div, mirror, whatever)

Sound like anything y'all have seen? Or is that a relatively novel idea.

[hazy fiber]

sounds like one of the many wealth trackers that exist

like exilence / wealthy exile?

[cobalt pollen]

Oh damn, I honestly googled it and didn't see any. I didn't really put that much work into it though