#tooldev-general
1 messages · Page 16 of 1
Once you get into the zone, right?

wouldnt it be easier to prebuild jsons or whatever for those?
access-control-allow-origin is not present, if you can't set them, I can proxy request 🙂
Not sure I follow
Like it a lot - I run linux and never had to even install drivers; just works
card is super quiet, too
It should be present on OPTIONS requests; I'll move it to just be global because lazy
you mean you want companion apps that read dats directly?
Sure, why not?
If the lib API is easy to consume, then you have fresh stuff all the time
idk if you have to bundle them with your app, might as well preprocess them i guess?
unless there are new league dats
or you want to download them from the cdn
you dont have to bundle the dats, u just read them from the ggpk or whatever
i dont think moving a 90 gb ggpk on a phone is a good idea?
A downside of driving tools directly off current DATs is that you need to cook something down for deployment anyway as you can't use the patch CDN from user computers, and if anything changes, it'll likely break your tools.
I'm not talking about phone apps
oh
I thought about it a lot for my Hideout Editor, which started out running directly off the local GGPK and after support said No, I built Inya.
though ive used POB without the game installed at some point
so relying on it being present might be a drawback
For that, I wanted to be able to obtain an exact old version of the assets so that the tool was guaranteed to work until I'd validated newer snapshots.
Well, the DAT file thing I made, was able to read the rows and columns, and map the ones that were mapped. From what I gahtered, new columns are added at the end
Yeah for your usecase, with the whole version stuff
u still tinker with that btw?
There's definitely not any guarantee about where things get added/removed/changed 😄
that was pretty interesting
oh yea and your tools refusing to run after every patch even if nothing relevant to the tool was changed is probably bad too
theyve added or removed columns in the middle a fair bit
Haven't since northern spring, got busy with the job application and move after that.
These days, I've got other things to do and like to focus programming energy at work.
My dat reader worked between new releases without updated dat schema each time, well obviously it didn't 'understand' the new columns etc
Gotcha, similar energy issues here as well, nearing 40 years old.. not 25 anymore with unlimited energy 😄
simple request doesn't trigger OPTIONS
The hideout editor also naturally reached a cusp where I couldn't actually finish it without things like replicating terrain generation and the renderer.
were you trying to accurately represent the look of the hideouts?
Unfortunately for ggg's ops guys, I can update this now
Yep, standalone tool with enough visuals to meaningfully edit a hideout preset without having to pop into the game to review.
@civic crane try now, I see headers on all requests
And the poe2 string is no longer "error" lol
poe-dat-viewer and pathofexile-dat CLI support poe2.
Poe2 schema inherits from poe1, and overridden types can be placed in dat-schema/poe2/*.gql.
P.S. Schema consumers make sure to pick correct table (duplicates are now present) by looking into bitmask field validFor
what's the difference between row and foreignrow?
row is referencing same table
row points to the current table and is 8 bytes
array[index]
yeah
Yeah, pretty sure that's fine
handling arrays, i think I'm pretty much done after that
what are the notsures? are you trying to use all 16 bytes of the reference?
yeah I was
they dont do anything, its probably reserved space where the game puts pointers on runtime
seen some values there (non-null), but ignoring that for now
those must be arrays of foreignrows
yeah could be as well
a single foreignrow will either be all FE's or a few bytes of row index and rest 0's
where do i post bugs
hey im new to poe and the game looks good on streams but why is it so muddled down when i launch it. my pc can handle it its a 3070 but it still looks and runs bad
Question how can we get help creating an account the authentication doesn't send to email
this is not a support channel
this is not a support channel
these skill trees are going to be fun 🙂
Anyone got the dump of all the available runes and new mods for PoE 2? Looked in RePoE but I guess that's not supporting PoE 2 yet?
Nvm got it, ty poe2db
poe noob here. does poe 2 support modding? or is this channel for external tools like path of building etc?
no, it does not support modding. yes it is for external tools like path of building
this is not a support channel
sorry, where is support channel?
where do we put bug reports?
see link above
derp ty
should not need to be said but dont download this
a mod should delete it, there's a vulnerability in 7zip that allows rce
If you think you've found something suspicious on the server, probably send a modmail.
we shouldnt share code via zips, especially for progrms that have recent cves
that aint code, just json dumps
The concern is that the file format itself could be maliciously crafted to trigger exploits in 7zip.
deleted
I'm not sure what method would be more transparent and straightforward.
Gists are a bit annoying to populate but can be downloaded as GitHub-generated ZIP:s.
Actual repos are cute but probably a bit heavyweight.
I’ll just push the code when it’s ready, then ppl can just use it to create their own dumps
didn’t know about the 7z vulnerability btw, good to know
shame that you can't seem to trade search filter on "Grants <skill>" implicits
they're always the same for the base type + ilvl, but I agree
issue is there's like 20 base types potentially with the same Grants, and I'm not very picky which one
yeah definitely something we'll look at improving
@nova hamlet Mod spawns are in GoldModPrices.dat and also may be elsewhere
I'm not sure if I have all the columns correctly identified in the dat though
the nest display is a bit .....
Tell me who designed it. I want to give him a big hug. /hug
not sure i like the half-left justified style
btw CVE-2024-11612 was fixed in 7zip v24.08 (unless there's a new one i'm unaware of)
It's the kind of tool that no-one updates, because honestly, why would you?
because of security advisories? 😄
I grab whatever is current whenever installing Windows, set that up, and then it Just Keeps Working.
but yeah i know what you mean
Do poe2 people need trade?
Can you even copy an item?
any idea if there is a way to get character names of the offline players on trade site?
if their profile is not public, i dont think u can, but not sure
I mean for poe2 sorry, they have open profiles. seems like the early trade website for poe2 is just struggling to show everyone online
api isnt available so pretty much a no until ggg gives us api
if u got to their profile URL and look in the character tab, only poe1 characters are in view. are you able to see anyones poe2 character?
nope unfortunately, still wip Im assuming
At this stage, fixing gear in the campaign and endgame might be alluring.
- not ingame support
- dont ping ggg staff
please admin i need help to unlink account i linked the wrong one
contact support by mail, there is none in this discord
maybe an opt-in dev role would slow down the unrelated chats
how do you determine mod - item combinations?
GoldModPrices.dat
thank you
I went through all the new dats today to add spec for ones that sounded useful for PoB
and discovered that one + a bunch of others
which repo is the main one for the specs now?
https://github.com/SnosMe/poe-dat-viewer this one now
don't think it has the spec for that file though
I'll send it, 1 sec
Id: Mods
Value: i32
Weight?: i32
_: i32
_: i32
Tags: [Tags]
SpawnWeight: [i32]
_: rid
_: [rid]
}```
@civic crane I copied a pair of magic gloves in prod before bed.
Unless I was holding it wrong, both normal and alt copy yielded basic-looking mod description text.
I don't know what the intended behaviour or plans are, just noting how it seems to work now.
Yeah no advanced copy for the moment
noted
Was there an explanation as to why minimapicon no longer can be displayed in the item textlabel?
I spit out a bit of my coffee lmao
We've all been there, the grand unifying force of facedesk programming revelations.
how do I report some findings for the schema, changed field types etc, without breaking PoE1 compatibility?
hello devs and ppl, I sent a mail to GGG support and I got this error! I understand that you might have alot of mails during the launch of PoE2, which is, by the way, an incredible game and I thank you for it. After you introduced your new tag id, I realized that I want to change my username, because its very old, and I have too many numbers inside. Could you devs help me out? Tag me pls
Hopefully this is an okay place to ask. For anyone who made their own item filter in PoE2, is the Sockets condition from PoE1 broken or is it a different name now?
Hm, nevermind. I guess I'm bad... Sockets > 0 works but Sockets >= 1 doesn't work.
we are community tool devs, not ggg devs. Also, not the right place to ping ggg
I am sorry sir, I've read the rules, and I didn't used any '@' symbols used for tagging, I just mentioned the name! Anyways I will never say or mention their name again! Thanks for info tho ^
Ryzen 7 cpu going 100% shutting the game down ;/ can it be solved
not a support channel, but my friend solved a similar amd issue by using some random program that limits cpu usage to below 90%. no i dont know the name of it
Good chance it was Process Lasso, popular app for that sort of thing
Hello,
i'm getting sent back to main login screen everytime i try to login my char...can i solve this somehow (with unstuck from site or w/e) or do i need to contact support by mail and hope for the best?
Not a support channel
does .it, .ot etc file formats has a name?
i keep crashing when i start batteling the boss and it cant be my pc cuz its a high end pc
Can someone help ?
this is not a support channel, contact GGG support on the website
ohh mb didn't know they had a support channel
I mean support thong on the websie
website
but thx
I found it funny that you can click the little "play" icon as many times as you want, and each time it opens a new copy of the skill video. So you can have 10 copies of the video playing at once.




is there a filter condition for sockets / socket count in poe2?
Sockets "1" "2" "3"
just found it, thanks 😄
does anyone know how the trade website is calculating the lowermost value on the item, for Physical dps: if i hover on that value it says "at Max Quality" but i still do not reach the exact value, it is slightly off if i use the old: 20% quality average dps * Aps
is it a crit chance factored in?
@fickle yew any ETA on poe.ninja for PoE 2? 👀
Sorry (not sorry) for ping
Actually I assume characters are not available yet through API
Didn't look myself
no api yet ye
I need help i linked my accounts now I seem to have 2 accounts I've lost all my progress in poe2 it's trying to make me start again i ain't happy
Not a support channel, sorry
And what are we supposed to do?
I put in here for any suggestions 🤦♂️
Amyone got same problem that items froom puplic stash dont show up on poe2 trade?
contact GGG support
contact GGG support, this isn't a support channel
I have there just super slow at replying I want to play the game
hi cdr, big fan
big petter fan
Yeah no api.. No data 😅
Hey guys, just bought PoE2 about 30 minutes ago and love it. But I tried to play on controller (DualSense 5) and it connects and plays just fine but some skills like attack are missing from the skill bar and I looked all over, no way to rebind spells or move spells to the bar for bottoms to be used…. Can anyone help me? I tried asking chat in game and they said “Play on the keyboard!”
How do people think "tooldev-general" is a place to ask for game support?
I think the Discord is limiting what channels you see as a new member, and this might show up quite far to the top in those cases
ah that's unfortunate then, still a bit puzzling
definitely not the topic
hey cmon, it says "dev" in the channel name, so it must mean ggg support
try #playstation
since its a DS5 controller
chat gpt suggests "ToolsetTribe"
hi novynn, big fan
if you ask for it it'll just delay it more 👀
i wasn't actually gonna ask
BUT now that you mention it 
although this is how i imagine the office right now
Actually I do have one question to ask of you
Pls alias pathofexile2.com/trade to pathofexile.com/trade2
right now it redirects to the old trade website
/trade2/ is a genius url though, props
I wish we managed to get it on the PoE2 domain but I didn't have much notice that we needed a PoE2 trade site 😅
what do you get when manually calculating it? I get 52.2 which is very slightly off as you said
I suspect weapon speed is slightly different than what is displayed nope double nope which is a yup
Classic divide by shenanigans? 
Don't remember whether PHP suffers from the same degeneracy as JS or not
this is from C++ but yeah some shenanigans
yes 52.2, discrepancy of .27
so speed decimal to the millionbajillion? 😄
so ... which value are we to use if doing dps calc
It's actually 52.5 as min / max are ints but yeah
round early, round often
That's often my motto around Christmas time 
thanks
are u sudos creator? lol big fan too
wait , im confusing the two
but yes big fan of ur graveyard
found a pretty awesome bug and it's just got me scratching my head at the hows and whys lol
is the forum the best way to report bugs? I found a pretty bad performance issue
might just work on my filter tool for a bit while I wait for it to get fixed, it's kinda bricking my build 😄
does trade api work for poe2?
See if there's dupes on the forum and check known issues, /bug if it's related to area/char/etc, post to forum with report ID and more context/screenshots.
If it's about weird computer things, maybe also include a dxdiag and graphics settings if they seem to matter.
it seems like just a silly engine bug with whatever setup I have on this char, I think it's related to attribute requirements lol
Im making a report now
lol
each spike is using a flask, feels like game is going to crash
do the /bugs without a forum post supporting them get read or sent to /dev/null?
They are collected by a system with the message you write and some repro metadata.
Their purpose is way clearer with a forum post.
cool. I'll make sure I do a post in the future. thank you.
guess I work on filter tool for a bit, cant work out how to stop my charcter from causing the bug 😄
has anyone figured out a chat command for respawn at checkpoint? could use that for a logout macro. haha
Since escape pauses, you can just bind escape
true
/exit boots you to the character screen
Yeah not Sudos but the other one
im in the titan grotto act2, and i leaped across to another area and when i click play i always crash now tried changign to vulkan and all even did a repair anyone know whats up? its like i glitched out when i leaped across the gap XD
yeah, I found that too. one of the hidden gems 🙂
Where would be a good place for trade site bugs? I know neowynn is here, but I don't want to annoy him 😄
its using /trade2/ which is rate limited internal api isnt it? i meant the public stash api
there are no apis for poe2 atm
what does explicit.stat_4067062424 refer to? its not HASH32 🤔
oh, its in their /stats endpoint. so these dont actually correlate to the Stats table? 😐
@vestal pond looks like libggpk3 is broken for poe2
and it's throwing the same exception when using lib from the code
just press ok, it still works
i know, but i mostly need the library version and there is no "ok" in code, i can't create BundledGGPK object because of the exception 😦
hey guys i watched and claimed the free cosmetics and after 2 days i still have nothing why is that
Not a support channel
Ok where is the support channel
there is none, email ggg
I think launching was higher priority than niceities like psuedo mods
ya it's fine, can just use weighted sum
you can just comment out the throwhelper code for the null paths
can i send a link here?
has anyone had this problem with the game? https://streamable.com/vh1z61
this is not a support channel
Looks like a skill issue to me
you can also DM me, hard to find website reports amongst all the game things at the moment 😅
haha yeah, would rather use github issues with labels than the forum 😄
the poe1 reports forum has tags that I always use
Hey guys, I would love to contribute POB or some other planners for POE2. Where I can get the news of POB2?
Github I'm sure. Open source project, same with Awakened POE Trade etc
Scraped the POE2 Leaderboard
Total XP by Ascendency
Yes exactly
Oh good eye, just grabbed the default chart in Google Sheets
For the missing labels
which ladder is this
which league
nah just asking
are the drop table data in the client files or is it only serverside?
Server-side
Thank you for the reply!!!
Thank you! I will keep 👀 github and reddit you guys shared
I cant do trial of chaos game ALWAYS crashes on wave 4 boss fight...
guys i found a meme build: https://jsfiddle.net/tzexd40L/
once you see how its just stupid and funny
how de we declare a bug for poe2. i did a trade and cant go back into my hideout (or whatever it is)
Sorry if this is egregiously noobish, but is there somewhere when I can read about deving tools for this game?
Is there an API? Documentation? Etc etc, totally new to this game.
All of the official docs are there
Goat, I appreciate it.
a lot of other stuff is either built on non-official stuff or adjacent to the game (e.g. pob)
keep in mind that as of right now they dont take applications for app registrations, and its unlikely to change any time soon (likely due to poe2 stuff)
Sorry I'm also new to developing, I was hoping to just create some private, probably offline tools for myself
Does app registrations affect this?
the APIs listed the docs website require a registered app, so yes
there are some undocumented APIs that dont need it (trade website and other website stuff), but in general its discouraged to use those and they are subject to change without any consideration to 3rd party apps
Ahh, I see.
Ok that makes sense, thank you I will keep that in mind when I study this.
has anyone figured out the new stat-interpolation formula?
If you are interested in the undocumented website apis while you’re waiting, I’m familiar with the ones related to character items and stash contents.
How do i get in touch with game mods, I need to put in a ticket. My guild stash page got deleted when i tried renaming it.
Anyone know if there’s source control for the wikis? Or a way to export/dump data from the wiki?
That might be an appropriate question for #wiki.
(or the separate Discord server that the wiki peeps operate)
Hey all I am a pretty novice developer (self taught... I am actually a construction worker and just learn in my spare time) who uses mostly JavaScript and Python for my stack... was wondering what type of stuff was being worked on... trying to think of some useful stuff to build out or help build out and continue to grow as a dev and get more experience.
poe1 wiki has cargo API, poe2 wiki might
Any chance the markup on trade site could be changed a little? If I copy item text I get this:
R219% increased Energy Shield
R2 + R10+174 to maximum Life
R6+33% to Cold Resistance
R6+33% to Lightning Resistance
R610.5 Life Regeneration per second```
The "R219%" makes it impossible to parse 😦
like a forced space after affix rank would do the trick
If it's consistently 2 characters can do your own thing? Assuming there's no R10 or higher of course

R2 + R10+174 to maximum Life
R10 for maximum Life
It's made of 3 spans, can just write a script to get the content of the middle one for only the stat info
The day a tier 21 ES mod exists and only results in 9% Increased ES will be a bleak day indeed
what are you doing to need this?
Maxroll stuff I assume
The PoE 1 Trade API has been non-functional for over 24 hours. Is there any information on when it will be restored?
what do you mean by non-functional? It's been working this whole time from what I can see
Hmmm i got response 403 on any api request and my awakened poe trade not working too
requests from the site itself or some tool?
From my own script that worked for a long time
And if i try to check some item with awakened poe trade it gives error too
The site is working with google chrome but api requests is blocked
so people can import items from trade for comparison and stuff. it works for the most part, but the tier prefixes sometimes mess it up
R10 also works because no leading zeroes, but 11+ bricks it if it's a thing
I guess the problem is two ways to copy stats are broken
- no icon to copy item text
- mouse selects tiers, which is not the case for poe1 trade site
Guys someone now what to do with error "buffer underflow" ?
That happen in jungle ruin act 3 🤔
This is not a support channel, file a bug report on the PoE Forum: https://www.pathofexile.com/forum/view-forum/2214
I'm also seeing 403 errors when using the website API with POESESSID to get stash tab contents with acquisition. However, in an unreleased development version the same function seems to work. I will try to make time tonight or tomorrow to investigate.
Right now the first thing I want to look into is if the release version’s user agent is blocked, because my development version has a different user agent.
I received the full response code with error 403, and it's just a huge HTML page with the message 'Just a moment...'.
It seems to be Cloudflare, but for some reason there is no information about the reason for the block. Moreover, a few days ago after the launch of POE2, I encountered the same problem, and the issue resolved itself after a day. I think the developers are limiting API requests due to the heavy load from POE2
Regarding GGG not accepting new app registrations at the moment, I'm guessing this is the relevant response: https://www.pathofexile.com/forum/view-thread/3616595
support don't handle OAuth requests
oh! I stand corrected then
hey guys i would like try making something akin to path of building for poe2
what is the state of game support?
can we somehow get character build? (if not with oath, at least through website?)
I'm not aware of any way to view PoE2 characters at the moment, even on the website
rumours has it if you ping Novynn 3 times he will grant you access to the hidden API
the promised one
try it 

@compact isle @compact isle @compact isle API pls
is he like Beetlejuice?
How's the API for the Auction Hou... 
Warm, wet, wonderful.

it is very humid today
We do have a discord but current work on it for Poe 2 is being done privately atm
Extremely humid even
do the moon & stars look weird to either of you now?
Yes
Did it work?
Yeah I have access now! Wow!
Damn
Hello 👋
I want to make a tool, not a webapp. I get that I can allow the user to log using the Oauth to do some actions on his behalf, but are we allowed to, like, parse chat logs ?
I believe there's a log file for chat, you can easily detect when someone whisper you, etc.
Reading the game's log files is okay as long as the user is aware of what you are doing with that data.
Oh, I didn't saw that line, sorry for wasting your time zao.
It's a legitimate tooldev question, it's refreshing 😄
you mean asking about weather isnt legit ?
Guys, I suddenly started getting 403 and Cloudflare Challenge responses for any request to the PoE 1 Trade API. The server doesn’t provide any information about the reason for the block. Has anyone encountered this issue? I haven’t violated the rate limits.
can you login with that acc manually ?
or does the trade api just go through api key?
i dont remember
I feel attacked 
I use poesessid, can use trade site from browser, but awakened poe trade and my script is not working
poessessid expires after some time
try getting a fresh one
i think i'm gonna make a shitty little dps parser ahk thing, so i dont have to get the calculator out everytime i wanna figure out bow dps
elaborate? 😄
New constellations and the moon's crescent is near-horizontal. The sun is in the wrong direction too.
oh yeah, you now can see the southern cross
That was one of the first things I tried, but the poesessid on my account hasn’t changed.
well i'm out of ideas then as i didnt do much with the trade api
Also isn't the blood just flowing to your head from being upside down?
I know I'd be dizzy 🥴
I tried enabling a VPN, and the requests started processing correctly. It seems I really got a Cloudflare ban for unknown reasons.
are you setting a useragent?
I wonder if I'm allowed to create a repo with datc64 json extracts
RePoE project stores each version extracted by dat json
nice, so that also means that it's allowed
yes, default line
https://github.com/adainrivers/poe2-data if anyone needs
Something like this was what I was looking for earlier today
it's still wip since the data structures are not 100%
converted using https://github.com/adainrivers/poe2-datconverter
which also generates c# model files for deserialization (mostly)
Where you getting your schema from?
I’ve updated quite a few for PoB that snosme didn’t have done yet
initially from https://github.com/poe-tool-dev/dat-schema but now it's descync, I'll keep maintaining, I have a converter, but doesn't work with deltas, will figure that out later
these are my schemas with hardcoded offsets
I find it easier to maintain
Is the current commit from the current update?
I was hoping to see the difference from 1 update ago to the one out now
Might want to have a standard commit format to know which version too
I'm not going to work on the PoE2 schema itself.
I only added support so people can send PR and view it in the viewer.
pushed the changes 4.1.0.7 => 4.1.0.10
That looks good. Ty for this
My app once got a user blacklisted by cloudflare for violating cloudflare’s own rate limit policies, so those requests never even hit ggg servers. AFAIK there’s no information about what will trigger cloudflare
I was seeing 403 errors myself last night, so I’m hoping to dig into it this afternoon after work.
Hey, Does the PoE API work for PoE2? Or still no update on that?
any idea on how hard it would be to export the key values instead of their index? Would make the diffs much more readable as a bunch of the lines atm are an index change but the content it refers to is still the same
just added that
oh nice
I was just looking at the diffs and trying to see what had changed but it was hard to tell
agree
if you can share your schema findings, I can also add them
I'm working on the quests atm
it's currently in a private repo but I might be able to make a git diff log for it
ignore the isGem tag right near the start, it's wrong and I forgot to remove it
what's width?
just for our exporter gui
time to write a lua parser xD
there's a bunch of tables that I have correct for PoB that aren't in the poedatviewer scheme too. There's also some that poedatviewer has that we dont use so dont have a schema for
mostly poedatviewer was missing some of the labels that I worked out
can annoints be searched on trade?
is there a new repo for schemas now or what is everyone using?
We should probs have one, I've updated the dats for pob a number of times every league and feel bad that it's not in some joint repo
@civic crane made some commit to the dat-schema, i think he's trying to keep them in the same repo somehow?
in poe1 i was editing the json directly and every league i got frustrated that i have to re-merge my changes with the dat-schema ones 😂
Yeah I'd look at the dat-schema and manually change stuff in our repo
Also yeah you can search annoints https://www.pathofexile.com/trade2/search/poe2/Standard/mq9GbkBh6 you need the nodeID though until they add the skill tree to the website I assume
Is there a specification for the loot filter somewhere? like a DSL or something?
oh its allocates # interesting thx
err are they considered enchants?
ok seems so. so corruption can remove it i guess
Hi, i found a bug can i report it here ?
We can't report it ?
Then the link above is what you want
Ok thanks a lot
You can also use /bug in game to report things
Thanks
hm, i assume that the only sane way of accessing PoE trade API requires me to have auth key from GGG?
https://www.pathofexile.com/developer/docs#gettingstarted
and i assume that this is up-to-date and there's no way of getting access to that API at this point, if you don't have an API key already?
i can think of one not-very-sane way of using trade via selenium, but i'd rather not
I believe scraping the trade website is even considered breaking TOS
i don't intend to scrape, i wanted to try making a simple trade macro for PoE2
just do a normal http request like all the poe1 trade macros, no need to scrape the entire website
and for that, the APIs locked behind oauth wouldnt be of much use, since there are no trade APIs there
ignoring the fact that there are no poe2 APIs anyway
There is a resource With all skill tree map and all gear + all posible modifiers... ? Im planning to do something huge for poe communitty ❤️
Or something like pob fork with all poe2 data
we're working on PoE 2 stuff just not on a public repo
secret new pob2 incoming? 🙂
It'll be lua for the when we release it in a couple weeks time then we're looking to move to a go version using a spreadsheet engine to dramatically speed up the calcs
spreadsheets 🚄
why does it have to be lua? 😦 😄 could you also use a modern/nicer UI engine?
"… to move to a go version…"
i missed that part. thanks for highlighting!
I have this one if that helps
#tooldev-general message
Where does GGG draw the line of scraping the trade site? Can I run a script once per day to extract the list of stats from the advanced search stats filter dropdown?
I wanna make a simple UI to ease the process of making weighted sum searches
does this help? https://www.pathofexile.com/api/trade2/data/stats
Damn, lets go 🚀
keep in mind this lists stats that exist (or at least existed at some point ?) in trade, so for example if a unique hasnt been listed yet it wont have the some of those mods, so you may need to refresh the data every once in a while
Thanks! Very helpful!
I'm just realizing however, that I probably won't be able to link the the searches as I intended.
Do we know how the query IDs work?
I can't run my filter through a hashing algorithm to get the ID can I?
somewhat, but just assume they are random, you can just include the json query in the url somehow though
Probably needs to be generated on the official site
if you look at poe.ninja urls they look like https://www.pathofexile.com/trade/search/Settlers?q={"query"%3A{"filters"%3A{"type_filters"%3A{"filters"%3A{}}%2C"socket_filters"%3A{"filters"%3A{"links"%3A{"min"%3A6%2C"max"%3A6}}}}%2C"name"%3A"Stasis Prison"}}
(query parameter)
nothing
Have you worked on something prior?
i have worked (and kind of still am working) on a tool to price check the entire stash tabs all at once, so i know some things around trade and psapi
Aaah I see. Tried a tool or two that did something similar in poe1, but could never keep up mapping to really care about the exalts per second kind of stats
Total value was cool tho
well, my tool was more equipment oriented, rather than currency, maps, fragments and whatever else you can find on poe.ninja.
basically a trade macro but it runs on the entire stash tabs to give a rough price for all the items in it. particularly useful if you have a dump tab and cant be bothered to price check all the great items you picked up off the ground
although when i started working it 3 years ago i made some great decisions that made it essentially impossible, and obviously as a result i gave up on it.
came back to it somewhat recently with much simpler idea though, so maybe in another 3 years i will actually finish it
this or pypoe rewrite, both wonderful projects to do solo, surely i will finish one, eventually, maybe
what do you need that for? you just do a normal query with json in body, and get a list of hashes for every item
if you just want to grab a list of stats you dont even need to do that, its just a static url
though im not sure what you'd want that for, it's of limited use other than to use with the trade api
Haha I know the feeling. Best of luck!
@waxen musk I want to give users a list of stats to pick out and weigh, just like the weighted sum UI on the official trade site.
I just wanna make it a bit more user friendly, so it gives a button for each type of equipment that redirects to the official trade site with the query.
The official URLs look like https://www.pathofexile.com/trade2/search/poe2/Standard/5aWlZ8VUa, so I thought I had to produce a hash like this, but thankfully Piklo proved me wrong 👌
Adding a URI-encoded payload like
{"query":{"status":{"option":"online"},"stats":[{"type":"weight","filters":[{"id":"explicit.stat_2557965901","value":{"weight":1},"disabled":false}],"disabled":false}]},"sort":{"statgroup.0":"desc"}}
onto the poe2 trade URL yields
https://www.pathofexile.com/trade2/search/poe2/Standard?q={"query"%3A{"status"%3A{"option"%3A"online"}%2C"stats"%3A[{"type"%3A"weight"%2C"filters"%3A[{"id"%3A"explicit.stat_2557965901"%2C"value"%3A{"weight"%3A1}%2C"disabled"%3Afalse}]%2C"disabled"%3Afalse}]}%2C"sort"%3A{"statgroup.0"%3A"desc"}}
and works alright. The sorting is broken though.
Does anybody know if the sorting has never worked? I've noticed the URL doesn't change on the trade site when changing the sorting to begin with. So maybe sort has never been supported in the URL?
Sorting by clicking parts of the results like item level, particular mods, and things like that are to my knowledge only reordering your result set. Edit: I don't know enough about this.
pretty sure it doesn't as I managed to get timed out by sorting by clicking on stuff on an item and the listing time before. Conjecture being it does some sort of additional fetch
I took a look in my browser inspector and noticed there were more requests with additional fields made when sorting, but noted that they're not captured by the memoised URL slug.
As such, I adjusted my answer to: 
Fair, I'm also most likely talking out of my ass. Just remembering that I got timed out a few times because I dared to sort too much haha
This currently has a one minute cache; I'll probably increase it to 5 or 10 at some point just for sanity's sake
jfyi
@fossil basalt from memory, initial sorting via the url was never implemented, and is waaaay down low on the list of things to do (i asked Novynn about it a while back)
Anyone know a solid fix to crashing? Generally happens more often when partied up with others (specifically 3+ players I believe)
You might want to remove the index from the output unless there’s a way for the diff to exclude those values?
this is not a support channel, try the forum or email GGG support
any idea using javascript String.replace #% increased [Evasion] and [EnergyShield|Energy Shield] into #% increased Evasion and Energy Shield
I use this for PoB gsub("%[([^|%]]+)%]", "%1"):gsub("%[[^|]+|([^|]+)%]", "%1")
.replace(/\[[a-zA-Z '\-]+?\|([a-zA-Z '\-]+?)\]/g, '$1').replace(/\[([a-zA-Z '\-]+?)\]/g, '$1')
err, need multilang support
.replace(/\[[a-zA-Z '\-]+?\|(.+?)\]/g, '$1').replace(/\[([a-zA-Z '\-]+?)\]/g, '$1')
does GGG have an exposed (public) endpoint for poe2 (yet)?
OAuth works, use poe1 OAuth api
I ended up using a nasty
.replaceAll(/\[\w+\|[\w ]+\]/g, (substring) =>
substring.split("|")[1].slice(0, -1)
)
.replaceAll(/\[\w+\]/g, (substring) =>
substring.slice(1, -1)
)
Yours is nicer
for now I’ll keep them, they are really helpful to figure out refs
Do you know why those tags are in the stat-texts to begin with?
For KeywordPopups
Anything bracketed is going to be a link in the tooltip system.
how do you tell spirit gems apart from normal ones? they have the same CraftingData, mostly the same tags etc
is there a flag im missing?
oh i see they have OngoingSkill type i guess
if it's working for you, then it clearly isn't down
also weird place to ask
oh, filterblade i guess
well, works for me
Aah, of course, thank you! 🤦♂️
Hi! When I find a unique item in Poe2, I would like to know if it's worth anything without having to write their names into the trade site one by one. Does anyone know if there is an existing solution for this problem?
Hi! When I find a unique item in Poe2, I
Hi, is it possible to parse poe2 .ggpk with PyPoE from PoE1?
Maybe someone have correct data scheme or any advices how to make it work?
ye I saw it, but its only data in eng
added localized versions as well (only for .dat files for now)
bug. if I make a normal stash tab premium and name it. it doesn't show name
Not a support channel, forums or ggg support are what you're after
Probably just have to relog if you purchased it while in game
lmao, was browsing the ggpk and was in the class illustration folder
(this is the huntress file)
oh indeed, they werent there before 😄
uh oh, i'll refer u to our HR officer, CDR
what i say to my clients every friday :
nah most likely one of our colleagues cursed the client for too many edits and complains so yeah.... HR
Read the channel description, this is not a support channel. Post in-game issues on the forum or contact GGG support
sigh fine, you got a point
is there a way to determine the mods that can/cant roll on the normal base and Advanced and Expert versions of the bases in any of the data available?
i dont see why they would have different mod pools
thought the higher ones cant roll on the normal base, but might be mistaken, is it ilvl dependent then ?
probably
ok i'll take a look around
do you know if there is a way to authorize a new application with GGG for oauth?
they dont accept new app registrations because they are busy, so highly unlikely
thanks
@velvet fog https://poe2db.tw/us/Uncut_Skill_Gem#TierLevel only has tier through 14, could you possibly extend that out through 20?
the page you're looking is off by one
1 = 0
2 = 3
3 = 6
4 = 10
5 = 14
6 = 18
7 = 22
8 = 26
9 = 31
10 = 36
11 = 41
12 = 46
13 = 52
14 = 58
15 = 64
16 = 66
17 = 72
18 = 78
19 = 84
20 = 90
or is that different? these are normal gem level requirements
fixed
20 is req level 90? 
ty, would you happen to have the droplevels of each tier of uncut?
The drop levels are in uncutadditiongemtiers with each area level being able to drop a few different tiers with drop weights for each tier
ty
heya. I'm totally out of touch with POE2 and I was wondering if there's been any discussion of GGG providing a skill tree export or the in-browser skill tree for POE2
not atm
everyone is having to create their own scripts to extract everything from the game files. I think maxroll has the most complete tree atm. We're in the process of building one for PoB
dont really use opengl but this is interesting, are those just artifacts or are they actually drawing over a dozen quads for a single arc?
Haven't looked at PoE2 yet, PoE1 used to do tristrips for orbits but I guess these are more spline:y?
gotta love math. super interesting, thanks for sharing
@velvet fog was looking for totem skil gems (https://poe2db.tw/us/Gem#SkillGemsGem) filtering by Totem tag and it wasn't finding https://poe2db.tw/us/Ancestral_Warrior_Totem for some reason
fixed, 12 gems in meta skill gems not included
thank you! ❤️
Is there a way for me to search poedb2 for anything that affects Limit ?
this is a mistake with premultiplied alpha accidentally introduced recently, will be fixed soon
Oh, thought that was about the game client.
it is a fair bit of quads though 😄
thats awesome, you guys got it out pretty quick. congrats. super curious what your shader and math looks like, might have to actually check the source for once
Would you like some psychic damage?
Who doesnt love some good mental instability. You working on a version zao? :O
Nah, just looking at what I could improve in SGv2 for PoB.
I did tristrips in a branch for PoB with 2D meshes in the past when the connector art changed, but never landed that.
When I was just messing with the poe1 tree without knowing opengl or glsl, I used trifans on my first attempt as a simple way to just draw the arc connections between each node, 4 triangles max. Now that I think about it, that was probably a lot more inefficient because of all the extra pixels compared to dozens of quads that has a quarter or less pixels
The current PoB orbits uses a kite-shaped quad for each quadrant the connector covers. This with the old art which doesn't have multiple pieces of connector art in a single texture.
The new style would be quad-strips much like the game, at not much performance cost if you cached them on the C++ side.
You piqued my interest, now I wanna try remaking it. Love the debugging how clean the arcs are
shader is as simple as it gets, just drawing textures with some basic color math to support desaturated icons
idk why i thought you might be doing the arc math in your shader but that doesn't make any sense now that i think about it. why recalculate all the points for no reason.
i appreciate you both for humoring me
Depending on how fancy you make things, doing a bit more work in shaders could be a viable approach if it lets you keep the CPU side more immutable and do less work. Another reason could be to trade more arithmetic for less memory use.
If you're willing to use less assets, you could probably even do procedural connectors.
Shader arc math seems to have a decent amount to it, although even a couple tens of thousands of extra calculations every frame is probably a joke to it. Memory is kind of a joke too though, even if one arc is like 1kb, couple thousand will only be a few mb? Procedural sounds like more work to me but I almost feel like with shaders could get it to look cooler, not official look anymore tho. I didn't get to do a bunch of math in school so I always have to spend extra time figuring out what I need to be using, probably a joke to those who know exactly what to use right off the bat tho
For the particular case of PoE skill trees, the approach tends to be fairly common and well-defined. Just musing in a more general case, particularly if you start needing animation.
Is it called something specific so I can look into it more or do you mean the approach is fairly common arc stuff and is already well-defined
You may not necessarily do it for arcs, but line drawing in general can do some neat things, and the poster child is of course particles.
I see, ty again for all the help
Hey, hello everyone i have an issue with a map. I can't come inside i'm always disconnected.
I have lowered my graph but same issue
i have a pretty big pc ( 4080 etc .. ) so i might think it's a game issue
Report the bug on the forums
oops sorry im doing it
it should show that all together in a nicer way
i think discord has a bad UX in that regard. in contrast to IRC it doesn't show the topic/title on join. and also if the discord window is narrow enough or on mobile, the title just vanishes.
that would make sense why there's been a lot of people lately coming in here and not realising this is not a game support channel
Hmm, fun times on 5-linking gems with vaals - My one friend five-linked three in a row, I got one after three tries, and my other friend has been trying to get two, and got 18 nothings, 1 +1 level, 3 -1 level, 4 -1 socket, and one success
Hey guys, I made a POE2 DPS calculator and want to share it with the community 🙂 Im new to poe and I dont know where is the exact place to do it, so I just start here
I'm in another discord where there is a dev channel, they stopped it by making a role which you can get by linking your github acc to discord to write to that channel
how are the hashes (or numbers) on this data calculated?
https://www.pathofexile.com/api/trade2/data/stats
Hey guys, I made this which further break down EA ladder data, planning to update daily until full release If possible.
(Didn't know where to post, but found this place. xd)
- Sortable by classes of each league.
- Class/Ascend popularity percentage of each day.
What is OC and OA? Can you add what they are to the site? Otherwise looks great. It displays the information I was interested in, class as a percentage of users and then ascendancy percentage of that class.
Those mean % of class and % of all, lacking of better word. I'll add a definition on bottom. xd
I'm attempting to edit neversink's filter for my purposes, is there a way to filter uncut gems by level?
I did some trade site stuff, and found out item level works
suggest asking on filterblade discord, this isn't really the channel for filter editing
Fairly on-topic about filter syntax itself tho, especially if you're hand-editing.
Path of Exile 2 will be exhibited at the Taipei Game Show on January 23, 2025
Timeless Jewel back in PoE2
it would be kinda nice if "Empty rune sockets" equipment filter on trade search were instead "Full rune sockets", so that it would be possible to search both items with empty sockets and for items that didn't have rune sockets but that you could add sockets
that, or just count potential rune sockets in "Empty rune sockets"
or eventual search psuedo mods I suppose
does this use an api or do you scrape the page?
a speaking of filter. is there a DSL or some other schema type that describes the filter language?
it's a internal-api https://pathofexile2.com/internal-api/content/game-ladder/id/Standard
@lone ingot weren't you working on a small local filter tool, any chance this is usable for poe2?
i think a syntax extension for vscode would already help a lot
I guess no one made the effort to write that down publicly? and filterblade isn't open source
but do they also check syntax? I think that would be more important so the filter file is valid
oh, you want to syntax validate. no, probably not
Daily copy, I don't think they have an api for historical data rn.
i have very big issues with the loading screen nowedays anywhere in poe, even the monsters are not loading correctly and they attack me without that i see them. what i did so far: testing my cpu alone I5 9900k no issues, testing the GPU alone 6900 XT no issues, testing my DRAM no issues. Reinstall windows 10 and also 11 no difference. the Loading screen is still very long and my CPU usage is at 100%. i changed some settings like turning Game Bar off, Put the PC on Balance, edit the Graphic settings in POE and still i am at 100% usage. my friend said it has to do with the 16 CPU lanes and my PCI 3.0 and that my M2 are using 2-4 lanes of the CPU so the GPU only has 12 lanes that communicate with the CPU. i dont think thats true because 3-4 months ago i had no issues. i also use a Mortar mag Z390 mainboard with newest bios. if anyone has an idea what i can do to fix the CPU 100% issues and loading screen and loading monster problem i would love if you can write me here some suggestions or pm me. thanks
It's a common problem. And you can read that on the forums where this belongs, not the tooldev channel.
yo folks, is there a resource i can take a look at to see how (poe2) tradesite links are encoded? 🙂
could you send me a link to that issue? that would be amazing, and well i havent found another channel in discord for issues 😉
you mean this? https://www.pathofexile.com/trade2/search/poe2/Standard/9KdaZmzUK
pretty sure its just a unique id, no way it can contain all the random stuff i entered in filters
yes, that's what i mean! maybe my question is phrased wrong, and perhaps i'm asking for the wrong thing entirely so i'll try to rephrase:
On poe.ninja when i'm looking at a particular unique item, there is a button to search for it on the official trade site. Clicking that button redirects me to this
(i know that it's a link to the poe1 tradesite, but the question remains the same)
what i'm curious about is how does one know what to set these parameters to such that actually becomes a working link to the tradesite? i'm asking because i would to try to emulate what other trading macros do where they can copy an item ingame, do some magic and eventually get such an url
You can set the filters by doing a POST request to https://www.pathofexile.com/api/trade2/search/poe2/Standard and in the response it will contain the ID.
ah, that explains why my trade tabs break when the servers crashed / restarted earlier today. then the ID is probably no longer cached
i think the IDs are static, i just tried to run the same query as i did before the maintenance and it returned the same ID.
they are static, but a) expire ~90 days after not being accessed b) can be purged at any time, so don't rely on them being there forever
oh, good to know. I guess if you try and access a purged/expired ID, it returns a 404?.
the URL doesn't return 404 iirc, but it redirects to the root /trade[2]/search/[league]/ with a "Failed to load search state. The search is no longer valid." error message
soon tm
been enjoying endgame (similar to NeverSink haha), my plan was to clean things up this week as I figured there was a bunch of hidden items
probably one last big refactor and then it'll be usable, plan is to open source after that
I am just using a manually written filter right now and honestly poe2's item simplicity (right now at least) is making me think the minimal approach will be suitable
yeah personally I am just looking for a simple ui to create a filter, change rules based on copy paste from an item and an index of available items by groups, e.g. all int bases
anyone that knows the windows and linux APIs in rust want to work on an auto refresh feature? 😛
I have some basic code that can tab in and run the command to refresh on windows, I need to make it more dynamic tho
can anyone here help me get my account unlocked?
not a support channel, you need to contact ggg support by email
i have been for over a week and only got 1 response
they are probably very busy, this channel is for tool developers and won't be able to help you
I'm generating rules with Excel and managing the structure by hand
NeverSink says he'll start FilterBlade work tomorrow
the best programming language (excel)
hard to beat for quick data munging
Haggis seems to manage the data for filterblade in Excel too
yeah filterblade would help, but tbh I prefer something simpler and optionally local
I was looking at the in/out of filterblade and my assumption is there could be some level of interop with what Im doing
not planning for it as an initial feature, in theory though bc of the x -> y -> z syntax in fb it's interpretable
So there is currently no way to access stash/trade info in PoE 2 that isn't against the rules, correct?
hope you don't mind the tag @civic crane but I had a Q about the pathofexile-dat lib if you have a spare second. is it possible to request an extract of all images/sprites without specifying them in the config.json?
Yeah, I can add all sprites extraction,
maybe someone knows a better tool for exploration purpose?
I really just want to dump only the imgs and sprites that are mentioned in the tables Im looking at (BaseItem + ItemVisual), I don't mind if it just dumps all and I have to manually filter locally
really the logic could be if path ends in ".dds" then extract while walking the file tree, figured Id ask in case it was an easy thing for the lib to do 😄
Has anyone seen an OAuth API reply with a 399 response before? It looks like a redirection message, but not one of the standard ones. (This was in response to one of the HEAD requests I make at program startup to check rate limit policy state).
probably a @compact isle question?
that isn't a response code we'd return
Could it be cloudflare?
that'd be my guess
though they don't report sending any either
you're still using Qt right?
Hmm, I remember getting a user blocked by Cloudflare for sending 2,000 head requests (one for each of their stash tabs), but there wasn't much error information to go on.
https://doc.qt.io/qt-6/qnetworkreply.html
QNetworkReply::ProtocolFailure 399 a breakdown in protocol was detected (parsing error, invalid or unexpected responses, etc.)
Yes, on Qt6 right now
Thanks, I'll add checks for that. The user was able to use POESESSID. Hopefully it is an intermittent error.
the site has been various states of alive recently
Love non-standard response codes
The website being up and down would probably do it
I also had to file a bug with Qt because their OAuth implementation wasn't compatible with the poe api, so I was worried about that as well.
Devils advocate, isn't that likely because GGG is not following proper OAuth specs? 
(I don't remember from the top of my head if they do or not)
I don't think so. I rolled my own oauth flow directly from the spec
I'd be more likely to suspect qt
I gotta defend my scandinavian brethren
poe requires all http requests to be made with the user agent, but Qt 6.8 won't let you set the user agent on some of the intermediate requests
Qt is adding a hook that will fix this in Qt 6.9
I hadn't done any c++ or Qt coding before taking over acquisition, but I'm kinda fond of Qt now 🙂
thanks for the help
I still haven't put a swedish flag anywhere in the office, I need to get on that
kind of funny, staves with no skill
seem to actually have no skill, not a trade site issue
isaw that there is a poe2 awakaner ""child"" project came out for beta , does anyone know if its trustworthy? https://github.com/Kvan7/Exiled-Exchange-2
Taiwan realm trade2 has not worked since day one, support said they would forward it, but there is no fix. Hopefully it will be fixed before Christmas.
@velvet fog https://poe2db.tw/us/
I know that i can check the POE1 MTXs that can be applied to POE2 in the current Theme topic. By the way, can you make a page where we can check all the applicable MTXs on one page instead of checking all the Theme one by one? Or is it already there?
PoEDB provides things come out each league, as well as items, uniques, skills and passives. Path of Exile Wiki editing functions.
https://poe2db.tw/us/Microtransactions
Thank you!! I checked that it works!
bun has a regex mode that l think does what you want - e.g l extracted all translation (.csd) files from my steam install to a folder named '0.1.0d' with the command ./bun_extract_file extract-files --regex 'C:\Program Files (x86)\Steam\steamapps\common\Path of Exile 2\' 0.1.0d "^.*\.csd"
not sure why l used ^.* but whatever
Regex mode indeed does what you desire, instead of extracting literal paths it tests all paths against the given patterns and lets them through if any pattern matches.
I should cut a release some day, improved directory creation logic, memory usage for full file extraction and allocator churn the other night (https://github.com/zao/ooz/compare/master...zao:ooz:feat/faster-extract).
That should have been what you did day one, disappointed
Ayo, lily and zao both work for GGG now? Congrats!
Thanks!
Understandable really
that's cool, I'll take a look. for ref this is something that needs to happen in ci so I can package them with an app, been trying to work out the simplest way to do it that wont run forever in github actions 
I think FilterBlade pulls item images off of trade (as does poeninja), pulling them out of game files is probably more ideal
and won't run into some of the weird bugs
I have tried via cdn and via gamefiles, cdn is more reliable but slower unless I optimise it to be more than a naive for loop
just wanted to work out alternatives before I commit to doing batched async calls lol, the files being right there locally feels like it's the correct thing to do
it's for poe2 right? repoe already extracts item images for poe1 https://repoe-fork.github.io/Art/2DItems/ but l haven't updated it to do that for poe2 yet (in theory it shouldn't be too much work but l haven't got to it yet)
my main issue atm is due to it being EA and the game files are kind of a frankenstein of poe1 and what I am assuming is new technology to obfuscate the unique art
repoe2 would be cool, it's nice to be able to refer new dev to repoe
I tried looking at in preload and saw a bunch of AERT1TW-Unique looking files for the art
uniques are the one module l have ported to repoe2 (was asked to for the wiki) https://repoe-fork.github.io/poe2/uniques.html
ooh that's cool, yeah honestly I will probably use repoe for uniques if you do update it
very nice, I had to scrape from trade the old fashioned way 😅
I can't found stash tab background image, anyone know?
i was wondering why my not %inc armor filter didnt work, and i guess there are 2 of that mod?
missing the (local) suffix that trade1 has
that list seems to be missing all of the unique relics btw
conversely it had a couple of uniques I had missed
it looks them up using uniquestashlayout.dat, which afaik is the only way to link unique art to item names - l guess relics can't go in the unique stash tab?
I wonder
art\textures\interface\2d\2dart\uiimages\ingame\mtx\currencystash\currencystashbg.png
the layout is done manually, you can see the location in the json https://github.com/adainrivers/poe2-data/blob/main/data/currencystashtablayout.json
I expected a static background, thank you
ctrl + alt + c isn't a thing in poe2, do we know whether it's intentionally removed or bug/todo?
Hi im new , this is my 1st time i do with api poe , how to get started to be able to fetch api to find an item. I find
https:// www.pathofexile.com/api/trade2/fetch/4d6de306f....xx?query=K7XZZd6S5&realm=poe2
, How can I find the item id?
See this chain of replies: #tooldev-general message
thank u so much
depends on your definition of allowed
generally, there's a line about reverse engineering in tos, so it's not allowed
unless you get written approval from GGG
buut, use of internal apis isn't exactly something anyone got banned before afaik anyway (not a legal advice)
I guess what I meant was, was this link ever meant to be shown in public. xd
what are they gonna do, it's used internally, they gotta expose it to use it
Yeah no biggie. I was just putting things together, and using it was more efficient.
did trade site go down or did I get rate limited lmao
getting 502 bad gateway after messing around in postman a bit
If you were rate limited by GGG it will show up in the http reply headers.
(If you are rate limited by cloudflare there’s no way to get any details afaik)
does catalyst quality (i.e. "mana modifiers") affect entire mods, or specific stats? i cant figure out what table the values in AlternateQualityTypes point to
ah it seems to be whole mods then
that makes things so much more complicated since i have to know what mods are on uniques 
as per usual, have to look what interacts from 3rd party site
when sending POST requests to https://www.pathofexile.com/api/trade2/search/poe2/Standard do I need to set anything other than the User-Agent in the header?
cookies
i'm fairly new to this so forgive me if anything i say sounds cooked. is that the POESESSID i would need to set?
yes
not sure if you are supposed to use that api tho, since it's probably internal use only
works without sessid for me
just dont overdo it, its very easy to get timed out for 30 minutes. 10 second interval between searches is generally enough
not sure if you are supposed to use that api tho, since it's probably internal use only
yeah I wish they'd be more clear about that. I've assumed that using that API outside of the trade site is bannable.
with no poe2 psapi it would be nice to know if we were allowed to use /trade2 in the meantime
(almost?) all trade macros use /trade in poe1, I don't see why it would be bannable in poe2
it's just internal and undocumented api, subject to change at any time
they are pretty clear about use of internal apis, it's against ToS to use them
they just never enforce it
so you don't see why it would be bannable, yet you say it's clearly against ToS?
I guess that exactly explains why I wish they would be more clear.
again, they are clear, it is against ToS, but I don't see why it would be bannable because it has never been enforced before, up to you to decide whether you wanna risk using it or not
most things are tolerated but not explicitly allowed
I have noticed a peculiar pattern for the raw data. Many of previously data-full dat's are now 12 bytes long...
ERROR failed to parse dat file error="failed parsing dat file: invalid row count: 0 (file size: 12)" path=Data/PassiveTreeExpansionJewels.datc64
ERROR failed to parse dat file error="failed parsing dat file: invalid row count: 0 (file size: 12)" path=Data/PassiveTreeExpansionSkills.datc64
ERROR failed to parse dat file error="failed parsing dat file: invalid row count: 0 (file size: 12)" path=Data/PassiveTreeExpansionSpecialSkills.datc64
ERROR failed to parse dat file error="failed parsing dat file: invalid row count: 0 (file size: 12)" path=Data/AtlasNode.datc64
ERROR failed to parse dat file error="failed parsing dat file: invalid row count: 0 (file size: 12)" path=Data/AtlasNodeDefinition.datc64
And at least one I expected to still exist does not:
ERROR failed to open dat file error="open data/componentattributerequirements.datc64: file does not exist" path=Data/ComponentAttributeRequirements.datc64
anyone know the default poe2 ports?
None as far as tools go. You may want to look at the third party policy (https://www.pathofexile.com/developer/docs#policy) and consult the ToU.
If you have some questions about whether tool ideas may be feasible or not, people here may have some opinions.
12 bytes long files should be considered as empty tables. They contain 0x00 dup (4) and 0xBB dup (8) The former being number of records and the latter serves as separator between fixed-length table data and variable-length part that would hold strings and arrays
Not sure which tool you're using, but it looks like their devs didn't provide support for empty tables
Exiled Exchange drives me nuts - idk why I'm getting this error
Website more down then up, seems like a feature to have it working at this stage
needs to check if the page is actually online 😄
a lot of tables from poe1 are still there but empty because the mechanic is not present in poe2
so theres no cluster jewels for instance
it definitely was
its now just called AttributeRequirements
that reply is when the page is down. you get the openresty error instead of the json response
the website is up now and still getting the same response - no idea what im doing wrong
Every tool will break right now since the APIs are behind cloudflare challenge
Sidekick, Awakened,PoE-Overlay, etc
Official Trade API down. I hope its not because EE2 stress tested it and CF Autostopped it.
I'm the creator of Sidekick, so I'm looking for more info on this change. Not sure if it's intended and long-term or a mistake on their end.
4 Years ago, Ben said its because of too many API requests which where 50% of their Bandwith. I hope its not the same this time.
50% that's an insane amount if true
Are there any other dat editors other than https://snosme.github.io/poe-dat-viewer/ ?
visual ggpk2 used to show them but i dont think it works anymore unless someone updated it to support i16 type
PoB has one in the exporter
and yea theres tons of different tools to extract them i suppose
PoB is not doing well for me right now 😅
but if your only issue is showing empty tables, then just ignore them i suppose?
yep
I have these, still wip, https://github.com/adainrivers/poe2-datconverter https://github.com/adainrivers/poe2-data
oh yeah same, I use ImHex but that's still slightly painful
not an editor tho
i also forked dat-schema, idk if theres any movement to get poe2 types into the main one
https://github.com/d07RiV/dat-schema-poe2/commits/main/
yeah these are converters, what do you use for mapping? I have my own converter and data dump: https://github.com/Vilsol/go-pob-data
there have been poe2 in for a while
I'm using 010 editor, the converted has the ability to dump raw data, like this
oh yea they got some types now
yep, I'm using those so I'm contributing to them
i suppose i should merge my changes
would be nice if you have stuff they are missing
or you can check mine, i have all the tables i use for my tools converted
ill take a look
I'd very much appreciate if the changes were in just the main repo
any chance the repo could be changed to run the build script directly instead of compiling it first?
wdym why?
to skip the step where you build ts into js
since theres no dist folder in the repo
i mean i changed the generate script to tsx src/cli.js, surely thats much easier no?
idk you'd have to talk to @civic crane but makes sense considering --experimental-strip-types and --experimental-transform-types are now a thing
then don't even need to invoke ts at all
i just dont see the point of compiling ts to js these days 🤷
unless its for web deployment
eh, mostly for bundling
@waxen musk what's your use case for running generate ?
to build the json
how... do you parse out info here... wow.
@civic crane https://github.com/poe-tool-dev/dat-schema/pull/89 added a bunch of types
Whats everyone using to fetch spirtes they need from the game?
if you mean item images, two approaches; from game files or from cdn via trade site
any other sort of image, game files
search this channel for "sprite" or "image" and you will see many methods. basically it depends what/how you are using them. there's also a few different types of image formats, e.g. I did this for flasks/gems in poe1 #tooldev-general message
its just some icons that need to be composited from multiple parts. but in general you just use whatever you like to load dds format
well, maybe. I just think noone runs the script except gh action 😄
If you don't mind running on wsl, I have a thing here to pull out dds files and convert them to pngs using imagemagick https://github.com/adamthedash/poe_data_tools/blob/master/test.sh
Haven't tested it yet with the poe 2 files but should be the same I think it still uses the bundle format
Alright, well, after the new shit, I have only 5 broken dat's
ERROR failed to parse dat file error="failed parsing dat file: unable to parse format definition for Mods.datc64: Missing \"type\" property in field \"HASH16\"" path=Data/Mods.datc64
ERROR failed to parse dat file error="failed parsing dat file: error reading field VideoClip of row 0: string offset too low (-101010101010102)" path=Data/ActiveSkills.datc64
ERROR failed to parse dat file error="failed parsing dat file: error reading field AchievementItems of row 0: array offset too low (0)" path=Data/PantheonPanelLayout.datc64
ERROR failed to parse dat file error="failed parsing dat file: unable to parse format definition for MonsterVarieties.datc64: Missing \"type\" property in field \"HASH16\"" path=Data/MonsterVarieties.datc64
ERROR failed to parse dat file error="failed parsing dat file: unable to parse format definition for PassiveSkills.datc64: Missing \"type\" property in field \"PassiveSkillGraphId\"" path=Data/PassiveSkills.datc64
looks like some changes have seriously broken stuff
Mods.dat are fucked beyond belief
I think there is a lot of obfuscated stuff now, maybe related?
also any idea what's happening with trade?
https://github.com/adainrivers/poe2-datconverter/blob/main/src/Generated/Structs/Mods.cs
works more or less fine
lots of unknowns and untested stuff tho
What are you guys using to read bundles inside ggpk files nowadays?
I'm using https://github.com/aianlinb/LibGGPK3
Ah, same as I did I suppose
it has a problem with 5 entries being null and throws by default, I commented that out for now and works fine
based on my old code or something else?
the oodle DLLs, which one did u opt for?
LibBundle3 uses oo2core
Somebody had a relatively functional pure rust implementation of the ooze/oodle shit
Extracts data compressed in the Kraken, Mermaid, Selkie, Leviathan, LZNA, or Bitknit formats.
Ah, perfect
I think this is different to what I was using, which I forgot completely where from
snosme has quite a few nice things for ooz, incle a wasm binding for it https://github.com/SnosMe/ooz-wasm (which is used in those above links)
which is not a good thing
if you prefer dotnet I can add you to my extractor repo
I got an implementation in PoeSharp 🙂
true forgot about that 😊
But because I mostly sit in meetings, powerpoint and visio all day, I wanted to do some coding
and me coming back to poe, it's a good thing to tinker with, among other things
been tinkering with these things for, i dont know how many years now, on and off
it's always fun
shouldnt be, mods work fine forme?
i didnt even change ActiveSkills in that commit
PantheonPanelLayout.AchievementItems is indeed not an array, can fix that if you want. im not getting errors on fields im not accessing so idk
god I really hate that we have 10 different people working on the same problem... defining a schema
yeah that was my fault
Kinda feel like it should almost be wiki-like, vs central pr type stuff
Format for it is like... who cares
the easier to digest the format the better for everyone
I think the dat-schema way is probably best as it allows for a lot of flexibilty, and compiles down to raw json
Has anyone tried containerizing poe-dat-viewer so it's easy to run locally with a WIP schema?
I actually asked multiple times, both here and in dm how to contribute to dat-schema, because I already have a converter which converts those schemas to mine, but I didn't get an answer so I did it my way
I could take a stab at that if not
not entirely sure how a container would help here
being able to run it with a dir mounted to feed your working copy of the schema in
not necessarily talking about the fracturing of definitions
just something that came to mind
you mean use the container so you don't need nodejs on your system?
"@types/node": "^22.0.0",
"graphql": "^16.7.1",
"typescript": "^5.1.6"
I mean I also don't want node on my system so I'd put it in a container anyway
as bare as it gets imo
I've recently taken a keen liking to devbox https://www.jetpack.io/devbox
being on NixOS this works pretty seamlessly, but it works on any 'nix
Re: splitting the knowledge, it might be interesting to write one parser that can slurp all the disparate definitions into one canonical format and compare/translate definitions so it's easy to "import" work from one repo into another
Trend toward convergence instead of divergence
insert xkcd
but yeah, that seems like a possibility
I mean I would just use dat-schema's format as the canonical format there if it were me
It's not like the formats have particularly complicated grammars or anything lol
I think the repoe way is my least fav, as the ordering is enforced purely by order in a json object
and json object fields are not meant to be treated as always to be parsed in the same order
Gross, yeah, that's why kubernetes and other yaml-heavy things tend to use lists of objects with {name: "foo"} in them
it's almost like we shouldn't have used ie5's idea of valid javascript objects as our universal object notation ;)
which even JSON RFC says to not do
(iirc no trailing commaa was from ie5)
repoe guys are walking an-optimization-away-thin-line of having all their shit break
I like how golang updated maps to be explicitly randomized to make it so nobody could depend on the order in a way that implementation could break
mhm
Also, jsonnet sorts maps on output as it is designed to be deterministic
fuck it I am writing a comparator between dat-schema and pob
I see poe-dat-schema has some schema definition controls if you select a column - Seems like a partial implementation unless I"m missing how to set the target table of a foreign key or foreign key list?
Someone got a datatable of skills?
*gem*.datc64
Now if you want proper JSON funtimes, parse PoE .hideout files 😛
For anyone not familiar with the file type, hideout decorations are held in an object, keyed by decoration hash.
Got at least two instances of a decoration? Duplicate keys.
Many JSON libraries take the ergonomic route and maps everything to sorted or unsorted dicts in their host language, which won't handle this case well at all.
For my WIP hideout editor I had to run nlohmann's streaming SAX parser to get the data out intact and in order.
I forget what I did for the small Python helper library I made, but probably something along the same lines.
Where is the link stored between an item (be it BaseItemClass or ArmourTypes) and the Mods it can roll?
goldmodprices
wait the hideouts are xml?
ah
Oh right, it's worse than I remembered, it's keyed by name, not hash.
I think I tested at some point in time whether those were localised or not, but have thankfully repressed the information. I think the hideout name is, at least.
I found the source to my old Python library for hideout wrangling. Turns out it's just wrapping my C++ library 😄
I think the skill_stat_descriptions.csd has a duplicate key bleeding_damage_on_self_taken_as_fire_instead
1st one is "You take Fire Damage instead of Physical Damage from Bleeding" and second one is "You take [Fire] Damage instead of [Physical] Damage from [Bleeding]"
my bot that scans and watches forum updates is also seeing a 403 now 🥲 (for the past 5 hours)
Guys, how can I avoid grabbing my cookie session token every time it's expired? I want to make a request for something and the session id keeps expiring
that took longer than it should, however, enjoy
(download and open in browser)
example
The fifth dat schema is about to be produced
Neat
Bump
Oh nice. I’ve added/mapped out a bunch of columns in the past so is nice to see what poedatviewer didn’t have yet
I have a table that has all the currently attainable gems with filtering for a bunch in the game files that are not currently used
repoe reads the dats using pypoe, which generates the schemas from the json in poe-tool-dev; the sekhemas in that folder just specify the output format of the processed json
sekhemas ^_^
also does anyone have an opinion on this https://github.com/poe-tool-dev/dat-schema/issues/88 ?
hi can i get some help with Jamanra boss please anyone
zao@dagur:~$ curl -sL https://github.com/pale-court/dat-meta/raw/refs/heads/main/global.json | jq '.builds|length'
889
Groups are nice when you know what goes where; somewhat frustrating until that point.
Need to click that Data tables button and preload all of them
Welp, no VR mode for the Model Viewer I guess 😄
(not that I'd ever finish the tool, but still sad)
Hide
Quality = 0
AreaLevel > 70
Rarity <= Magic
Class "Flasks"
BaseType != "Ultimate Mana Flask"
does anyone know why the game cant load the lootfilter?
Im getting No base types found matching "!=" arent ultimate mana flasks base types? (Poe2DB says they are)






