#tooldev-general
1 messages · Page 56 of 1
hope so. i'm currently debating if i should get a unifi pro switch, because it's rack mountable as well, and get a couple of blade servers in a tiny cabinet next to the desk here
perhaps later
Here comes the energy, i can feel it
https://www.pathofexile.com/forum/view-thread/2036673 why does that list "Lightning Tendrils" as a new item?
internally it's probably a new gem, like what they did for the other reworked gems
might be an oversight to include it on there
Did he just post the filter/data stuff at 13:37 NZ timezone?
Are there any Path of Exile specific discord bots (like a price checker bot)? I apologize if I've asked this in the wrong channel.
somebody was working on a unique item bot
The problem is formatting
Discord doesn't have any good formatting for a unique item bot
the trick is doing what some bots do and generating images on the fly of the item
render to offscreen CEF context, save as png, upload
or some other html renderer
those Discord LevelUp bots do something like that
where they grab the user's avatar and do some drawing with it
you wouldn't get text though, which could be a problem
could link the wiki page though
oh embed instead of upload
interesting
maybe the poe wiki can be modified to support discord embeds when linked to an item page
and then a bot can just post a link to the page
otherwise someone will have to host their own database
Yeah preferably hosted on the bothost, although doesnt really matter but
I have a discord bot that evaluates C# syntax and compiles it in a docker VM and then builds it and returns the result in an embed
I dont per say
I protected a few namespaces
Docker restarts if its too heavy or if a friend tries to do that
It's in a contained VM so i dont really care
@polar island it should be part of the type line still
hope a pre-download torrent today
and i hope you tear it apart asap
I'll confirm that though
@polar island confirmed
what about them?
still in the typeline?
yes
There are 2 types of people in this world:
- Those who can deal with dirty data
- -fJ�rԤ�(��{S-�:#��[Z欘S�!�ڏm��%��c&�(��g0w�-zж�88 oKak�
f8H�]g<Mm���GNàE&d8�\�&&:=�y��I�N%8s����+݃���(��R��=հDUe����X5�-�'k=��r�
Z�z�,��]�vCQ�L��
�>�s�'�i1<�ڥ6z��M�[u��3I[����_�.��?���{���w����Ϋt�u4����җ��qG���y���ѭK-֒G�`l���m��n�䅵�F\fW#���]��:ar�� EC������f�s��eh8�^��B�-�
@compact isle Is it possible get a clean type line, or provide itemclassid in stash api
because it's really dirty right now, the only way to get itemclassid is parsing the image icon
the in-game item class has a lot of issues
I can potientially provide the one we use for the trade system
but I'm not sure if that would be useful enough
unless you mean base item type?
base item type is more useful
so just the way it is now but without magic items putting their suffix/prefixes into the type line?
Regex.match?(~r/Map($| of)/, str) -> :map
Regex.match?(~r/Flask($| of)/, str) -> :flask
Regex.match?(~r/Jewel($| of)/, str) -> :jewel
(snipped from a big ol' case clause)
but i think additionally, what i mentioned before about belts, gloves, armour etc
probably is what chuanhsing is interested in
did you ever get the chance to pack that into the other api?
provide a separate base item type column is okay for me, mapping base item type to itemclassid is trivial
you had mentioned something about maybe putting data in here: http://www.pathofexile.com/api/trade/data/items
well I did just remove sockets: [] from items without sockets, so maybe it's time to add class info
right
it's probably easier for people to consume if it's in the public stash api
that would be really awesome
yep
they're based off the trade categories
which includes "Two-Handed Melee Weapon" as a searchable category
i see, right
I could probably strip that out
i had assumed that melee/ranged was not variant in any given weapon type
ie, all wands are ranged, all daggers are melee, so on and so forth
this is true
even so, people might find melee/ranged annotations useful
but yeah i guess the trade categories would fit the need if it told me something was a belt even if the typeline said it was a Vise
it'd be "category": {"armour": ["belt"]} in that case
hm, can't do formatting inline
or "accessory": ["belt"] perhaps
but yeah
i see scepter in the trade categories
but not rapier
or ranged
rapier gets condensed into one-handed sword
wand/bow aren't generally interchangable for builds
Will it match ItemClasses.dat?
no, it's trade related
"C:\Program Files (x86)\Google\Chrome\Application\chrome.exe" -app=https://www.pathofexile.com/trade/
works better with poeapp.com tho
looks more like an app
our logo is so blurry in this 😦
@gritty olive you just blew my mind
didn't know you could do that with chrome
I do it with codeanywhere.com
spent a few years reading the source code
@mortal bone you can do it with firefox it just takes a little more work...
you have to create a custom profile or chrome stylesheet
wat
what they doing to the trade API?
Bex_GGG: We have an update coming for this which should solve these issues while keeping its use fair and open. We'll share more details in the news tomorrow.
fair and open don't go hand in hand
should I make a player ran auction house to prove points?
I feel it would be hilarious at this point
what point?
that it either works or it doesn't
don't see what that would prove
I've been considering doing something similar as well
Player ran auction house is a bit hard without buyouts lol
You can't really force someone to sell
No, but you can incentivize with reputation
Which is also hard to do.
You can't prove someone did or didn't sell something
A +1 button is a good way to get people to create a ton of accounts to bump themselves
Well I agree with you to a certain extent
It holds true as long as you can't verify that the account is not a duplicate
To a reasonable degree of certainty
You can always link them to real accounts, but it is a free to play game. Although then it is easy to track behavior
Yeah, and also learn from the gotchas and mistakes from oether auction type websites
In forex/day trading for an example, there are some pretty intriicate bid manipulation strategies people use
So eventhough an AH would solve 1 problem, you might be introducing X new problems with an AH
Because with forex/daytrading, you have to accept you're at the big boy's table, and have to learn the ropes. This is the main complaint with trading in PoE, that people get screwed over, especially beginners.
Which is a major problem for adoption of the game, if new players come and get screwed over too many times, their first impression and first experience with the game isn't as good as you'd want it to be, which is unfortunate.
Thats totally true, its hard enought as a new player to stay while looking at the talent tree.
i know a way to prove whether an item was sold or not
use the river
so, have a system like
You could have the person put the same item in their stash
But item ids are unique per player :/
hmm, i guess it can't work for items that can easily have duplicate rolls
oh yeah, you could also use the river to verify bids
Mhm
You could use the river to bid
Generate a code for each item someone puts that code on a note for currency
i was thinking you could just require that all of the items used in the bid be publically available
that way you can have mixed currency, or even item bids
Yeah, any item with the generated code could be put towards the bid
Only one code per item or your bid is invalid
well, you could just have your currency stash publicly available
and the system will know how much liquidity you have available
yeah
Ideally, but I don't think it's feasible at scale
I think for performance and user experience, you'll have to work around that
You could have a couple different systems
Say hf less verification faster turn around and then a slower system that ear marks the currency which gives you more verification
The user can choose between the two systems for individual items with a default of a more verified system
Would be interesting to mess with if I didn't have a data cap lol
I feel sorry for ya'll with data cap 😐
1tb isn't bad, but it is easy to rip through it
I could pay the extra $50 for 'unlimited'
what would the total cost be, and for what speed?
Just moved, so I have a promo. Current service is $70 for 20Mbps down and 5 up, so $120 with no data cap
That sounds like UK
Well, what does the contract say that you're subscribing to?
I only have one provider available as well
75Mbps at peak times
Is the contract
We get higher in the mornings
Your wifi router must be quite far away?
Not too far but about 6 walls inbetween
ouch heh
anyway, time to get another 100m tp cable and some rj45 plugs etc
new network equipment will arive any minute, woop woop
Depending on what the changes they're doing with the trade stuff, perhaps brainstorm a little more around the previous things we discussed a bit later?
Yeah, I am down. It might be kind of fun
The one thing I am looking forward to when buying a house is plugs in every room...
We have a 50foot cable across the apartment lol
You sharing apartment with others, or?
My wife and I then a roommate
Ah, right. You were expecting a baby too, or was that someone else?
Internet cable entry is in the living room, but the bedrooms are across the place. That was me, he was born about a month ago
Ooh congrats
Ty
Hey, when I usually play poe I get a bit over 60fps, but as soon as I start MercuryTrade or Lutbot for example my fps drop to around 30, tried it in window and fullscreen window? Why is that? Is poe getting forced into a background application?
register a new account and trade between them
hashing and browser fingerprinting
lol
I'm curious what they changed though
hmm i remember when the API was supposed to be private
they sure would 💰💰💰
Man, I hope no drastic API changes will take place in the coming few weeks
Got a project that I have to present that relies on the API
Ya, not going to be happy if 2 years of work suddenly becomes worthless
@wind garden What have you developed? Curious..
That must be one hell of an indexer if so
all these public snipe indexers haven't even heard of the word 'cache'
rip GGG servers
lolwat
they all redownload the entire thing and just replace it
i'm pretty sure most start from the tail
imagine if just 1000 persons have a private indexer, that's like 1Gbps/sec
I find it weird that they haven't just added a webshell button ingame for their new search tool
big fat trade button
sorry yeah, head
i'm so tired, that is what i meant
no worries
well, i suppose that you could have use for the rest, especially history
but that would be a more intricate solution rather than a sniping app which you somewhat-manually operate
the big of what, do you mean?
oh
i want to order a little rack
and get a couple of blades
for the shits and giggles, and do some funky stuff
who are 'us'?
oh
lol
lol, my 3-year-old got his hands on my ethernet cable reel
and been unrolling like 100 meter of tp cable
yay
@simple ravine I have several apps, one of them is an indexer, but the other is an iphone app that forwards private messages to my phone with push notification so I can remote desktop back to my computer to sell something
I wouldn't say it's been 2 years of solid work, but I started about that long ago and have been adding features off and on each league
private project?
the biggest one though was based on petet's exiletools which is now defunct
yes
but i wanted to make my own asa practice making an iphone app
had never made one before
i used to use prowl app just to do that
without using remote desktop
lol, i wanted the ability to set item prices using the public api
that never went over well
you can set them with a forum thread
true
acquisition actually works on android (and probably iOS too)
here's what I don't get about the argument against private indexers (besides the strain it puts on GGG servers). People don't like them because they think they're unfair. But in reality, somebody is always going to be first. Whether it be because they have a faster connection or they're physically closer to the server. So in th end, how does it matter if someone is using an app to find deals first, or if they're using poe.trade. It's all the same in the end
if they use their own indexer they can be 5-10s faster, if they use poe.trade and they have a slow connection, they are going to be like 0.1s slower
i'm talking about from the buyer's perspective though
the people complaining are never going to be first
as for bots, someone can still hook a bot up to poe.trade
@mortal bone is there a tool that can do a visual diff of the passive tree?
ah nevermind, you already posted a link to one on reddit
you the best
awww snaaapp
nice, have fun with those!
Lol what do you need with all those?
decent networking
Is there any data on what the rate limit is for the api? Trying to use https://www.pathofexile.com/api/trade/fetch/ for quite a few items but since the max "result lines" (or whatever they're called) per request is 10, I quickly get rate limited since I have to send a lot of requests
its in the header of the response
Aha, X-Rate-Limit-Account:20:5:60 X-Rate-Limit-Account-State:2:5:0? What do the numbers represent?
20 requests per 5 seconds, 60 second throttle
Cool, thanks. 60 seconds throttle means what exactly? If I surpass the 20 req per 5s I get throttled for 60s?
yes
Throttle = shut out/more limited access/reduced speed?
shut out afaik
ty!
@reef jacinth in my experience the limit is 45 requests per minute
that's on the stash api
isn't 20 req/5sec really fast?
why would you need to fetch that often?
@wind garden Okay so I'm looking to fetch many (all if possible) items with certain names, say Factory Map and Mesa Map, to aggregate them and make them easier to buy at once. My current solution is:
- Query https://www.pathofexile.com/api/trade/search/LEAGUE for each item name, this returns a list of 0-100 "result lines"
- Query https://www.pathofexile.com/api/trade/fetch/RESULT_LINE1,RESULT_LINE2...RESULT_LINE10 for all those result lines, max 10 result lines per request or I get a 400 bad request, and this returns 10 items per result line
so to sum it up I have to do about one request per 100 items, so 4500 items per minute if it's 45req/min?
maybe there's an easier way to do this? (without having to set up my own indexer)
As I understand it, different APIs have different rate throttles
I was referring to the public stash API
but I think you're using the trade API which has a different rate
it should be the 20/5sec rate you listed earlier from the header
Okay thanks
My office now sounds like an airplane cabin
@simple ravine sucks you can't automate the configuration of those
what do you mean?
not sure what you don't understand
can't automate what and how?
i have conflicting information
Release it on github, or sell it
im confused
the automation and versioning of the port / vlan configuration
If you have a way to do it release it
idempotent-ly
sorry, but.. what do you want to automate? once it's configured, i'm just gonna throw it in the closet and have it do its thing
It's outdated and when I change something I want to see the history, for reasons
and what do you use that doesn't suck?
@chrome topaz UNFAIR MONOPOLY :v
RIP
WTB whitelist paying in uncorrupted golden rhoa feathers
(is joke I love xyz)
hum but do u think that 60 sec is enough?
oh yeah
lol
that is a nice solution actually
how would that fix things?
i assumed "public" means usable by the public rather than just public source
It doesn't take away that, it prevents unfair advantage
that is the point of this annoucement...
defeating 'sniping' tools while still allowing everyone to develope if needed
right but still means if you spent the time to write your own sniper you're SoL
RIP my 780% facebreaker 1c flip
why not just give a whitelist key to any developer that wants one, but not to users of that app. so prevent snipers from being used by anyone other than the person who wrote it
cuts off the mass distribution of sniping apps that GGG didn't want
So the curernt api will stay the same?
good
Inb4 still faster than indexers 🤔
or research it looks like
sooooo
This is fine for me indeed
i wonder if poeapp got the "Online players" api permission too
all we need to do is make a public tool and we can use the same backend for private indexers?
@elder hearth yes, just recently
nice
is that what you meant emmitt?
No
lol
I mean research projects
so it's not enough to be a public page that need non-delayed API
you have to be xyz or poeapp
that's probably what's going to happen
fair
Email GGG about your use case
but we'll see
ya i guess the requirements for getting on the whitelist are not clear
they seem pretty clear
Developers doing research projects or getting started on trade sites can use the delayed data and existing public trade sites receive fast access.
basically until you prove that you're not a scumbag you don't get fast flow
If you're a developer of a public community tool who would like to unlock the undelayed data, please email us at contact@grindinggear.com. Thanks!
it seems straight forward
so in otherwords, all sides besides poe.trade and poeapp will be delayed
be public and show you have worth
Well, there are no "These are the requirements to get non-delayed API access"
right
"worth"?
like, how big do you have to be
how useful does your app have to be
that sort of thing
It isn't set in stone no, but you can email them and ask
its prob intentitoanly ambiguous
lol
i mean really almost noone needs the fast api
he has a pretty small operation
i'm pretty certain both him and xyz have put a crazy number of hours into their sites
@hazy fog for $50 i'll email ggg your ip and tell them i added a new load balncer node
Alt+Prt Sc -> compose email to bex@grindinggear.com
This delayed stashtab data is a step in the right direction... but still doesn't solve the problem that you cant create a trade site... because you cant get access to the online-api. This means your stuck only knowing additions/changes in the last few minutes... anything else cant be trusted.
what's going to happen is the number of poe.trade live searches will go through the roof
watch as poe.trade gets delayed > 60 seconds
and private indexers become the fastest search again
@rugged night you get it eventually as seen with poeapp
I doubt the live search causes too much overhead
he can also disable web sockets
eliminate overhead
ya
i don't think it'll fix any issues in the end. just shifts them
it cuts down the strain on GGG servers
and shifts it to others
well, that was their goal right?
no doubt
Websockets aren't that bad, 30 WSs per browser is tho 🤔
maybe they want to subtly shift people to using pathofexile.com/trade
those private tools help them more than they realize
...
They could easily reduce the strain on servers by sending less data too. We don't need all the data on every item in the tab just because ONE item changed position. Most of the data that the stashtab-api sends could be contained in a simple look-up table/database for that item.
At large, I don't think the community get the situation, @mortal bone
there are tons of ways to reduce data
you sound like you're asking ggg to make a public sniping tool lol
for one not using json would be a good start
as @rugged night said, the API in itself is quite inefficient
sending the entire tab when you change one item is a sub-par choice
Yeah, well I'm just being very blunt. I'm not trying to be a hater, nor a fanboy
My suggestion would be to create an API that would send events, rather than complete tabs
Also, dont send EVERYTHING about an item... just send like "Item 673" and the stats that can change
Why do I need the long description of an item when it could be in a lookup table?
erm, items have a different id per user
ya that
well, take flavor text, the verbose stat lines etc
trading an item changes it's id
I believe he means just a pointer to BaseItemTypes.dat (as API) with the info that doesnt really change
Yup
exactly
oh, yes
No need to send me 100+ descriptions all the same... when it could just contain a short look-up code/number
The properties thing is a dumpster fire lol
It would save GGG (and consumers of the API) sooo much bandwidth if they spent like 5 seconds pruning the useless stuff... and sending individual item updates
that is where most of the data comes from
don't need w/h I have a table for that
also the full icon url doesn't need to be sent
the name line is sad lol
name "<<set:MS>><<set:M>><<set:S>>Roth's Reach"
such sad lol
Yup... NO thought went into the stashtab-api :/
28bytes for a display header
I'm not sure how you'd make it only send item updates without it being excessive on the ggg side
read a book about it
the whole tab would be fine if there wasn't so much extra stuff
would be intersting to see how much "better" the community could make their api by facading it
100 items/s is low
yes, I know lol
closer to 500-600
500-600 items per second?
again, facepalm
Oh yeah sure I'll read a book thank you very much
Lemme check amazon for stash tab api books hmmm
lol
I created a quick app in a day or two that consumed the StashTab-API... dumped things into a MariaDB and then checked each new item coming in to see what data I really needed. It threw away unchanged items, used a lookup table for item/uniq bases, descriptions, etc... and created a new ""StashTab-API" like data packet.
...it got the data packets down to about 5% of the initial size... and I never finished optomising it.
Over 95% of what the StashTab-API sends is useless junk
emmit already mentioned that
wouldn't you sacrifice human readability though?
or is there a readable more efficient format
This is a comparison of data serialization formats, various ways to convert complex objects to sequences of bits. It does not include markup languages used exclusively as document file formats.
merry christmas
JSON is quite fine when gzipped imo
of course, there are formats that are more compact
could use blittable structs and binary serialize it :trollface:
I guess people who wrote sniper things will switch to writing poe.trade sniper thing that auto copy to clipboard etc
They may hammer your "live search" feature, xyz
protocol buffers is where it's at
@chrome topaz how did you guess? 😄
may?
Or maybe they'll just ddos me again to prove a point or something
protobuf is awesome
read xyz's comment above
ah, missed that
How big is your database (as a whole) for poe.trade, @chrome topaz ? ...and when does it date back too?
Big as in?
gb/tb storage needed
Dates back to like 2013 when i launched it
waiting torrent, 5pm-9pm NZT
uh I'd need to check but db size on disk is kinda pointless metric for me because i have all data in memory
you don't write your db to disk?
I do, why?
didn't understand what you mean by "I have all data in memory"
did you mean the db size on disk isnt' accurate because there's additional data in memory?
table caches?
either way, I think @rugged night was just looking for a big number that he could be impressed by 😃
it doesn't use the disk for querying the db
I'm just after a rough size in gb/tb of the database... be it on disk or in memory
Thats not too bad 😃
so it's not "terabytes" of data yeah
do you strip a lot of the useless data out?
With that size, I'd guess so
I was thinking with all the historic data... it'd be in the terabytes by now - lol
sure
i don't think GGG should whitelist anybody tbh
pathofexile.com/trade should be the only service without the api delay
it would for certain be the most fair thing to do, since they have complete control and every other publicly hosted service is blackbox
hey you take that back
lol
poe.trade would likely still wind up being better than pathofexile.com/trade
simply because of ux
is there a centralized source for filter info?
thinking of starting a project similar to filtration now that it seems to be dead, would be nice to have a text list of item types/bases/whatever -- all the item info
oh, woah, looks like filtration actually got an update a couple of hours ago
I don't think GGG should do whitelisting until they make a good service
might still be interested in doing it just as a project
so if anyone knows of a list of item classes etc that exist anywhere id still appreciate a link
id rather not pull them from filtration or w/e
poepy or the website
the official site? i guess i could just scrape it
excellent, thanks emmitt
did not know about that
@gritty olive i found that last league and used it to build my affix calculator
helped me prune down the problem space considerably
i think @simple ravine is doing the same thing now also in c#
seriously considering publishing my affix calculator as a community tool now with these recent developments
what dds format is ggg using?
Does GGPK store unit hitbox data or is that all handled server-side?

the website was enabled but the realm hasn't been opened to players yet
someone notify me if torrent is ready
just a ping?
ya, thanks
which one lol
Novynn how do I use the api?
Does http://api.pathofexile.com/public-stash-tabs contain ALL the latest items?
🤔 is there a way to register my server to relax rate limiting slightly?
contact support@grindinggear.com like the post asks
rate limiting for which API?
ladder/league
they'll be lifted to be less limiting in 3.1.0
right now its looking like a 17 minute cycle for querying 15k ranks on 4 leagues
yeah, we're doing some interesting backend things this time so I'm sure it will only become easier for you
Honest why cant I ask here?
do i get direct lookup on ranks? 😄
Are you making it hard for me on purpose or what?
I just want o know how to query something like items with ilvl between 50-100
I don't understand.
and you tell me to use email like its 2000
You have to parse the river...
what the hell
o_o he asked me to email them, not you lol
direct lookup? You mean by account name or something?
@dark heron thought you were talking about the stash api lol
that's possible, but will still be limited to the top 15,000
Does http://www.pathofexile.com/api/public-stash-tabs contain ALL the latest items?
@glacial flax did you read either link I sent?
Every Public Stash tab has a private change ID attribute.
When you update an item in a tab, or update the tab itself it's ID will take the next available one from the pool on that server shard (the old ID is discarded, and never reused).
When you query this endpoint, the ID you provide says "give me all tabs on each shard with a change ID greater than the one I provide". The backend will then fill up a packet with as many stashes as it can, and when it can't fit any more it will provide the change IDs of the tabs on each shard it was up to.
If the number of stashes returned is zero, you get back the same change ID you passed in (a hint to keep trying until the endpoint has some tabs for you).
:O! seriously? i'd love to not have to parse the whole 15k/league forever.
when it can't fit any more it will provide the change IDs of the tabs on each shard it was up to.
where is this?
"next_change_id":"2524-4457-4108-4873-1427"
is there a current_change_id?
always the very first object in the river
it is in the url
http://www.pathofexile.com/api/public-stash-tabs?change_id=0-0-0-0-0
replace 0-0-0-0-0 with next_change_id and query that url
@mortal bone If I want to query something with filters, like poetrade, how do I go about doing that?
So I keep querying the next change id, at what point does it stop?
working in Python 3.x
If the number of stashes returned is zero, you get back the same change ID you passed in (a hint to keep trying until the endpoint has some tabs for you).
Will read through and replicate that code in PHP, since I'm not too familliar with python, but thanks.
still no torrent
@glacial flax poe.ninja lists the latest current change id
there are also other reasonable ways of fast forwarding to the head of the river without drinking the whole thing
when does the whitelist come into effect?
@wind garden ```
We're changing how the trade API works with the release of 3.1.0 so that private "sniping"...
where did you quote that from?
the original forum post
It's already changed.
Basically, they have a whitelist now, those that are not on their whitelist, will have a slight delay.
if someone had downloaded the full preload.zip, I need some files
@wind garden yeah, seems like the post itself has been changed but not the news on the front page https://gyazo.com/6556747d82823edd3b87aed95772ff2a
@glacial flax 0 is the earliest history of the river. you can call it the starting point if you want, but that's not where you're going to find the most recent data
2017-12-07 23:48:31.901 [info] [ 0 / 1200 ] [111876157, 117298596, 110017422, 126960771, 118529646]
2017-12-07 23:48:34.126 [info] [ 1 / 1200 ] [111876164, 117298627, 110017448, 126960837, 118529708]
2017-12-07 23:48:34.948 [info] [ 2 / 1200 ] [111876170, 117298647, 110017448, 126960839, 118529731]
this is where the river is at right now
you can check this against poe.ninja:
Next change id 111876213-117298688-110017487-126960947-118529787
just found a commit from my old python project: 2016-10-16 18:25:27, where all the changeids were between 21M and 30M. now all the shards are past 110M
db has grown 5x in the past year
come a long way, eh @compact isle
@compact isle Are the new API changes already in effect?
seems not yet
can somebody recommend a tool for extracting the ggpk, or is visualggpk the best option?
Im using visualggpk, do you dled full preload.zip?
@tropic shuttle @glacial flax That's not actually correct, the river doesn't keep history. 0 is the start of the CURRENT stash index.
any histsory must be stored by the indexers themselves
i'm downloading now
me too, my poor net
got it downloaded
though, vggpk2 does return ```
Building directory tree...
Traversing tree....
All done!
Failed to read directory tree: Failed to compare two elements in the array.
WOW...
so fast
spec?
specification for .dat files
huzza @obtuse citrus, well done
ahhh, unique items leak 
something is fucky with travis urgh
build server failing you?
it's failing to install/update some of the requirement packages
to be fair, pip has been a clusterf... since i met him the first time.
@velvet fog where's all the new uniques
all the ones one the page were confirmed already
oh =/
any info on Elder/Shaper/Abyss mods?
ModDomains 14 = Abyss
I thought 14 was Pantheon?
http://poedb.tw/us/mod.php?cn=AbyssJewel not match official site mods, finding others
@timid hemlock I believe Multistrike isnt working with minions on PoB. I believe the newest update isnt classing animate weapon attacks as melee attacks.
Hmm, the Content.ggpk file has a last modified date of 22nd of November
I wonder if anyone is awake at ggg right now
Getting lots of 500 responses
Map Stash Tab
Add a Map Stash Tab to your account. Map stash tabs can hold 72 of each map type.
Map stash tabs can be listed as public, allowing them to integrate with community trade tools.
150 Points
@velvet fog awesome!
urgh they changed how map icons work
they're just the glyph now with transparent back g round, seems like they overlay it over the base icon and change colour or something on the fly
map stash tab isn't for shit shaped meta
it's for normal mappers who have some of lots of different maps 
https://i.imgur.com/rNblvbP.jpg more stash types
o shit
can't find Shaped maps from baseitemtypes.dat
@hushed relic In filterblade for the loot simulation, Stygian Vise has the wrong BaseType. It's "Belts" not "Belt".
@velvet fog can you extract new shaper/elder mods?
no idea where they stored
They're just normal mods with new tags
@wind garden what i meant by that was historic change sequences. the data you'll find there is current, but the change at index 0 occurred year[s] ago.
@obtuse citrus can you get the list?
okay, can you share the script?
it's fairly basic
for mod in r['Mods.dat']:
yes = False
for tag in mod['SpawnWeight_TagsKeys']:
for key in ('shaper', 'elder'):
if key in tag['Id']:
yes = True
break
if yes: break
if yes:
print(get_translation(mod, tc).lines, mod['GenerationType'], mod['CorrectGroup'], [t['Id'] for t in mod['SpawnWeight_TagsKeys']], mod['SpawnWeight_Values'])
perfect, thank you
r is RelationalReader instance, tc is TranslationCache instance, get_translation is from PyPoE.poe.sim.mods import get_translation
yep, I still have your old script for enchants
alright, now to get the ggpk... I hope this time their torrent doesn't have a shit ton of porn trackers
well guess I hoped too early
oh is it
I didn't realize
whoever makes these torrents
my big smh to you
the unfair poe.com/trade monopoly
yeee
online api stuff should be fixed
@compact isle what are the new values in the status api?
A neat trick to cure yourself of your python addiction:
True, False = False, True
it's got 4 fields now
Account,AFK,CharacterName,LanguageId
LanguageId is the same as in-game so it's probably datamined somewhere
yeah I didn't know about it sorry
also current league would be nice, too
we have to do more work there to get the league name
@compact isle how many live searches you got running on the official trade thing?
seems to be 150 per second
so that's 750 currently running?
checking logs for more accurate numbers now
i see
we're limited by the amount of php-fpm workers we're running though
time to implement websockets
I got 6.2k live searches and about 12.5k websocket connections
so @compact isle did the character rank lookup make it in anywhere? docs dont show it
seems a lot of people haven't turned off their harbinger/mayhem/whatever searches
we only have a handful of those
@dark heron https://www.pathofexile.com/developer/docs/api-resource-ladders added "accountName" param
oooooohhhhhh
let me know if it's slow or anything
is api working properly?
i haven't had a single person message me back on an item
with like 50+ offers
what item?
weird
cuz you broke the api
that's the concern of course, but things seem to be working fine still
Yeah, I'm just very vocally against doing things that heavily impact tools that are used during a major event
how elder/shaped item mods displayed in stash api?
the rate limiting stuff could have and the api field changes
that said the new league "pick your reward" thing is cool
which api fields changed? By ratelimiting things you mean the headers?
whitelisting happened just yesterday right?
happened today, but doesn't have any code impact

it looks exactly the same consumption-wise
the rates of consumption changed
that could mess with someone elses code which has different expectations
or the error could cause the whole system to error out
"the error" what error?
the error of fetching too fast
there is no error
lol
you need to also read a book
It's weird to not think that someone relies on something working the way it works and when it changes even slightly or the interaction is handled differently that the contract is no longer held
There is no difference in rate-limiting, nor response codes
The river was changed, if it didn't change, then it wasn't changed
Look at it, as different premiums in fin-tech/trading systems
But if it changed, then there were changes and those changes will impact those who relied on the previous state
Nijiko, no offense, but are you sober tonight?
That's rude
Your statements make no sense, I'm sorry.
Our solution is to delay the item data by 60 seconds for everyone except certain whitelisted public sites.
And how exactly would that break existing implementations?
If someone doesn't expect this, that can break an implementation, it depends on what that text (which is vague) means.
The consumer wouldn't know if it's delayed or not.
It depends on that sentence meaning, whether it implies duplication or sliding window
Since it's a river I would expect a sliding window, but then again who knows
It's vague
it isn't a river in that since
it is the difference since the 'last' time you checked
Sliding window then, which means there is now a Dam in the river (keeping the river metaphor)
Well, I'm going to bed. Have fun guys.
your window is just 60s delayed, but it is the same window
how would that break anything?
broke my sniper
eh, if you are faster than a minute
it didn't break them
It slowed them down
The thing I don't understand is... if you have a whitelisted access, you can just scrape from the output of that person
they can consume at the same rate
This doesn't fix it 
It's theatre
Also I thought it wasn't sliding window earlier and I was wrong
the window can be different for everyone
yeah
it is a difference
I get that, but it is easy to comprehend or get a basic grasp of how data flows in it
if you stop consuming and restart your will have a much different set of data than just straight consuming
How does it break things though?
I said I was wrong
@chrome topaz also, you can just piggy back off one of your nodes
your sniper works lol
3.1.0 Hotfix 1
that's the joke
all we have to do is a port scan
port scan?
I have a feeling xyz is a bit more heavy handed on the ip bans than ggg
massive port scan = angry email from host : p
: p
does anybody do this? if not, why don't people do this?
that would kind of destroy most adblocking software. and the ones that do blocking by nth-type-of-element can get subverted by proper obfuscation
right?
@compact isle you're right. I'll try and see what's going on. My site isn't liking the river atm apparently.
@delicate ore because I right a plugin that hot swaps 'critical' sctipts with the proper cdn
@compact isle poe.ninja should work now. Apparently some items had a null sockets array where I hadn't seen it before.
Main task was actually deploying from a mac instead of my regular windows machine 😃
not sure if this is the right channel to ask, is there any trade sites that have all the new affixes and can also sort by total stats? I know that the poe offical trade has all the affixes but can't sort by total that I could find.
@fickle yew Thanks for the heads up! I had the same issue with poe-rates
I wonder why they suddenly became null.
my code was crashing on the null sockets also
+ def is_rgb_socket(_), do: false
1 liner fixes
@compact isle why is poe.trade live search faster than pathofexile.com/trade?
heh
because it uses web sockets instead of 5s polling, how faster do you see it anyway @wind garden ?
it was pretty close when i tested
it's about 1-2 seconds faster
poeapp is about 5 sec behind
i thought pathofexile.com/trade would use websockets too
i guess i could have checked
@chrome topaz have you seen a large increase in live search usage?
pathofexile.com/trade seems to miss items
super annoying pathofexile.com/trade lists items by user account and not IGN
@wind garden hard to measure when it's a new expansion
i'd say it hasn't increased by a substantial amount
How?
I'll test it when I get home
But I don't see why they'd lie
why they would lie? i dunno, easy karma, rage boner against ggg, etc?
pretty easy to test yourself, open a live search, put your item into public tab, walk into another area
somebody saw an instant whisper and assumed it's a "private" sniper, because they are used to poe.trade being delayed by 5 mins or so
I'll have to test it. I was testing earlier on standard but not abyss
I'll have to see if abyss is slower like people were saying
There was no delay for items on standard
Poe.trade was <3-5 sec
Snap
No its not!
I'm getting the api real-time
What's also weird is items appear to be missed once in a while
what do you mean missed?
Mmm might be my indexer
I don't list items that I've seen already
Poe.trade shows when someone changes from fixed price to negotiable
yes
But the api definitely isn't delayed
maybe they forgot to enable it
Maybe
I'm more curious why people claim that poe.trade misses items, when it shouldn't
Perhaps just saying that they do it scare people off enough 😄
@hushed relic your filter is not showing shaped maps properly. https://www.youtube.com/watch?v=mORfMwNPP4k its an ilvl 75 shaped beach(t6) and it barely shows
Maybe this has been posted before, while I am new here:)
What does a shaped/elder item JSON look like from the public stash API?
@wind garden was posted a bit above shaped: true and elder: true
the lack of the mods means false
thanks!
@chrome topaz http://poe.trade/search/etoranikiubuko
it should be showing 4 mod jewels, not 3 mod jewels
glitch?
you have lightning damage to sword attacks in there twice
yep
oh it should be to attacks
anyone fingered how armor/weapon apply a elder/shaper mod?
ouch, I know how to mapping the elder/shaper mods now.
Elder & Shaper mods
http://poedb.tw/us/mod.php?cn=Elder
http://poedb.tw/us/mod.php?cn=Shaper
that's quite a list
chance_to_deal_double_damage_% [20] huh?
can't find description in stat_descriptions.txt
how well does PoB do with SRS?
Good
oh wow rings with curse on hit
Ok apparently i wrote return instread of continue and my script was cheked only the very first item of the entire api pull
Which is funny because it took me 4 hours to figure out why there's so few items on sale
Haven't learned that yet, still a novice
Oh, what language do you use?
java this time
pro tip of the day: google breakpoints debug java <insert your ide here>
printf debugging master race
aka noob-debugging
Not really noob debugging. Logging isn't the worst thing when you have a system you can't debug
If you can't debug it, you're doing it wrong.
you're taking it the wrong way 😛
i'm trying to make you a better developer 🙂
Why is that?
There are times when it simply isn't possible to debug. I work on systems all the time that can't be debugged
Such as?
Phone systems
In development mode?
Seems like new ammy Impresence has 5 different variants
We're talking about when you're developing, not when you have issues in production environments, then of course logging is key.
sometimes you're writing a rop chain for a console and the only way to debug it is infloop/crash distinction
but i digress
@chrome topaz you do realize you can attach multiple debuggers to different processes, right?
printf versus debugging is like the oldest flamewar
wonder why...
I like a mix of both, and it depends what language
Python print is pretty much all you get
emacs xd
you can debug python
gentoo, emacs, tabs here
You can, but it is much faster to just print
how rude
Also, I do most of my scripting in notepad++
in emacs mode I hope
why is it rude?
To be fair, a print statement also would have caught the issue
Printf('continue')
my code is shit quality so print is usually the way to go for me
Assemply
@simple ravine I would say 95% of my python is within a couple hundred lines. Not very hard to see issues
Sure, your mileage may vary
Never needed a python debugger, so I am doing good so far
You didn't need a cellphone before they were invented either.
I don't really need one now either
you get the point.
No, I have never had an issue where I needed a debugger
I'll stop now, before I sound even more rude I guess
let's just agree that we disagree
I'm cool with that
@shell elk plan9, every indentation level is the next prime number of spaces, butterflies
I'm ascending to another physical plane right now by just reading that
is the stash tab api broken right now?
it's like returning 800-1500 items in a single response (so not backlogged) but takes a long while for items i place in tabs to appear
hmm seems erratic
yeah it's good now
forums look like they still have items linked
hmm, too bad there isn't timestamps on stash updates
@timid hemlock any chance you'll open source SimpleGraphic?
isn't it technically already open sourced?
I'd rather not replace it with QT
Nah, the drawing mechanism is a compiled DLL that openarl wrote in c++ but never open sourced
not sure since I don't know the dll code
could watch system calls or the exe calls but im too lazy
ya item i listed 20+min ago still haven't shown up
not even on their own site?
does all shards increment?
perhaps some shards are down
i.e. network partitioning or something
lol
@mortal bone yeah PoB ui/render is pretty inefficient
every frame it throws everything away and re-renders everything
Delayed sniper feed lul
that's also why i abandoned my pob js "port" project
was the port just webasm?
webgl and emscripten yes
haven't tried optimizing it much
you could increase the framerate to 60 on pick up
maybe i should post it on github so somebody could pick it up
it was basically a hodgepodge of some js webgl, emscripten hacks and that qt renderer
oh and then there was that amazing hack to draw text mmmm
i'm also not seeing my stashes come through on the river
I poked Chris about that hopefully fixed soon
says it's gonna resolve itself soon
well it's not related to whitelisting
i think it just came through. heavily delayed