#tooldev-general
1 messages ยท Page 37 of 1
i see
@tulip gale yeah, i meant reduce the data count returnd from the backed
like I was telling claymore, you can start later on if you don't care about standard/hardcore
@compact isle thanks for the clarification btw! Are there any plans to introduce filters in the future?
wrong mention lol
@compact isle the change ids are random?
they're not
so the default api request gives me 2151-4130-3306-4050-1240 next id
how old is the data for it
like what do you mean by 'start later'. the ids are date-based and i can calculate them someow?
how will i know the id of the beginning of the breach league
nope, your best bet is to use something like poe.ninja
I asked very similar questions
a few mins ago
Interesting that adding that id was actually useful. I added it in the very early stages of poe.ninja dev.
you're poe.ninja dev?
Yup
someone lied that you are not on this discord guild!
I just joined 5 min ago
I see then
well then welcome to the tool chat ๐
are you fine with me querying some of your endpoints?
for such data
like change ids or market value
Thanks, lots of useful people here to stay up to date ๐
welcome rasmuski o/
hello @compact isle and thanks for the help on poe dev reddit in the past
what's the secret meaning of the change ids? i provide just random ids to the api and it still returns data
@prisma prism think of it this way, the stashes in the list you just got were in the first 1240 to change when the API went live
@tulip gale As long as long as the query amount is low, it's okay. If you do anything public with it, attribution would be nice.
happy to help ๐
The server load after Breach has been quite insane.
Thank you @fickle yew, absolutely
I really need to make a powerpoint presentation or something on how the stash api works lol
apparently my summary in the dev docs isn't enough ๐ฆ
@compact isle what data is returned if id is not found?
like this http://api.pathofexile.com/public-stash-tabs?id=0000-0000-0000-0000-7777 still provide me some data
Be sure to add data about the special messages for throttling and maintenance mode.
stashes will be empty and you'll get the same change_id you passed in back
oh, good idea
but this data is not empty
so what's the real throttling now?
ye, because the current max change id is like around 36,000,000
1/s is fine?
yes
hmm
okay APXEOLOG, what's a programming language you know?
I can pseudocode this up
ah awesome
i understand how the system works, the only thing i want is how to get the id of the most fresh data
i don't want to know all prev tabs
i just want to track new data
then grab the one from http://poe.ninja/stats
np, feel free to ask if you have any other questions
sad thing you don't give any timestamps in the data
well all data in the API is current at the point that you receive it
it's kinda true but... new service have no idea about all this information
iirc the steam market api is close to your's one, but they have timestamps in the each data sets and you can also navigate back. and the root api request returns the newest data. so it's not like old -> new but new -> old crawling
hmm, that's interesting
@compact isle also, how do i check if user is online ingame right now? i bet poe.trade used ladder firstly
there's a private api you can get access to on a case-by-case basis
oh i see
To avoid abuse, right?
yeah pretty much
imagine the thiefs who checks your poe online status to see when you will not be at home ๐
I was actually considering to apply for that for poe.ninja, since I could use the info to improve my weighting of prices.
privacy is a real concern ๐ฆ
@compact isle so basically I can lock anybody out of their account by failing to login as them (from a different IP) many times?
Loooooool that's probably possible
but anyway, that's not the point -- can you or somebody else unlock this account? people are complaining
how should I implement rate limiting on the login page?
I mean most of the time it didn't even send the request because the hash element wasn't even here, but still got rate limited?
I guess I accidentally started the bot again during a deploy
not at the office anymore so I can't give details
but it looked like you were requesting too often still from your IP
so who can I contact about it?
in order to do what? We can't single out accounts to disable or reset rate limiting on
well to discuss what I can do to avoid rate limiting like this
it sounds like it might be a useful thing to add, but right now nothing can really happen except waiting it out
don't request the login page more than 5 times a minute and don't try to log in (and fail) 20 times within an hour
so it actually failed to log in? can you tell me what was the cause?
it just logs the failure
ok noted about login page GET rate limit
@chrome topaz Do you have any place listing the new currency shorthands for the new blessings etc when doing stash notes for currency trades? The list page I was able to find on poe.trade doesn't have the new ones like Shaper sets and blessings.
@fickle yew https://www.reddit.com/r/pathofexile/comments/58bpve/psa_you_can_now_search_for_sextants_and_full_sets/d903kh9/ sets not sure about blessings
yes of course, it's on the website http://currency.poe.trade/tags
Yeah I saw that one. I can just see people trying a lot of interesting notes to sell blessings etc ๐
oh right
Thanks! I always found the old page I guess.
Yeah I found this one from the page footer: http://poe.trade/html/tags.html
it's different for poe.trade and currency.poe.trade which is why the link I posted only linked from the currency page
Yup, no selling your Starforge for 4x shaper set. Makes sense.
websocket?
Persistent connection to your browser client for server to push state to you instead of you polling.
roger
just curious is the trade makro working for everyone?
it seems to not work for me : o
@long stratus it's being blocked by cloudflare after the recent ddos on poe.trade. I guess it looks like bot traffic since it pretends to be a browser and everyone is using the same useragent in trademacro
aye captain thanks for the info. Thought it was my fault so I've reinstalled it a dozen of times already ๐
is it normal that request times for the api are around 2-10s?
Yes
out of curiosity, does anybody know how poe forums does their item embedding code?
i can inspect it later but figured someone might have already played with this
lots of json
from the stash api i assume?
the same format, yes. But it embeds the json in the page
anyone experiencing any problems with the api?
nah, support just told me people were complaining their items weren't showing up
we just tested it and it worked fine though ยฏ_(ใ)_/ยฏ
I saw a new Race mode in Tencent Chinese
But I don't sure It really exists or just leaked
they're trialing it soon I think
It's named Path of Endurance
There are many levels of it, limited time event, and boss arena
This new Race will drop League specified Uniques every 5 Level
like greater rifts? 
ah
Fixed Map mods for each Path of Endurance level
Tencent China had confirmed this new Race mod
@chrome topaz do you have somewhere dedicated to bug reporting?
@fickle yew there's a (fake?) listing of Eternals in temp sc showing up on your site
not sure that it matters but kinda funny
Yeah, people can list stuff for Eternals through the currency notes.
People also seem to like to do it for not-commonly shaped maps ๐
aha
I might filter them at some point, but I'd rather get 5- and 6-link prices and big history graphs for uniques done first.
ooh nice
there's no way to get retrieve stash information for a particular account, correct? there's just a real-time stream of everything?
you could technically get all the data then filter by an account
@random quarry yes, use the forums (link at the bottom of poe.trade)
Could someone explain to me why the poe trade makro takes so long to get a pricecheck done? (not complaining just curious because I was watching Ziggy's stream his was working much faster - is that the fault of my internet connection?)
are there any front end web developers here interested in building something POE related? I've got a nearly fully functioning backend finished i'm just a garbage FE dev
@toxic spoke send me a PM with some details and I'll have a look
@waxen ridge done ๐
I've also been looking for a poe-related side project, so feel free to send some details this way if you'd like
does anyone know poetrade's devs?
He's in here
i wonder if we can somehow remove unpriced items from premium currency/essence tab. because ppl mesaging me to buy thing i don't actually sell
you can mark the price really high
like giev the tab a price thats 1 mirror
then everything defaults to that
your individual prices should override that
make a seperate tab that you put your priced items in and dont make your main tab public
otherwise idk
but then the currency in stock will not be tracked
Yo, I listed a characters items through procurement to sell equipped items while mapping but now I can't seem to delist the items and people keep wasting their time whispering me about items no longer for sale. Any1 got a way to delist em?
The indexer may not have updated yet
This was like four days ago
how is it that I'm seeing stash updates for characters that aren't online?
don't they have to be online to make an update to the stash?
the online stuff only updates every minute
how does poe.trade know that someone is online?
it requests the list every minute I'd imagine
is there an api for that now?
a private one, yes
private as in, you must be authenticated or as in it's only available upon special request?
or both
both of those
got it
i had asked poe.ninja why his prices were so off sometimes
he said it was because he can't see who's online and so offline items will skew it for the rest
I'd say it's safe to assume that if someone's stash updates it's because they were online at some point in the last minute (assuming you're at the top of the river)
Might be useful for other tool devs: I have converted mod and stat information into a Json format with PyPoE so I can use it for the offline planner later on:
https://github.com/brather1ng/RePoE (files are in the data folder, documentation about them is in the docs folder)
If there is interest or its necessary for me, I might add more converted stuff.
@woeful sphinx neat
@woeful sphinx Thanks! Do mention if you do skill gems as well, those are still a pain for me, getting them through poeskilltree's wiki scraper.
@fickle yew The plan was to rewrite the gem stuff from wiki scraping to using the wiki's api. That's what I need the stat id translations for. But I might do that completely with the ggpk, will tell you if I do.
Great. Looking forward to that ๐
depending on what you need the ggpk might be easier
wiki is formatted from the ggpk anyway, but it has a bunch of extra stuff that you may not need
for example I put stats that dont change at any gem level in a extra section in the wiki to avoid confusion with people who might edit the templates manually
but it's fairly straight foward as list of things per level in the data which is probably fine for the skill tree
Yeah, most of the work with the ggpk is finding out what I need and how to interpret it, then it's just converting PyPoE's objects to Json.
What I've seen with the wiki, the stat ids and values for gems seem to be linked together weirdly.
how should i know that the first value applies to the first two ids and the second value to the last two?
(speaking about "Has stat ids" and "Has stat values")
oh ingore has stat ids and Has stat values
multi value properties are broken
if you have the same value twice values disppear
best to go by the subobjects on the page
the subobjects seem to be empty for some stats (e.g. http://pathofexile.gamepedia.com/Special:Browse/Frenzy-23level0_stat1_physical_damage_%2B-25_per_frenzy_charge)
thanks for both PyPoE and feeding that into the wiki, btw. all of this wouldn't be possible without your stuff
I need to look into why the subobjects dont seem to work
btw those empty subobjects is because SMW has some issues with handling the % sign
if you look in the box it looked for
Frenzy#level0_stat1_physical_damage_+-_per_frenzy_charge
while the actual subobject is
Frenzy#level0_stat1_physical_damage_+%_per_frenzy_charge
but there was an issue with the subobjects never the less
ah, thanks
just to make it clear: the subobject exists and you can query it, but you simply can't view it using Special:Browse
You can view the subobject but you have to replace the - with % ๐
SMW likes to be stupid sometimes
hey, would a tool that displays an overlay over your stash and hijacks clicks be allowed?
basically it would display items in a different order and when you click smth it moves the mouse to the actual item location
I do belive that's illegal.
how are you going to be retrieving item info? stash api?
i was thinking both api and screenshot
to catch real time updates to some extent
is that actually illegal if its 1 physical click = 1 ingame click?
Overlay is against ToS I believe
A few other people have tried making tools that used overlays, and Chris said they are bannable.
aw =\
You can display a window over the game though..
means every steam user should be banned
if overlays would be illegal (which would be stupid)
That's not how it works
that link dosen't say anything about overlays
In-game clock and such were overlays and meant to be helpful to racers in keeping up with their position iirc
Overlays that hook into the game to read data, or manipulate data
yes but the reply didn't say anything about overlays. He refered to "modifications" broadly
and it's 3 years ago
meanwhile TradeMacro is ok -- it creates windows that sit on top of the game
Acquisition is ok -- third-party program, not a modification
streaming overlays are ok
Steam, other chat overlays including Discord, presumably ok
oh sweet, @fickle yew is in here now. Welcome!
@wind garden thanks ๐
if you scroll up you might see my conversation with Novyn earlier where I was asking how poe.trade know when people are online. he said its a private GGG API. Not sure if they would let you use it though. Wouldn't hurt to ask ๐
Yeah, I talked to him too. Still have to make sure that it would actually improve the rates. I'll consider requesting it for the next spree of development, right now I'm still a bit too busy actually playing Breach ๐
nice
have a few features almost ready.. already collecting data for 5 and 6 link uniques and the big graphs for prices for items are almost ready too
awesome, how do you determine price reliability? the green/yellow/red
number of people listing the item
Considering if histograms showing the distribution of prices would be useful. I'm thinking it might show items that vary heavily in price based on rolls.
mmm poe.trade complaints on the front page of reddit, just another day....
does GGG have anything new coming soon regarding trade? or do we not know/can't say?
my fav comment on that reddit thread was people conspiracy theorizing that xyz is employed by GGG on the down-low because he doesn't live in NZ
link?
I'm guessing it was this thread: https://www.reddit.com/r/pathofexile/comments/5ls60a/ggg_please_work_with_xyz_to_fix_your_api_andor/
those threads are usually always full of crap anyways
@fickle yew are you poeninja dev? I'd like to know if gem prices would be possible 20/20qual etc
@warm mulch I am. I've been considering gem prices, but there are a lot of possibilities.. 20/20, 20 non-corrupted, 20 corrupted, 21, 21/20 ... + Empower, Enhance, Enlighten etc.
Haven't quite found a way to cut it that I was happy with yet.
@compact isle Is there any way to link directly to a character on the character page? Maybe an extra query string or something? For instance, if I wanted to link to the character "Daltran" on https://www.pathofexile.com/account/view-profile/darkmage67/characters ?
Looks like it's picking the last active character based on some JavaScript set in the page.
I've not found a way to link direct to a character yet. Was thinking of scraping and providing my own funcionality
Your own functionality?
Replicating the passive tree and all seems a good deal of work ๐
But I guess that part could just be a link.
Yeah probably is reasonably huge to replicate but it's fun to learn and try
Yeah ๐
with pypoe installed on windows [full] where is pypoe_ui so i can run it
found it, windows search was bein dumb
:| runs but does nothing no error message in cmd
script file in there errors can share if anyone knows anything about it
sure share it
C:\Python34\python.exe C:\Python34\Scripts\pypoe_ui-script.pyw
Traceback (most recent call last):
File "C:\Python34\Scripts\pypoe_ui-script.pyw", line 9, in <module>
load_entry_point('PyPoE==1.0.0a0', 'gui_scripts', 'pypoe_ui')()
TypeError: main() missing 1 required positional argument: 'maincls'
def main(maincls, *args, **kwargs): in source. icic
well sort of
dunno what to give it
PyPoE\ui\__init__ has that line
my bet is some library is missing
thats different from the version i have dang it
I don't see any obvious bugs on github so try updating
issue was somehow i had a shit version
i used the zip on github before i thought
did git clone this time
seems to work
neat
why don't people understand that there will never be an auction house in PoE?
different people think auction house means different things
also new members of the community arnt aware of how its been done to death
"Fixed a bug where upgrading Essences in the Essences Tab would sometimes fail if you had the Nature's Boon Ascendancy skill."
I seriously wonder what kind of bug was that. How are they even connected...
As far as I'm concerned, AH means automatic completion of sales and items are held in escrow.
to me AH means bids
so in @wind garden's terms steam market is also kinda AH am I right?
well they did add an "ah" to poe china
no just market, steam market
was the china ah developed by ggg?
Think that was a special agreement either way
@chrome topaz what trade improvement would you like to see? Is there something you think would satisfy the majority of players?
no, it's impossible
I would like to see proper online status of all players with afk and dnd
What about all the price fixing though?
I think the two biggest complaints are AFK and price fixing
how are you going to prevent someone from buying all instances of an object and relisting for higher?
you don't, that's not price fixing and not a problem
supply and demand will balance out any such attempts over time
yup, exactly
i can buy all of the HoWAs listed at 10c and relist them at 20c. I might sell a few for 20c, but soon someone else will list it at 15c and then 10c. The price will fall back down and I'll be stuck with a bunch of HoWAs.
The worst part is there is no DnD that allows interacting with others, such as a "not-trading atm"
It's more of my annoyance with GGG and not xyz
What I'd like to see is a way to CoD items to people. Like a mail system.
Like WoW or FFXIV
I can see that too but it would require bots and GGG has a firm stance on that
They themselves would have to implement
not talking about 3rd party
GGG would definitely have to implement it
I was just talking about what the ideal solution is, GGG or otherwise
The only issue is that it can't be half done, I know sometimes I under or over price not knowingly but accidentally
Preventing sniper or mistakes like that would be hard
CoD mail is a great way to hold items hostage
could do a Master for it, for all it matters, asa little limited inventory shopkeep
if you send 3 offers, the first person to accept it gets it
and people purchase directly
Somewhat, but less player interaction in the second
I argue with myself on it, I would like the implementation but at the same time I really enjoy the current one
can reject or accept them
I hate AFK people and overpricing, but I enjoy it at the same time
It's like being in the mid-ages where I am forced to barter and deal with annoyances
I'm okay with it
I'd like GGG to have an ingame database like poe.trade that lists items and lets you search for them. But instead of messaging the person with "I'd like to buy X for Y", you have a button "make offer" that will get sent directly to the seller where they can accept or reject.
if they're away at the time, it'll wait until they can confirm it later
Yeah, that's a little better
buyer would have to confirm one more time that they still want to buy it once the offer is accepted
That's the BDO (they changed it) way
that way if they make multiple offers on different sellers, they don't end up with duplicates
but see, that's clearly not an auction house
but it is more automated than what we have now
however, doesn't prevent price fixing
someone could still reject every offer
I want GGG to release an item api
tbh it's a solved problem. Not perfect solutions of course, but there are so many solutions. I had to tackle trading in MUDs 20 years ago.
GGG are just idealists and not willing to pick a solution and go with it, they have to find the "perfect" solution and reinvent the wheel at every step
Just an api for all the items
all our suggestions are known solutions, some used in multiple successful games
they have heard it all before
but don't want to listen, they want to find their own solution
I don't see the issue, I really enjoy their decisions so far
they've said so about other parts of their process
well yes, I too enjoy the product of their decisions so far
just wish they could maybe wing it for once and iterate through many small changes than trying to find one big change that will magically solve everything
I can't imagine they're not working on something already. I think they've just been burned by communicating what they're working on before they know it'll work how they want. Then the public gets up in arms about why it isn't done yet.
"PoE tool development discussion"
I think it's relevant
@chrome topaz can we please have accesskeys on the main poe.trade form for submit/reset?
suggested on your thread before ๐ฆ
also was ignored the first two times ๐ but drama and complaining about delays will get you a response from xyz
What are you asking for? Some kind of API?
no, HTML accesskeys
will take all of 5 seconds to implement. I provided example code when I suggested it the first two times even
Ah i see
will improve usability on keyboard for actual human users
doesn't aid any baddies who can automate things anyway
I guess the drawback is adding like 30 bytes uncompressed to every page
I'm sure that's why he hasn't done it ๐
sorry, wasn't trying to be aggressive
you respond to stuff that is unrelated to tool development here if you're interested
so no need to tell us what this channel is for
I've added your change now
well thanks, appreciate it
me and the 3 other people who still browse with keyboards ๐
@compact isle any idea if there is a plan for an API for items?
what do you mean by this?
you can get that out of the ggpk, so i doubt there'll ever be an api for it
You can derrive it from the trade api.. I do.
That's why I asked @compact isle whether they will make one, because it's obvious that data exists
It would be useful
you can use the wiki api
I want an official api
I could easily make my own
I already have, but I would prefer to have an official one
that would basically be them providing an api to their ggpk file
it would be nice if they expanded the xml part of the official website yeah ๐
would make it a lot easier
xml part of the site?
like the ones here? https://www.pathofexile.com/item-data
yep
I do know that we plan to overhaul the data in the tables at some point
but there most likely isn't going to be an api for uniques / mods any time soon
That sucks
What table you need?
need< is kind of a strong word but an api for items in general would be nice
what would be the benefit of running an API continuously instead of providing the whole data set for download in say xml or json?
item data is completely static between patches
Someone is used to API?
API prevents having to generate the content yourself, easy consumption, consolidated way of doing it, and ensures that the least amount of issues occur
There are many test items inside Data/ files, it's hard to provide API by 3rd party
not really
like I said, I already have an API for my personal use
It would be better to have an official one though for the reasons listed above
an xml/json file with all the info on a static part of the poe website would be much easier for them to implement and just as good
It would get me at least 50% of the way to where I need to be, but it is a start
Oh, the site is just missing a portion of items
Is what I meant
I took your statement literal rather than abstract notion of static items
oic
@gritty olive: what site/app are you maintaining?
I have stealth sites being built, but I recently helped build https://poe.fyi
I had my own API server too
I'm building a tool that takes your current gear, compares it to available gear on poe.trade, and tells you if there's anything better within certain parameters. (Price, for example, or weighted towards certain stats.) I have a prototype working, but it currently requires that you have your Profile open in the background. POE's current API only seems to allow your Stash to be queried, not equipped gear. Thus, I need the Profile open so I can snag the equipment info directly from the HTML. ๐ฆ This makes me a sad panda. Is there a way anyone knows of to query equiped gear via POE's current API?
@pure ocean Use get-items instead of get-stash-items: https://www.pathofexile.com/character-window/get-items?accountName=<accountname>&character=<charactername>
though you still have to be logged in if the account is private
Thank you! That's perfect!
wow that's sweet
I'm curious, das poe.trade have an public api - especially for the currency?
no, not even a private api
๐ฆ
how does a site like poe.ninja get the data? obviously they get it from your site ๐
No. poe.ninja consumes GGG's public trade api to get it's data.
hmm, good to know - thanks!
sadly, I cannot build the tool with the data from the public api ๐ฆ
I think I read that poe.ninja also scrapes poe.trade to get offers outside the stash api stuff
It doesn't. (I'm the dev)
The only interaction poe.ninja has with poe.trade is links to trades.
Also thanks @desert needle! I used a lot of the information / posts you wrote while building ninja.
ah nice - awesome site you built there ๐
@fickle yew is it possible to make the linked searches have "Normalize quality" on by default?
Yes
That's a good point ๐
I also need to switch to base item search for maps etc.
cool, i thought you used to do it but not sure if something changed
I don't think I did, the search is rather simple.
Hoping to find a bit more time for more features soon ๐
is it open source? maybe we can contribute ๐
It's not.
Would take quite an effort of scrubbing history etc to make it open. Plus there's a lot of unrelated code in that repo
kk
oh word sorry! ๐
@fickle yew Gem extraction done: https://github.com/brather1ng/RePoE, see gem.json and gem_tooltips.json (there might be bugs, didn't get use it myself yet)
@woeful sphinx Nice! How are you supposed to map the stats to the per_level values?
Like Arc level 1 is: ```
"per_level": {
"1": {
"mana_cost": 9,
"required_level": 12,
"stat_requirements": {
"int": 0
},
"stats": [
{
"value": 2
},
{
"value": 35
},
null,
{
"value": 2
}
]
},
you have to merge static and per_level, see the .md for that
But I can't really find that they are min damage, max damage and chains
yeah, haven't found anything to force an order (other than alphabetic)
Looks like the gem_tooltips.json would be more appropriate for what I need actually.
Since it's closer to the ingame data.
might need a mix of them, gems is the raw data, gem_tooltips is reproducing the in-game tooltips
Right
Thanks, maybe I can replace my wiki data code then ๐
Will you be adding a guide to running RePoE in the readme?
Sure, the code there only produces the jsons though
Yup ๐
actually, I have no idea, the IDE seems to do more than i know, lol
Hehe.
Anyway, I'm off to bed. Thanks for the data.
You should post on pathofexiledev
night
will do that once it's a bit more fleshed out, which it might actually be now
PyPoe have gem extract code
I was thinking about using the public stashtab api to generate some info about my items throughout the league, what language would be the best to write that kind of stuff in? It doesn't need to be fast. I was thinking Python for ease of use but want to know what other people would use for small projects like these.
I'd go with the language you're most comfortable working in.
which would be Rust
but that really seems like overkill
and i dont mind learning something new
Well, depends if the goal is to actually get something working or experimenting with a new language ๐
A little bit of both
my latest project was in php - more precise the laravel framework
just to get a website
usually I'm a java guy ๐
is there anyway to get a stash tab for a specific person (if its public)?
you mean a gift?
you could form a guild with that person and let him use the guild stash as space
wait, what am i doing in tool dev
@uneven meteor don't think so, the only method I know requires valid session id of the owner of the stash
you would have to run through all of the stash tabs and pull out their account name
or character name
@mortal bone thats what im doing right now
but its really slow cause I don't know the most recent stash update
And I don't really care about historical data
yea
there is no timing data in the stashtab api correct?
the only timing data is when you read any particular update
there's no historic data in stash tab api
oh was about to ask, it only gives the newly updated tabs right?
i want to index enchant prices since poe.ninja doesnt do those ๐ฆ
also how much bandwidth would it use if i run the indexing from my local pc?
lol
dangit, i hate it when i respond to messages i read that are several pages back >.>
makes me look stupid
@uneven meteor I have some sample code I wrote in C# which is pretty easy to understand, you could use it as a starting point to search for a specific person's stash tab updates. It handles the stash API updating and converting the JSON into a easily usable class structure.
@chrome topaz how do you determine online status, is that a private API?
@wind garden i actually got stuff working for what i wanted to do
@gritty olive yes it is
@compact isle who do I talk to for usage of the private API
I have an interest in building something and that feature would benefit it greatly
i'm not sure if they give access out
I'll figure that out
if they do, @fickle yew should request it so his prices can be more accurate
what tool are you working on anyways?
Will discuss it once I flesh out portions of it, some parts are still in the air
try emailing support@, they should be able to redirect you to a developer
or maybe contact@
^ both of those will work, I'm away from the office at the moment but those emails will make sure it goes to the right people
so i built a python script
that keeps track of the changes in my currency tab
over time
now i have a 31kb json file
and i should probably figure out a way to display its info
https://www.pathofexile.com/character-window/get-stash-items?accountName=xiaoy312&tabIndex=1&league=tmpstandard&tabs=1
Can anyone tell me what's wrong with this api?
There is no league tmpstandard @mellow ferry and you probably have to be logged into the website for the API call to work.
I'm logged in
I changed tmpstandard to Breach
thanks that worked
do you know what tabs param is for?
number of tabs to pull starting from tabIndex?
i went to tabs=2 and it appears to show me what's in my hideout decorations stash
Same with tabs=0
Same with tabs=99 lol
Same with tabs=1330130 weird API is weird
yeah it is hard to use them when there is no documentation...
be helpful if it was self documenting, like, you know, github's api
yeah
iterate through tabIndex instead
actually i just need info from a single tab
now i just need an algorithm to find the right combinason of skill gems to produce 40% quality lol
tabs=1 means it returns list of tabs
what's with all the people showing as online on poe.trade but being offline?
is the online players api not working?
Seems like it's updating fine
With the introduction of new 'currency' are we going to see more options for buyout in the future? For example I want to sell uniques for splinters but there isn't an option in the public stash tab. I don't think there is one on poe.trade either.
Oh, thanks. ๐
I tried this and then searched up an item and it doesn't show the b/o ๐ฆ
my gosh, i've been looking for this for forever
why couldn't i find it before
maybe it didn't exist until recently
@wind garden Did you get it to work?
Well, I found this link in poe.trade so I don't think it's been updated for other types of currency. http://poe.trade/html/tags.html
it wouldn't be because you literally can't search for any other types of currency
the currency tags works for selling/buying sets and splinters just fine
I'm trying to sell my non-currency items for splinters. For example a Map for a splinter or a unique/rare item for a splinter. I'm not trying to buy splinters with chaos or alchemy or sell currency for splinters.
poe.trade and currency.poe.trade are separate
not all the tags supported on currency are supported for regular trade
Yeah, I realized this after I did a little more digging.
Maybe my original question was phrased confusingly.
yeah so I don't think you can list items for sale for splinters
only whatever is listed in the dropdown in premium tabs
seems like a deliberate choice that they want trade to be multilayered like
items <> main currency <> fragments/other
Yeah, I can respect it. I just like shortcuts ๐
stashi.org will release a 10min vlog sometime later today about our progress and challenges trying to fix the rare affix pricing problem
Is this the system that is being done as the school project? Or something new @normal idol
@mortal bone The project you're talking about is somewhat different. Paul (if that is the person I think you mean) is taking a close look at a massive amount of data on standard. We're focusing on temp leagues.
The idea is we get a continual reset so we can get an idea of what is in demand in the temps by looking at the ladder affixes in use in conjunction with other pointers.
Ah, yeah. The ideas are in a similar vein. It is a pretty cool idea. How many people are working with you on this?
Paul and I have teamed up and there are other testers from my guild helping to ensure the demand valuations make sense. He's tackling the problem his way and stashi.org is doing it our way.
We intend to compare and contrast our methods so that they can work as blind and double blind controls for antibias
is there supposed to be sound?
edit: yeah there is
Would you consider pasting the transcript to a pastebin and putting in the description?
Sure!
Great thanks. The Microsoft sam voice has been ruined for me too many times, plus reading is faster
I could have easily voiced it my self but was trying out the new Adobe Acrobat t2s so I could be lazy
Here is the transcript http://pastebin.com/d7DbiYpd
Hey, does anybody know if there is a way to get a character's current zone (/whois) from outside of the game?
there is no way
So, is stashi a site that will try to fix the whole every unique is 1 alc problem?
unique prices are purely a function of supply and demand -- if nobody uses a unique because its shit then its price will go down since the supply keeps increasing. you can't put out a valuation that says this unique should be X price based on its stats if literally nobody wants it
and anyway the transcript only mentions rares and rare affixes and doesn't mention uniques at all @dapper notch
@chrome topaz I've found a way to at least get my own zone at least
@dusky siren by parsing the logs ?
ya
what the heck, PoE is making the menus in my app lagg
if i close PoE, they're fine
open PoE, they're all slow and flickery
i've tried DX9 and DX11
woh
vsync fixed it
never actually had vsync improve something before
@timid fable yeah i realized that afterwards it was mainly talking about rares. i dont really id rares and when i do i only notice the crappy ones so i guess it wouldnt matter to me.
#stashi We will still be looking at uniques to try and give you an idea of how good your uniques are (with enchants and gg rolls) but it's nowhere near as detailed as the rare item problem that has a vast number of possible combinations of affixes to try and understand and evaluate.
Yeah, I get it. I'm still looking forward to Stashi. I always had a lack of knowledge when it came to rares. Hoping this will help people like me understand the market better. I have been playing since Domination/Nemesis and I miss the old days. When finding a unique was actually exciting.
is therea release for stashi now?
i started about half way through essence league and i use poetrade macro and have a good idea of what sells, but any other tools are always appeciated
@undone hull not yet still in early design phases but describing our process early to underscore our #transparency #opensource etc
i do ux/ui for a living if you need help @normal idol
@candid ridge thx sent you an inv to our discord
@candid ridge what language you use?
ux/ui is not a language
In a way it is
depends what you consider UX/UI design. You could specialize in WPF without doing too much backend coding yourself
@velvet fog the footer on your site is showing Unix epoch as last updated date ๐
Is there any way to get unique items out of the ggpk?
nope, they are on server-side only, like all other items are
base items and gems aren't
but seems like the wiki does a good job at reconstructing that, mod ids and stuff are in there
yes, gems are normal (base) items
well we've spent a lot of time mapping mods to unique items
nice
note that the wiki is not reliable enough to build other tools upon it
on the other hand there is not better source
yeah, I don't really have a choice
do you want to add it to repoe?
nah, would have done that when i could have gotten it out of the ggpk
i want to add unique crafting to PoESkillTree
what is it?
the offline skill tree planner
well there are too many posibilities in the game and developing a build planner is a huge pain in the ass ๐
yep, what we currently have is not easy to maintain. so it was mostly left alone.
Yeah, it honestly just needs a complete rewrite because some of the components are too integrated
@cardo: thanks, it should be v2.5.2.4 now
Maybe if we bother GGG enough they'll eventually give us a list of unique items ๐ฆ
but yeah you can use the wiki if you want for those, there is a post on the community portal thats details a bit on how to use the wiki API to get some of that stuff as json
look at ha107642's reply there ... at some point I should properly make this into a guide on the wiki
I'm already loading base items from the wiki API, getting uniques should be pretty similar. So that shouldn't be a problem.
It's about the same yea
they have the data, they could just release the relevant .dat file without the stuff we are not meant to see
it seems like they can't afford the extra work currently for that
at least when I asked about this last time
Is there a better way to parse item stats to Stats.dat's ID?
Augh, working on new design for poe.fyi and I want to post it but I know I should wait haha
what's new feature?
@obtuse citrus How to get a gem use mana or mana reserved from .dat?
@obtuse citrus : ActiveSkills.dat's SpellTotemId is correct, because all null dat files are the same. value range from 1 to row_size+1, all row_size+1 equals 0
3 hours later....Visual Studio finishes installing
you install all the packages? lol
Thanks @mortal bone I think so as well
@chaunsing maybe from the reference to activeskilltypes, currently its done manually for the wiki at least
@obtuse citrus : I can't find it too, thanks.
https://www.reddit.com/r/pathofexile/comments/5slqin/is_there_a_currency_tracker/ the excessive complexity of the proposed solutions in this thread is mind blowing
or GGG's lack of documentation is mind blowing
it's like everyone forgot there's already an API that lets you see your own stash tabs and inventories
What about acquisition... It counts your total exalts given a set of ratios
This already exists
pmuch
yeah I think they just want to take that to a level of like graphing it per hour or something, which is a cool idea
but it doesn't require using the public stash tab api >_<
Why not just use autoit to move your mouse over your currency tab and ctrl+c, then parse the text and convert currency ratios? ๐
How does authentication work for getting your own stash? Or is it only publicly visible tabs?
Prob better off adding the feature to acqusition than all the work of remaking everything it has
Can the api get private stash tabs?
the personal api can get your own, yes - but not others, and the public api can't get private ones
acquisition logs your currency every refresh i think
The personal api has a lot in it. It can be really abused though, so I would be careful with it
You can do things like buying MTX and such
woah
Yeah, well it is how GGG confirms your account and without OAUTH you can do everything they can
i thought the login that aqusition does with sessid could only read items, deng
Nope
The session id can literally do everything on your account
I don't think many realize this
lol unfortunate
Thread/PM spam and auto MTX buying are the only major things it can do
As far as I am aware
I'm not sure how far you could get into the point buying process either
Is it documented?
I haven't heard anything about it except in this channel
Would be nice to have my app only notify me about items I can afford
Not documented
The MTX Finder I helped finish up has some good examples of character/private stash api
At least the end points
Thanks
would suck if somebody logged into my account and bought me some mtx with their card
@mortal bone is there a way to fetch just the tabs list?
or do I just have to do a fetch with &tabs=1&tabIndex=0 and thend do a second fetch if my currency tab isn't index 0 and use the correct index?
girls familiar w/ shell: i got a command like so: ./thing_im_doing argument_of_thing && rsync (...) output_of_thing.html
how can i put this in the background? if i add another & at the end it just backgrounds the rsync
@wind garden: http://poedb.tw/us/article.php?id=API
@wind garden tabs=1 means you always get a list of tabs attached to the payload
"tabs": [ { "n":"<stash tab name>", "i":<tab index>, "id":"<stash ID hash>", "type":"<Normal|Premium|Currency|Essence|DivinationCard|Quad>Stash", "hidden":true | false, "selected":true | false, "colour":{"r":99,"g":128,"b":0}, "srcL":"<stash tab left image url>", "srcC":"<stash tab center image url>", "srcR":"<stash tab right image url>" }, ... ]
I would format it better, but I am on mobile sorry
looks like you have to pass a tabIndex along too @wind garden
I just committed a fix for it so that passing no tabIndex means it doesn't return items: [] etc
but idk when the next patch is
The current tabindex seems to default to the first tab
Thanks @compact isle!
so i'm able to get the stash json from my browser but not from my C# app
i'm assuming it's because my browser has a session already cached
how do I get a sessionID and pass it to the private API?
Take it from your cookies?
Then just use it as a cookie in C# as well.
do i just set a header for "Cookie" and "POESESSID=xxxxxxx"?
well i read WebClient doesn't support cookies natively
so i'm using an extended cookie aware web client
''' public class CookieAwareWebClient : WebClient
{
public CookieAwareWebClient()
: this(new CookieContainer())
{ }
public CookieAwareWebClient(CookieContainer c)
{
this.CookieContainer = c;
}
public CookieContainer CookieContainer { get; set; }
protected override WebRequest GetWebRequest(Uri address)
{
WebRequest request = base.GetWebRequest(address);
var castRequest = request as HttpWebRequest;
if (castRequest != null)
{
castRequest.CookieContainer = this.CookieContainer;
}
return request;
}
}'''
WebClient does have a CookieCollection afaik
hmm that didn't work
To use formatting type three back tics before and after the code
it isn't working
its ` not '
'''
echo "Hello World"
'''
echo "Hello World"
single quotes?
echo
oh
there we go
public class CookieAwareWebClient : WebClient
{
public CookieAwareWebClient()
: this(new CookieContainer())
{ }
public CookieAwareWebClient(CookieContainer c)
{
this.CookieContainer = c;
}
public CookieContainer CookieContainer { get; set; }
protected override WebRequest GetWebRequest(Uri address)
{
WebRequest request = base.GetWebRequest(address);
var castRequest = request as HttpWebRequest;
if (castRequest != null)
{
castRequest.CookieContainer = this.CookieContainer;
}
return request;
}
}
var cookieContainer = new CookieContainer();
var baseAddress = new Uri("http://www.pathofexile.com/");
var handler = new HttpClientHandler { CookieContainer = cookieContainer };
var client = new HttpClient(handler) { BaseAddress = baseAddress };
cookieContainer.Add(baseAddress, new Cookie("POESESSID", sessionId));
That's what I do
you can specify language with it somehow but never got around to that
HttpClient is the newer WebClient..
Did you see my code above yours?
ya
let me try
there we go ๐
i needed the baseAddress added to my cookieContainer
was just doing Add(new Cookie(name, value)) before
Ah yeah.
Ah, yep
awesome, it's working now ๐
my app can sense how much currency I have
and skip items I can't afford
Yep, the web api does take a bit to update sometimes
basically the same as public stashes
that's fine
If we can get stash items, would it ever be possible to set item prices via api?
unlikely.
imagine how amazing that would be though
could have an app to manage your item prices. Throw everything up for a high price and then programmatically bring the price down every time interval until it sells.
Yep, there are probably a bunch of those types of programs floating around
though you would have to use forums because you can't change item prices with a program
ya really inconvenient
would be easy if we could just submit json data
get-stash-items gives you an id for an item
poe.trade still parses forums if you wanted to
just pass that id back with a new price
It's a nice feature
we generally don't let modifications happen to the game backend from the website
since then there would need to be weird sync stuff
sad news
makes sense
Understood, but I still think it's a good suggesting worth passing on ๐
There may also be plans in motion that would make such a request unnecessary
so take it for what it's worth
@pseudo ocean just wrap it in a bash script and then background the script
Letting outside programs set your item's prices just encourages botting.
who cares?
in this specific case, the whole point of adding the feature is specifically so programs can set prices automatically
that's not a bot, that's just 3rd party development implementing features that should have been part of the main game
it's exactly the inverse of everything poe.trade does
you can't claim that's a bot and poe.trade isn't
program that lets you set prices = not a bot
program that sets prices automatically = bot
c'mon we know you don't care because you're smart, you can write your own tools, and you enjoy having an advantage
but a lot of people would care about bots automatically undercutting or pricing better than them
how does undercutting yourself give you an advantage?
it's not semantics, it's two different things. one is automated, one isn't
besides, such a thing would certainly be release open source to the community anyways
it would effectively equalize the supply/demand
allowing more items to be posted for less effort
everyone wins
I'm not arguing the pros and cons, I'm saying an automated tool is a bot
call it what you will
why pretend it's not a bot
you want a bot to set prices. that's fair, not judging you
that's fine
OK I don't think we need to continue arguing over bots here folks
there's just negative connotations with the word
avoiding the word doesn't change what it does. you'll just get ridiculed if you go out and insist your automated tool isn't a bot
game needs an npc that hangs out in player's hideout that sells the items in players stashes with buy out prices
hi wtb something, pls wait im in a map. would not happen anymore.
letting peeps come in to your hideout and only interact with that npc/stash would be pcewl
anybody know of a good tool to price rare items?
experience is the only way
could also look at that shows what gear top builds are running
the info changes too often is the issue
kinda, a good item will always be a good item
it might as well just say 4 t1 mods are gud
yeah but a good item can be 10c or 10 ex
depending on current meta
thats an extreme drift on a rare tho from 10c-10x
its demand for that particular set of mods that makes items valuable
and its rarity that gives them any base value
so you basically would need a tool that knows how rare certain rolls are and then compare it to what rolls top players buy on gear
which would still require an experienced player to understand unless the dev is a ui genius
Is there still a AHK Script / Overlay around to track your current ladder position for races? I think ExileTools had one, but itยดs down ๐ฆ
RIP exile tools
any way to get version number from Content.ggpk ?
I'm using patch_notes.rtf to identify Content.ggpk, but it got removed.
@velvet fog maybe get it from Client.txt log? when it connects to patch server
he has to get the updated content.ggpk somehow, right?
they sometimes offer a torrent of it
could scrape the first post title in https://www.pathofexile.com/forum/view-forum/patch-notes
I see, in that case they probably mention the patch version in the torrent too
i made a bot, can i test it in this channel?
I'd say probably not, you can make your own server instantly to test it anyway.
snipes underpriced items on poetrade and puts it in whisper form
is it something i could somehow share with this discord?
I think it could be a good tool for making currency, easy trades
As long as it doesn't automate ingame actions and just generates text from APIs/poe.trade, it should be allowed. I'd suggest posting the github link on the subreddit for better coverage though.
yeah you still have to paste the message ingame, its the same as clicking the link on poe-trade, ive never tried github.. will look into that
its really only to help people in discord that dont want to use poetrade..they could just look in a channel and see the best deals or easiest items to buy and flip for profit
It sounds good! Just make sure to have the source code visible for people. On the subreddit we don't really allow people posting executable downloads, unless we can see the source and verify it's OK
Oh there is no download, its hard to explain - can I possibly show you in a private chat?
@pseudo ocean how do you determine if something is underpriced?
The bot takes a pool of that particular items current and past prices seen within 12 hours..on a slow day i may increase it to 24 hours. It then only shows us items that if flipped would net us a profit of 35+% or 2+ex.
so do you have your own indexer keeping track of history?
The bot itself is just running 24/7 keeping track of everything, yeah
It is pretty helpful
i just read the api stream realtime but don't keep history
so i rely on poe.ninja for data
but it gets really inaccurate at times
i think it's because he doesn't have access to player online/offline status
so offline items throw off his averages
what stops him from having online/offline knowledge?
it's a private API
have to request access from GGG
and I don't think he's bothered
I've nudged, but no luck heh
you can mail customer support with your site / app and how you use online api
I'd definitely do that if I had an indexer
but i don't yet
since his site is publicly used so much i don't have any doubt they'd OK it
hmmm, mine supports online/offline access but I never requested anything from GGG
how do you get that info?
very carefully ;D
i mean, the stash api doesn't include that right?
He could atleast narrow it down, if he assumes most people have a premium tab he could run a verify on a sale item to show if its online or off
or maybe thats what hes doing already and thats why its inconsistant
could be
@fickle yew you around?
is that what you do then?
just infer?
@desert needle if you were to rewrite ExileTools again, would you still use ElasticSearch? Or are there other alternatives that you'd recommend?
@compact isle do you know why the JSON for items has a mixed datatype array?
{
"properties": [{
"name": "Stack Size",
"values": [["10\/10",
0]],
"displayMode": 0
}]
}
what's with the 0 after 10/10?
same thing here
{
"requirements": [{
"name": "Level",
"values": [["52",
0]],
"displayMode": 0
}]
}
there's a 0 after "52"
it looks like it might be used to indicate whether it's an explicit property or not
They are using the same structure as above, so it would make sense that they would be mixed
what do you mean as above?
that would make sense
xyz what do you use for your database on poe.trade?
it's text color
1 is blue, 0 is white
for items it's custom stuff
xyz is correct, it's the display style of the value
looks weird in json but makes a bit more sense in the backend
K I'll just have to strip it out and reserialize the json
hmmm, thinking about how to make an indexer is helping me see the challenges in getting accurate item prices
The problem is that the value of chaos:exalt changes from when one item is added to the index vs another
@desert needle chose a static value of 70c:1ex for the sake of having consistent indexing
the problem with that is when items are priced in chaos vs exalts
you usually have a mix of the two
so if exalts are much lower in value than what you chose (ie 70), then those priced in ex are going to be overvalued by any query you do
you can get better data by choosing the current exchange rate at the time of adding an item to the index. However, this causes another problem when you have older items in the index. Once the price of an item starts to move up or down, those items that are still left for sale throw off the averages
I think the best solution would be to price items at the time of adding to the index, and then query with a maximum age of 30min or something
you could price items as they come in then run a job that recalculates the relative prices of older items in batches
that's just not realistic as the index grows to a large size
would take too much processing power
surely you're not too interested in old items though
if you're just looking to flip
true
but then i would have to purge my index of old items
which messes things up
i guess what you're saying is query based on age and update only those items
you could just partition them then delete outdated partitions when you're done with them
yes
what I really wish is that I could calculate price at the time of executing the query
which is easy but then you have problems sorting
useless your query returns a small enough result set that it doesn't matter
If i sort by age, it might not be so bad
assuming I'm doing what poe.ninja does and only look at uniques and other similar items
it's only a few hundred items
the question is, is it worth doing all that?
am I going to get significantly more accurate results over what poe.ninja has today
poe.ninja is only inaccurate when the prices of things are moving rapidly
up or down
I haven't been following his data lately, does it get pretty inaccurate at times?
right, might be a side-effect of his anti-manipulation stuff
could be
only happens when the chaos:exalt ratio shifts up or down
and I don't know if you can avoid that inaccuracy
without introducing other types of inaccuracy
if you have to throw out so many data points based on age, you lose other useful things too
ultimately what you want is the cheapest item
it's just the manipulators that screw it up
too many to blacklist?
well that requires manual intervention
see here's what happens
i'm playing the game, I hear a ding for an item
at that point I have two options
I can either paste in the message and offer to buy the item
or I can look it up on poe.trade to see what it's really selling at
the latter prevents me from making an offer that's a bad deal
but wastes valuable time
if I'm at my desk, i can look up the item while I'm completing the trade
but If i'm remotely logged in on my phone, that's really difficult