Looking good!!
#tooldev-general
mortal bone
crystal hamlet
my parser can do everything on there on there except for nesting now, and builds me an abstract syntax tree representing the whole filter
chrome topaz
tacit steeple
^shrek'd
chrome topaz
I'd say same applies to the whole itemfilter system
GGG sometimes adds some weird features like that, or the forum thread bump system
pulsar moat
cere I took a look and it looks really cool! Great work
chrome topaz
I agree
crystal hamlet
i'm just building what i need to do what i want to ๐
it's actually a great little project to learn about parser and compiler stuff without having too much complexity in the language itself
fervent night
So for the developers out there, how many times do you make proper documentation when developing software for a customer?
mortal bone
what is your definition of documentation?
fervent night
pretty much everything, from designing the project, coding the project and testing the methods/functions, writing an implementation plan and after that the upkeep of the software
tacit steeple
u mean like changelogs for the thoughts themselves
crystal hamlet
there are very different levels of documentation - could be on a class/function level, or on a higher conceptual level, and of course tests are also a form of documentation
having documentation on a class/function level is pretty much mandatory just for working on a project with more than one person
(imo of course)
and excluding very small projects
tacit steeple
documentation like that is usually just comment-spam in the code itself
//this function does this
crystal hamlet
ye don't overdo it
fervent night
inline documentation yeah
tacit steeple
ez as fuck
i never do it tho
programming in a way that makes it obv is better for me
crystal hamlet
don't have a function doThisThing() with a block comment "does this thing"
those kinds of comments should provide some actual value
tacit steeple
something like CalculateDifference(Object<list>) is easier yea
makes it like blatant
what it does
crystal hamlet
the most important piece of documentation for people looking to get into the code is a short readme that explains how to get started with development and includes a short what's what
that in combination with readable code that has comments explaining things where appropriate goes a long way
btw i've started using visual studio code recently, it's actually great. originally got it because it was easy to get rust debugging and good completion going, but i think i might ditch atom for it completely
tacit steeple
its really light weight as well
great for a quick code-change or something
but i preffer visual studio community for larger projects
crystal hamlet
yeah i'm not using it for any .net stuff anyways
so far it seems kinda like atom but faster, includes a debugger, is just as extensible and has slightly better code completion (although that depends on the language and extension you're using)
crystal hamlet
way back before atom was a thing i used sublime, but i never bought it
then atom came along, had the same functionality but completely free
crystal hamlet
however atom is slower and doesn't handle large files well
tacit steeple
i dont like the layout and im too lazy to change it
crystal hamlet
too much gui? sublime has barely any by default
pseudo ocean
Does anyone have an idea why tier 14 maps are not getting hightlighted with this? http://pastebin.com/zAAe4bww
desert roost
@pseudo ocean Looks like you're missing this line:
SetColors 246 247 235, 246 247 235, @RedMapColor
lol thanks, how could I overlook that
outer jay
lol documentation
mortal bone
@fervent night most of the time, in my experience, people will not add comments in code unless forced to do so. This is because a lot of people think they write perfectly clear code.
Other forms of documentation are hardly ever updated, unless your project manager or technical writer update these things. I have been working with a few different apis over the summer and not a single one have correct documentation. It causes a lot of problems, and until someone points it out, they don't get fixed.
crystal hamlet
I've never seen that setcolors syntax in a filter, is that documented anywhere?
tacit steeple
honestly the visual studio feature of commenting makes it really fun to use
if people would use that more
that would be great
steep hinge
the feature using ///<summary> etc?
that's because there's like 3 people in the world who enjoy writing large documentation.
mortal bone
/// is handy when you have to document.
crystal hamlet
I enjoy rustdocs style of comments, it also starts with triple slashes but has no clumsy XML tags or other stuff like that. Following the conventions always makes the comment a readable markdown snippet at the same time
tacit steeple
/// is great but kinda clunky to navigate
something like adding what i want, pressing double-tab to get to the next field would be nice
but w/e
fervent night
Well I've found a docblock extension for Brackets about PHP. But Zend even has some docblocks about WordPress. But who uses WP, amirite?
fervent night
anyways why i was asking about documentation is because im currently doing my exams about development. but i hardly learned any coding and it has been more about documentation than coding. so that the customer knows what youre making and the future developers who might work on the project knows where or how the system would work
but if youre doing personal stuff i dont think i would be doing this much documentation
ebon oasis
as a person who never learned coding at school and mostly just does scripting level stuff for personal reason, document everything cos a week later you have no clue whats going on in the code :D
desert roost
Lol. I hope the link was to rick astley.
loud umbra
Was it a good one
tacit steeple
i hope that video contained dank memes
pulsar moat
Was it the Mathil video on setting up acquisition though?
fleet axle
So I'm looking at making something to learn how to code as a newbie. Looking to make a program to help me find the best currency to trade in via the shop api. What language are you guys using to make this stuff?
distant heath
Poe.trade doesn't seem to support essence mods like physical damage taken as cold
Any alternatives
?
ebon oasis
@fleet axle you mean the public stash api ?
fleet axle
yea that's the one, like how poe.trade gets its info
ebon oasis
well can't suggest exact language, but i can tell you to look for something that can easily parse json and that can handle huuuuge ammounts of data
cos you will have to sort through tens of thousands of items, probably hunderts of thousans
ebon oasis
not if you want store everything, you might get away with it if you sort through all the data and store only currency relevant
excel doesn't have native json parsing though, but i know of a library
fleet axle
okay cool, i'll look up json parsing some time in my free time
ebon oasis
sec, i should have the link somewhere
fleet axle
Thanks
ebon oasis
i actually wanted to do something too, but when i realized how much data you need to handle i kinda chickened out
fleet axle
how does poe.trade do it then?
could I piggy back off that some how and only look for currency trades which doesn't look like that much info
ebon oasis
[3:13 PM] Esge: hmm i did not realize the amount of data there is in the public stash api O_O
[3:43 PM] trackpete: make sure you enable compression in your client, it compresses at 4:1 or more since it's text
[3:43 PM] trackpete: but still can easily be hundreds of gig a month
thats from a few days ago
fleet axle
lol oh damn
ebon oasis
yeah
if you wanna piggy back on poe trade, then you don't need to handle the api really
you just need some kind of macro to click through currency and store values
there are a lot of web automation tools
pseudo ocean
i'd go with grabbing the relevant routes, putting them in a list, then using something like request' in npm or requests in python's pip and then parse the results.
i've heard before that poe.trade is not a fan of scraping, but i've never heard a source on this. up to you
python and node are probably what i'd go with if i was a beginner and knew about which languages are easiest to get help with
ebon oasis
yeah, i can imagine, i wouldn't be a fan of scraping if i ran a site like that either
chrome topaz
@compact isle why do all mods have lower case "chance to ..." except "Chance to Block"?
crystal hamlet
scrapers are also hella messy to write
(as someone who has written a few scrapers)
old beacon
it's a reminder never to buff block again. (jk)
compact isle
lol I have no idea
hard briar
if i just wanted to get my character/stash info from the main site
would I be writing a scraper to do that?
tacit mango
hard briar
@pseudo ocean thanks
fervent night
fuck
anyone here who knows stuff about making own plugins for wordpress? got a silly question about adding the admin css files to my wn plugin files, isnt there an easy way to include a file that already exists from WP into my own plugin?
crystal vapor
Hello, can this tool https://github.com/Retik/WhatToFlip still made to work? It used exiletools api.
desert needle
nope :/
not unless someone updates the exiletools indexer and makes the resulting index available
crystal vapor
damn, that sucks. I guess if someone does it, he going to keep it for himself :/
compact isle
to anyone following badges / supporter titles, they now have text IDs rather than numerical ones
mortal bone
Seems odd that they didn't before
compact isle
yeah I was lazy
waxen musk
how much would it take to convince ggg to make an official search api for trades?
desert roost
Not really the correct place to ask that.
waxen musk
anyhow i had this idea, idk if its been done or attempted before, basically a site where ppl post items and others can pricecheck them, sort of like yahoo answers for pricing
as long as there are enough ppl interested in participating it could work out pretty well
desert roost
You mean like http://www.poeprices.info/
waxen musk
uh no thats automatic and it tries to guess the price based on stats
i was thinking of a manual one where ppl can price stuff and they would have a reputation of sorts for how well they 'guessed'
because i saw some ppl actively pricing a bunch of items here in price-check channel
desert roost
Sounds feasible, as long as you manage to keep manipulators in check.
And somehow entice people to actively price check things for other people.
the price check channel is one of the most dead channels, probably second only to the lfg channel.
waxen musk
yeah manipulators would definitely be attracted to that, the thing is my research paper is related to dealing with these kinds of voting systems so i thought it would be a cool idea to try
there are basically systems that evaluate peoples' honesty by comparing their answers to the majority, and then adjusting everything based on that
desert roost
Sounds like an e-merchant rating system.
chrome topaz
is anyone responsible for the wiki here? http://pathofexile.gamepedia.com/List_of_unique_weapons this is missing a lot of unique wands, like "Apep's Rage", "Reverberation Rod" etc
woeful sphinx
OmegaK2 does that stuff and he's not on Discord I think.
You could contact him through Reddit or the wiki itself (http://pathofexile.gamepedia.com/UserProfile:OmegaK2)
old beacon
hey XYZ, if i get the perfect jewel mods all configured into a search, can i book mark that specific search or does the end of the URL that is generated expire
eager swift
@old beacon you can bookmark that search
compact isle
@chrome topaz seems fast to me when I checked it just now, is it still being slow on your end?
chrome topaz
@compact isle yes very slow
normally when there are that many items it's about 900-1000 items/s
but now it's like 2-3x slower
so it gets seriously backlogged and I can't do anything about it
compact isle
hmm, unfortunately I'm going to be away from the office for a few days so I can't help much
I've told the server guys about it so hopefully it'll get fixed
round mauve
How many requests does it usually take to download the full current state from the public stash tab api?
Any way to get latest change id (without going through the whole river) and only listen for updated stash tabs?
compact isle
I saw earlier that /u/rasmuskl on reddit's tool makes his next-change-id public: http://poestats.azurewebsites.net/esc/stats
it usually takes quite a while to download the whole thing
round mauve
@compact isle That is awesome, but couldnt this functionality be in the official api?
compact isle
it's a feature that gets requested a lot, but not something easy for us to do right now
fleet axle
Not sure if this channel is the right place to ask but what language is poe made in?
ebon oasis
i think its c++
compact isle
it is made in C++ yes
mortal bone
C++ and I believe heavy use of the Boost library
plucky sail
Seems like procurement doesnt work anymore...what else is out there
desert roost
Acquisition.
jovial bear
Do you know of any API I could use to get an up to date currency ratio ? I'm still working on the userscript for poe.trade and I'ld like to work on pricing query
ebon oasis
i don't think there is any public api aside the official one
but poe.ninja has currency rations
jovial bear
Yeah I saw that, I might parse that data =/
ebon oasis
having something easily parsable without dealing with the ggg api data would be nice but alas, i lack the skills to do something about it
jovial bear
or I might work on an even more tricky part, we'll see ^^
ebon oasis
gl
jovial bear
thanks ^^'
jovial bear
So since there are no api for currency rate, I guess one doesn't exist for a list of uniques/div cards/skill gems/mods/anything
a huge json maybe ?
ebon oasis
yup, you get everything in the ggg public stash tab api
and have to sort through it yourself
jovial bear
mmm
I'll look in it but I don't care about public items, I just want a list of existing uniques/div cards/....
jovial bear
yep
so I can parse it to get info/name/anything
it can be used for various situations
and I personaly want it for autocomplete search
ebon oasis
yeah i dont think theres an api for that
jovial bear
ok...
ebon oasis
maybe @compact isle knows better
jovial bear
If I have time maybe I'll try to do something then
I'll have plenty of time in a week since my internship will be finished
ebon oasis
i got scared away by the amount of data -_-
jovial bear
Ahahah yeah, I'm diggin into exiletra.de code and it's huge
ebon oasis
poe.ninja has a stat info about api
Stash Tabs proccessed 7829611 stash tabs
GGG API download 285.48 GB
jovial bear
But I can't stop to think that having a common normalized api about unique items, div cards, mobs, well anything... would be awesome
ebon oasis
yeah, like item list and stats would be nice
sacred vigil
anyone know if theres an offline skill tree planner for Mac OS? Like just an Electron wrapped app would be great, havent been able to find anything resembling the one for PC though
jovial bear
In fact, i might try to build sth ahah, it looks fun ๐
timid hemlock
@compact isle The accountName parameter isn't case sensitive for character-window/get-characters, but it is for /get-passive-skills and /get-items. Any chance of a fix?
compact isle
sounds like a reasonable request
waxen ridge
@jovial bear I did some work recently on uniques and their information and ended up working with some HTML scraping of the data on the wiki, since there is no official api for data on uniques
I was building a discord bot, much like the reddit one where you type "[[Name of unique]]" and it would reply with the unique data. Unfortunately the wiki is crowd sourced data so not always 100%
jovial bear
Yeah I remember your project (is it finished yet ? ๐ ) I'll try to learn a few things about normalization, json and Apis before diving in this "small" project but I can't help thinking it would ease the work for a lot of us, fan developers, by not reinventing the wheel for each new idea.
woeful sphinx
@jovial bear We have written Gem list, base item list and affix parsers for the offline planner. See https://github.com/EmmittJ/PoESkillTree/tree/master/UpdateDB for the code and https://github.com/EmmittJ/PoESkillTree/tree/master/WPFSKillTree/Data for the resulting xml.
jovial bear
Thanks a lot !
mortal bone
Yeah, if we could add unique to the updater then we would pretty much have all the information (from the wiki) in an XML format.
jovial bear
Can I use your xml files and make them into json one, (and probably adding stuff) ? Also apart from uniques we lack maps in this format
And anyway, what do you think of the idea of a centralized api in json/xml/whatever with all data stored and updated by devs and community.
It would be far more efficient than just parsing the wiki here and there don't you think ?
Also it would, as I said before, help every dev, in the sense that they won't have to do the work again
jovial bear
What's the reason behind the choice of having a "from -to" for gems mods instead of repeating some of them and having static values for the ones that never change ?
woeful sphinx
It's MIT licensed, so you can do pretty much whatever you want with it.
I might look into separating all the data stuff from the main repository into a new one, which could then serve as a centralized repository for all the data stuff.
The gem list wasn't initially done by me, so I don't know why things are done this way.
jovial bear
Ok ๐
did this draft this morning :
I'm planning to do so for every kind of item /mods
woeful sphinx
Well, that is a lot more information than we have. Also, prepare for a lot of fixing stuff over time. The wiki changes its HTML around frequently.
jovial bear
Yeah that's why I wan to get all the info from the wiki at first
and then be completely independant from it
woeful sphinx
You want to only parse the wiki once and then update it all manually?
jovial bear
once everything is done, the updates won't be so heavy no?
Except for extreme changes such as maps this league
woeful sphinx
Well, new uniques, changes to uniques, gem buffs/nerfs (with values that are not entirely clear from patch notes), ...
That is going to be a lot of work.
woeful sphinx
And all of that in files that could be 100 thousand lines long.
Most of the wiki is updated automatically from the ggpk file. So most of it will be always correct and up to date
jovial bear
Yeah well having a program to add an entry / update a file is still doable
oh didn't know that
I think the more info we have on it, the more usable it will be: every dev will just keep what they want but in the end I feel more is better here
woeful sphinx
Yeah, sure. It will be about what is worth the time investment for writing the parsing code vs. what is useful.
mortal bone
Really we need to parse the ggpk if we want accurate information. This is what the wiki dies (mostly updated by a bot)
PyPoE I believe is used as the base for that bot
PyPoE I believe is used as the base for that bot
Parsing the game files would be much better and allow for basically any format
waxen ridge
Whoops sorry I've been away. Bot's mostly done, there is still some hosting I need to sort so It's up 24/7 and Shae wanted some rules but honestly we could roll without rules and just let chat moderators do some work to begin with
ebon oasis
this chat seems pretty tame tbh, even mods probably have barely any work
seen and moderated worse..
desert roost
If you don't notice anything going on, we're doing our job perfectly :D
ebon oasis
true, gj
the ability to delete messages is a great thing though
used to modding irc
desert roost
Discord does make moderating fairly simple, so I'm thankful for that.
jovial bear
Hey @woeful sphinx, did you try to parse poe.db instead of the wiki ?
woeful sphinx
No, the wiki did work fine for everything I wanted it for
jovial bear
ok
compact isle
@pulsar moat "playing" IntelliJ huh? ๐
pulsar moat
I think I've logged about the same amount of hours in IntelliJ as I have in PoE, too bad there isn't a /played!
compact isle
haha you should definitely suggest that to their dev team ๐
as well as /deaths for crash count
waxen ridge
Does the XYZ guy frequent here by chance?
desert roost
He's around occasionally.
waxen ridge
Oh found him in the autocomplete names!
@chrome topaz When you see this, was wondering if you'd have a chance to add the names of the maps to poe.trade autocompleter?
waxen ridge
Heya @compact isle You remember a few weeks ago an issue with flask having the incorrect graphic on the website? I'm noticing it's still an issue.
It should look like this
it actually looks like this
chrome topaz
@waxen ridge unique maps? they should be already here
if you meant normal maps you can just use the "base" field
waxen ridge
@mortal bone I've tried now on two different machines. Same problem
mortal bone
doesn't mean much
if it is on the web site it could be cached
is in on a character profile or something?
waxen ridge
@chrome topaz thanks I did mean normal map names. I suppose the base is a reasonable solution but wasnt my first thought to use it. Cheers
Yup it's on my character profile. Last I spoke with @compact isle he said he was going to bust the cache and that was a few weeks ago
mortal bone
I just equiped one to a character, and it looks like the API is returning the wrong item icon
compact isle
not at the office for a little while sorry, I'll look into it once I get back
frozen rock
Who do I have to love for these? 
desert roost
Googa.
obtuse citrus
@blocknite @jovial bear @woeful sphinx @mortal bone Instead of parsing the html you have another option now that the wiki uses Semantic MediaWiki; you can use an API to query / retrieve properties from the pages in json format. I'm not sure whether the wiki will stay on SMW indefinitely (there is a move to cargo being considered), but in any case for the meantime this should be a solid option if you want to retrieve data from the wiki.
There are a few details on how to do it here in my reply to ha107642 https://pathofexile.gamepedia.com/Path_of_Exile_Wiki_talk:Community_portal#Item_template_v2:_Updating_unique_items
jovial bear
that goes to a pinned tab thanks
obtuse citrus
Since Emmitt mentioned PyPoE, it's another option, just be aware that the wiki compared to the raw data contains a lot of processed information, as well as additional information that isn't available in the game data. One of the bigger examples is that you can't really retrieve unique items form the data right now
woeful sphinx
@obtuse citrus Nice, thanks!
mortal bone
Hmm, OK. I wish there was some official way to pull all this info... it is kind of annoying to not even have all the info in the game files
@obtuse citrus thanks for the info :) an api would be a hell of a lot easier
obtuse citrus
@mortal bone: Yeah I wish this was the case, I've proposed to GGG they make the info available as official API but it doesnt look like it's going to happen anytime soon if it happens
mortal bone
I guess you could technically use the public stash tab api as a form of this. It should contain almost all unique items at some point
Easy way to crowd source unique item data
obtuse citrus
I believe the inherent problem with the stash tab API are that the abstraction level is already too high. For example it doesn't have the ranges of the mods, and they need to be manually parsed out of the translation text, which due how translation strings are handled can have a lot of problems
On the wiki we just went through the trouble of 'reconstructing' the relations between items and mods so we can still use exported mod data for some purposes
Actually to more exact it doesn't even show the mods at all, just the resulting strings. I bet xyz would like to see actual mods too so we can properly search for items having specific mods ๐
chrome topaz
it's just same format as with forum, i think they repurposed the code which originally was only supposed to be used for display, not datamining/indexing/etc
desert needle
yep, definitely.
Even to the point where having like numeric color codes for elemental damage types instead of actually saying what element it is and stuff, really annoying.
You have to dig in there and go "oh, ok, 3 is Fire, I'll add a lookup table for that." Pretty bad.
mortal bone
You could infer ranges from hundreds on uniques though. The mods are a pain in the ass, but you really only need to parse number(s) from the string and everything after is the mod irrc.
or just replace numbers with # and store it like that
We do this with the offline planner when parsing mods on the tree
waxen ridge
Woot thanks @obtuse citrus i'll have a look at the API you got.
Honestly, if I could do a bit of extra work at night to help out GGG with an official API for that stuff I would do it.
waxen ridge
Understandable if there are items you don't want visible, or stats you don't want visible. Filters on that should be an OK solution though right?
Uniques should have less of a worry since they only really change due to balancing
compact isle
yeah my suggestion was allowing items to be "turned on" as the community found out about them
but there are other priorities of course ยฏ_(ใ)_/ยฏ
waxen ridge
Of course these are only QoL equivalent features. Like I said though happy to come help, I only live 5 minutes up the road.
ebon oasis
@compact isle are you saying theres stuff in game thats not yet on wiki? :)
compact isle
I mean more at the start of leagues ๐
ebon oasis
ah right
runic drum
@mortal bone the offline passive tree's wiped my saved files like three times this week
is that a known issue or some shit
mortal bone
That is not a known issue. What version are you on?
manic mason
Hey, im trying to create a little tool for displaying stats about a gem with html+js and the json export of pypoe. So far i managed to get the skills available from SkillGems.dat and their names from the BaseItem but i have no idea where to look for the gem progression and levels, maybe someone can point me in the right direction?
mortal bone
@runic drum Hmm, we are chaning the build structure in the next release pretty massively. I am not too sure what the problem is though or how it is happening. Do you have any details?
obtuse citrus
@manic mason you'll also need ActiveSkills.dat GrantedEffectsPerLevel.dat GrantedEffects.dat ItemExperiencePerLevel
STR/DEX/INT requirement is based on level requirement and the % of the stats on the gem. There is an utility function for it http://omegak2.net/poe/PyPoE/_autosummary/PyPoE.poe.sim.formula.html#PyPoE.poe.sim.formula.gem_stat_requirement
runic drum
@mortal bone from what i can tell these wipes happen when i open the program by accident and close it before it finishes loading. most of the time it doesn't wipe but it's done it two or three times
coral frost
is there a website (not ahk script) that lets you copypasta an item and it tells you the mods like the ahk script? (I run something the background that doesn't let me keep the ahk running)
torpid mesa
Not that I know of. What u got in the bg
mortal bone
@runic drum Yeah, that will be fixed in the next rendition of the planner.
limpid helm
Does anyone know why Silvertongue is not being indexed on poe.trade?
desert roost
@limpid helm http://poe.trade/search/baroikiriwooba
Slivertongue, not Silvertongue.
limpid helm
@desert roost woah thank you. Rip ๐
analog orbit
Hi all, got this proof-of-concept stage project that will bring in-game like features to the game, see details in my reddit post:
Cheers!
torpid mesa
Neat, is this an actual overlay or an always on top window? @analog orbit
old beacon
make like steam overlay, profit (rekeybindable of course, i can imagine the rips from accidentally overlaying)
torpid mesa
ah darn
someone needs to make a cool library so people can piece together tools like yours into a proper overlay
analog orbit
what do you mean by library?
dusky siren
Is there a reasonable way to get equipped items on a given character?
pseudo ocean
torpid mesa
@analog orbit well not nec a library but a tool that lets you put stuff of your choosing into a proper overlay like steam and discord have that people can use to customize a nice overlay
analog orbit
well, I think WO is exactly that. It will load any URL you want and also provide APIs that would be needed for things like client logs parsing
analog orbit
just curious, what makes an overlay, an overlay?
what I have so far is an actual separate window, always on top, but "undecorated"
but can be activated with a hotkey, like you would with c for character window
torpid mesa
it has to be a sub window of the game
basically its rendered to the same gl or window thing
that way there is no weird focus issues and it works in fullscreen
also when the parent window is moved your overlay is naturally as well
this can set off anticheat stuff though so you ahve to do it right
discord and mumble can do it
steam does it of course
it sounds like a minor difference but its a huge qol for stability and correct behavior
dusky siren
@pseudo ocean Great, thanks
buoyant tundra
mortal bone
Someone had thought about adding a wiki bot, but I don't think it is operational
analog orbit
@torpid mesa i see, thanks for expounding it for me. Sounds good. But sounds like something I won't easily achieve with java
torpid mesa
yeah prob not unfortunatly
waxen ridge
Sorry! @buoyant tundra I have a working unique bot (similar to the reddit one) but as @mortal bone said, it's currently not online right now
analog orbit
does the name "Wraeclast Online" makes sense?
https://redd.it/59590g
analog orbit
btw, i'm working on it right now.
Anyone wanna do the work on imitating the PoE GUI with CSS?
analog orbit
compact isle
does anyone know if there's a community defined standard for listing items by silver coins?
torpid mesa
only if xyz defined one
he has a page someplace on what text to put in
dunno if its updated @compact isle
https://github.com/mumble-voip/mumble/tree/master/overlay wonder how hard it is to rip this out into a seperate library
it seems well organized
looks like it might basically be one already
compact isle
it is a separate library, but it's not easy to interface with
yeah, xyz doesn't have an entry for it
torpid mesa
yeah it looks like the interface is super weird, it has blit but hides a bunch of stuff behind messages maybe
dont know c++ well enough to care to figure it out AND relearn c++
compact isle
it's also deeply integrated with mumble stuff anyway
torpid mesa
yeah looking closer the message struct has fps and other hard coded properties
lamesss
pseudo ocean
people don't really trade silver coins unless they're buying/selling them
ebon oasis
theres an imposter !
compact isle
ah awesome, cheers @chrome topaz
tight igloo
That moment when your downvoted programming question gets a reply from Chris Wilson himself
Damn, PoE is amazing
torpid mesa
pcewl
though are you extending the abstractnode in order to make each node on the tree?
in poes case i feel like only jewel sockets really need special handling
mortal bone
Looks like they are designing a game with a skill tree in mind
mortal bone
PoE has cases in terms of flags, but nodes in general are pretty abstract
Position, Icon, stats, connection nodes, then a series of flags to tell you what kind of kind starting, jewel socket, etc.
torpid mesa
icic
mortal bone
Yeah, skill trees are pretty basic, so I am curious as to how @tight igloo will improve it
or change it
wind garden
out of curiosity, since @desert needle took down this indexer, do you guys know of anyone who's used his source to host one of their own?
desert needle
it's not doable without heavy modification
the most recent patch broke a lot of stuff
wind garden
aw that's too bad
near gate
I committed my initial Linux tools work for PoE. A server component hooks into the PoE process so that text can be overlayed and keystrokes emitted via DBUS. A nodejs client is used to implement macros, DPS calculations and price lookups using poeninja's API. I'll be contacting GGG to make sure they're okay with me hooking the PoE process for macros and an overlay.
If you plan to build it, it's easiest to use a 32bit container.
torpid mesa
If it hooks like mumble/discord and ask should be fine but any other way prob not
Aka a layer higher than modifying the running binary
near gate
They already responded. They said anything that hooks the process isn't allowed. I'll have to rethink my approach.
wind garden
mmm very pleased to find that my item scanner is still working despite not having updated it since prophecy league
just finished adding a feature that pulls the latest league names and lets you select which league rather than hardcoding it
if only there was a way to get the current exchange rate for chaos:exalts
anyone know of an indexer with a web api?
low prawn
chrome topaz
@near gate make it a patch to wine then they can't find out
wind garden
how does poe.ninja parse data from poe.trade? Does it just parse the raw html pages?
rose flicker
If I look at the self description of poe.ninja, it does not parse poe.trade. It says, it uses the public stash api:
How does it work?
The site constantly consumes Path of Exile's Public Stash Tab API, keeping track of all relevant items for sale.
timid fable
dunno who to tag about this. Looks like http://pathofexile.gamepedia.com/Incinerate and http://pathofexile.gamepedia.com/Strongbox was messed up during generation
bunch of lua errors presumably from one of the pypoe tools
woeful sphinx
@obtuse citrus I guess
desert roost
@timid fable Best to message the admins of the wiki I'd imagine. We don't have wiki admins here.
desert roost
Oh, lol
Would be great if I did that, but I don't really work on that side of the wiki
timid fable
now i have no idea if it was a tool error or an error on gamepedia's part
cos there's no new commits
desert roost
Well, I literally just got the error when I tried myself
refreshed the page and it fixed itself
timid fable
weird...
timid fable
it might be gamepedia then. this just happened http://pathofexile.gamepedia.com/Deal_with_the_Bandits
but I have no idea why they'd be using Lua for web frontend
desert roost
Server may be running out of memory?
timid fable
but why would it be Lua is the question
desert roost
Honestly don't know the answer to that.
timid hemlock
the wiki uses Lua scripting for a bunch of the backend stuff
timid fable
i see. i wouldn't have thought it was on the fly though
assumed it would be generated once and written to the wiki
mortal bone
It needs to be generated on the fly because of how many links there are. There is no way it would be able to be a static page
timid fable
that doesn't make sense, number of links doesn't matter, frequency of change matters. in fact the more things there are the better the case for making it static
one would also hope gamepedia caches well but i guess we don't have control over that
mortal bone
I didn't mean actual links I meant dynamic links between pages. Statically generating these pages isn't a good option at all. You would have to render out each page that a page is linked in/to on an update. It is pretty quick for a server to make a call to some data on page load and render on the fly. It technically generates a static page but from dynamic scripts on the back end
obtuse citrus
server the wiki is on was low on resources, it should be fixed now. If you see any new memory errors showing up I can let curse know
desert roost
Thanks!
obtuse citrus
and lua is used on the wiki as an alternative to the wierd shitty wiki scripting markup. And basically what Emmitt said - a large number of wiki pages are more dynamic these days rather then static. Done on purpose so the information can be put into one wikipage and then fetched from other pages, rather then having the same info in a ton of pages and being oudated
as for the caching, there are 2 caches on the wiki
a) the wiki caching itself. Basically the generated pages are cached by the wiki. This kinda refreshes itself after a while, but usually within a day. Sometimes with the dynamic stuff if the data changes the pages still may show old stuff for a bit until the wiki goes through and updates it
b) cloudflare caching that just catches the entire page somewhat independently. So sometimes it caches broken stuff even if the wiki has been updated/fixed already. If you have a gamepedia account with PRO status you basically bypass that and see the live version though
Issues with the a) kind of cache can usually be fixed by simply going to edit mode and saving the page without changes. It should update it. (or waiting it out)
mortal bone
https://github.com/EmmittJ/PoESkillTree/releases/tag/2.4.1 new offline planner release ๐
woeful sphinx
๐
mortal bone
thanks for your work man
wind garden
do we know when GGG is releasing new passive tree?
or if there's even going to be a new tree?
compact isle
we usually do a thing about a week away from release
with tree / item filter info and stuff
frail knot
my poe skill tree crashes a lot of the time
also wipes all my trees on updates
why this happen @mortal bone
mortal bone
I need the debug.txt file
It doesn't wipe them
this is technically a completely new version
mortal bone
so it will be in a differen folder
frail knot
what directory are the old builds in?
frail knot
ah ok
is there a faq/note of this on the documentation?
cause every update ive done i lose my build list
so im sure someone else is having issues with it
wind garden
does the owner of poe.ninja ever hang out in here?
ornate spade
you cant see a ninja
mortal bone
I don't think so
desert roost
I've seen him on here a few times, but not as of late.
wind garden
@mortal bone have you seen this bug in the planner where you drop in a build file into the builds directory and it endlessly asks you if you want to reload builds every 5 seconds or so?
actually, it only keeps asking you if you want to reload as long as you keep clicking yes
once you click no it stops
easily reproducable
wind garden
strange
wind garden
I'm trying to get raw html from poe.ninja. But the page is almost entirely javascript. Is there anything I can do to get html from it without a browser?
wind garden
dang, figured it out
but man was it not easy
I'm using C#, had to use CefSharp which is an entire c# implementation of the chromium browser
massive overkill for my small app, but at least it works
i may find a smaller solution later, but at least this gets me by
actually, just found a PhantomJS implementation for C#
or wrapper i mean
compact isle
can't you just use his data API instead of loading the page?
wind garden
he has a data api??
are you just assuming there is a data API I could use? or do you know something I don't?
mortal bone
you would want to ask him first
but he probably has some calls he is making for the data he has stored
wind garden
do you guys know who "he" is?
doesn't have any contact info on the site
I assumed they wanted to remain anonymous
what I have now works, but I'm embedding an entire chrome browser, increasing my app size by over 70MB. Just seems like a waste.
wind garden
cool thanks
compact isle
yeah looks like he has a few endpoints (http://poe.ninja/api/Data/GetCurrencyOverview?league=Essence for example)
I'd talk to him before using them of course, but it'd be a lot easier than scraping the page with PhantomJS
wind garden
Ya I messaged him on reddit and he responded
said it was fine as long as I wasn't distributing something publicly that would cause excessive load
torpid mesa
neat
wind garden
ya saves me a TON of work trying to parse html
wind garden
ug, just spend the longest time trying to figure out why my item wasn't showing up on poe.trade. Finally realized I'm on standard, not essence
uneven wyvern
anyone else having trouble with lutbot on dx11? says it was fixed for dx11 but still doesnt work for me
nvm got it
chrome topaz
lutbot is such a bad name, it totally sounds like loot bot which totally sounds like being against tos
mortal bone
Yeah, I was confused
compact isle
just a heads up for tool peeps, item json for flavourtext is going to have some markup in it on some breach items
looks something like <default>{Actual text here}
desert roost
Thanks for the heads up!
wind garden
What does <default> mean then?
compact isle
it's for colouring the flavour text, default means the default colour which is #7f7f7f
really annoying from a json data perspective I know :/
compact isle
cool stuff! Will have to check them out
weary ridge
who makes Filtration? is that still updated?
weary ridge
will it be updated or did he drop it?
timid fable
maybe he could answer that..
mortal bone
Create an issue on github?
That is what it is there for
If there is a problem report it
cold garden
is it possible to stream dx11 client from obs? and why ingame overlay doesnt show in dx11 client?
timid fable
@cold garden this is not a question for tooldev. but see https://www.reddit.com/r/pathofexile/comments/5e6lyi/directx_11_client_and_obs_black_screen_game/dafsmrt/?context=1#dafsmrt
wind garden
@chrome topaz if two characters are selling currency for the same price, what determines the order they are displayed in?
coral fjord
@wind garden not 100% sure, and I am not the one you asked, but I am pretty sure it is based on when it was listed, more recent listings appearing first.
wind garden
hmm alright, thanks
chrome topaz
@wind garden it's randomized
outer jay
It used to be based on order right?
chrome topaz
based on order?
chrome topaz
@compact isle are we going to get breach itemfilter update info?
outer jay
Based on the order posted
wind garden
Random makes more sense, ordering them on list time could be abused
wind garden
@mortal bone just posted an issue on the PoESkillTree Github. Getting a crash 100% of the time when loading a pathofexile.com skill tree after having previously loaded a saved build. Included stack trace.
exception is: System.FormatException: Invalid length for a Base-64 char array or string.
wind garden
k
mortal bone
Already fixed
wind garden
guess I should have asked first
mortal bone
Or look at closed issues ;)
wind garden
i went ahead and closed the github issue
i didn't look at closed issues because there hadn't been an updated released yet :/
i wish i understood why this PC has issues with it asking to reload builds constantly. It's local to this machine, doesn't happen on my PC at home.
and evidently doesn't happen for you either
mortal bone
On the releases page you can see how many commits there have been since the last release. You can click on it, and it will give you the commit history. We use the normal Fixed #000
I won't update releases until most bug fixes are out anyway
woeful sphinx
Also, there is always a list of fixes since the last release:
https://github.com/EmmittJ/PoESkillTree/wiki
Easier than searching through commits or closed issues.
mortal bone
That too
desert needle
hrm, hey Emmitt, looks like the new version of POESkillTree saves a fully qualified path with drive location for the builds folder, instead of using a relative path. This means it's broken if you use a shared drive with different letters on different computers.
I'll throw up an issue for it.
woeful sphinx
Yep, can't even be changed to relative paths in the settings. I probably had a reason for that ...
desert needle
oh, I just changed it to relative and it appears to work
<BuildsSavePath>Builds</BuildsSavePath> doesn't get overwritten saving new builds either
though I guess the real test is what happens when I go home and try to load it on the other computer
(ah, I had to edit the xml file directly)
woeful sphinx
That one shouldn't ever be changed by the program except through settings. But since I even implemented a relative path check there, it probably has a reason I can't think of right now.
desert needle
</Options>
<CurrentBuildPath>test</CurrentBuildPath>
<SelectedBuildPath>Essence+Builds</SelectedBuildPath>``` this seems to be working atmIt works, but if the relative folder isn't there (standard install) it will crash because it doesn't have permissions to install
desert needle
makes sense
woeful sphinx
We'll probably change the path to be relative on portable installations and absolute on normal installtions
wind garden
@desert needle what are you up to now that you're not busy running exiletools? Playing PoE?
desert needle
I've been playing a lot less than usual, mostly just other exciting things away from the computer. At work I'm generally pretty busy now, which is part of the reason I stopped.
I got like 5 characters to the low 80's in essence but really just couldn't push through to 90 this time on any of them
did get lucky on a pretty badass 6l astral plate from celestial justiciar though \o/ my first 6l in literally 40+ 80+ chars
I'm generally pretty glad I stopped doing the exiletools stuff though, it's really disheartening to continue to see no/minimal changes on GGG's side, I thought initially the stash tab api would herald something new but instead it was like "here" and then they stopped, qq
wind garden
i think they've been working on something large scale and it's not quite panning out how they had hoped so they've pushed out schedule
Chris mentioned having worked on a demo that he was hoping to show off but didn't work out
wind garden
Ah you're right, 'experiment' was the word I was looking for.
compact isle
Added support for the slash symbol in Premium Stash Tab price fields. @chrome topaz ๐
near gate
Has the 2.5 skill tree data been released?
desert roost
If I remember correctly, the tree for 2.5 should stay the same as before.
twilit ibex
The raider changes are in the patch notes, and the totem changes aren't terribly huge.
pseudo ocean
could have sworn there was something about "minor but nothing major"
changes to tree, that is
probs tomorrow
twilit ibex
Well, there are small buffs to a bunch of totem nodes, so that could be what you saw referenced.
hoary tulip
compact isle
there have been changes, I exported them today for Bex
so they'll probably be up tomorrow
waxen ridge
โค
chrome topaz
cool
quick lava
Hi guys, is there anyone here that speaks russian and knows a bit about the russian community?
I have a tool to translate itens from portuguese<->english that helps some brazilian players that don't speak english very well and use the client in the portuguese language.
I'd like to know if I made the same for russian<->english it would be usefull for the russian community or not really.
mortal bone
It would be pretty useful in general
there are a lot of people who play that would prefer to read russian
quick lava
I'll try adapting the code already and maybe release it on 2.5
velvet pasture
Emmitt take my energy!!!
wind garden
were there any changes to the tree besides those mentioned in the patch notes?
mortal bone
idk
near gate
Got a link to the 2.5 skill tree JSON?
near gate
Thanks
mortal bone
yep
timid fable
Fontin (font used for wiki's items) is missing "ffi" ligature. E.g "Insufficient mana" on http://pathofexile.gamepedia.com/Soul_Taker https://i.imgur.com/uk4O2iD.png
also pretty sure we're breaking the font's license which requires acknowledgement for web use http://www.exljbris.com/eula.html
timid fable
yes that's what I mean, the text is there, but the font lacks the 'ffi' ligature or something and the browser is still trying to draw it instead of individual 'f' and 'i' characters
livid dirge
I cant search poe.trade for the malicious mod type, explcit local chaos damage to attacks
@chrome topaz I cant search poe.trade for the malicious mod type, explcit local chaos damage to attacks
cosmic saffron
livid dirge
hmm ok weird, ty
timid fable
there is one explicit I've found missing, #% increased Damage with Movement Skills from Bronn's Lithe
edgy perch
there's a lot of unique explicits annoyingly missing on poe.trade
the most egregious is the lack of the chaos warband weapon mods
timid fable
you can still search the unique, then sort by the explicit by clicking on it
runic drum
does anyone else have trouble importing pre 2.5 builds into the new poeskilltree
waxen ridge
no i did some an hour ago and it seems to work ok
runic drum
it's throwing a keynotfoundexception
i don't mean copying the build url or w/e, i mean like actually copy pasting the .pbuild files into the new build folder
waxen ridge
oh i just pointed it at the old folder and it worked hmm
runic drum
good idea thanks
runic drum
no i made sure to close all instances of poeskilltree
wind garden
you check in task manager to be sure?
mortal bone
someone had this problem easlier with an anti virus not allowing the program to update
wind garden
hmm i do get similar behavior on a project of my own. Have a post-build script that updates some files. But sometimes they're in use by the anti-virus and can't be written to.
wind garden
excellent....just what he wants you to do ๐
mortal bone
...
wind garden
of course I'm kidding, but turning off AV doesn't seem like a good solution
you can add exceptions to the rule list if you suspect it's a problem
wind garden
I thought that was fixed
mortal bone
It was
wind garden
are you sure you're using 2.5? @runic drum
runic drum
yeah
mortal bone
but there are some builds that still trigger it
runic drum
fresh download
wind garden
hmm
mortal bone
It is because they aren't encoded right
and the decoder throws an exception
there is a build in your list that isn't working right
exceptions are based on where it is compiled (I have a folder c:\Github)
wind garden
backup your builds
runic drum
:fuckingsweatemoji:
wind garden
then clear the builds dir
make sure it works
then move them back in 1 by 1
until it breaks again
runic drum
that's the plan i guess.
waxen ridge
at least he could send you the broken file so you might be able to look at it and see a bug
the old replicate process
runic drum
yeah i could
mortal bone
yeah
timid fable
if you remove the fullscreen- from the url in the file does it work? @runic drum
waxen ridge
if you put the url into the browser, both with and without the fullscreen- it still renders a tree
timid fable
yeah, but one of the errors is with the string length which was a problem with prev version, i haven't used 2.5 yet
prev version crashed on fullscreen links
anyway nice RF ele tree 
waxen ridge
Ah that could be mitigated by moving the base of the URL, out into another property.. Then doing string concat when you need to
timid fable
i saw it was supposed to be fixed, but maybe only on new imports -- this file has it saved as fullscreen url which shouldn't happen
waxen ridge
I'm also assuming it's a windows character limit thing URLs can have upto 2048 characters based on browser implementations
timid fable
nah it's just that later parts of the program expect the regular formatted url, and the input is only checked once at loading
to resolve url shorteners and such
waxen ridge
they're just xml / text files
timid fable
open it in a text editor, remove the string fullscreen- exactly
waxen ridge
open with notepad
mortal bone
they are xml
runic drum
i just know that whenever i had that shit in my build folder it crashes the program
oh r they
mortal bone
yeah
timid fable
I think it'll work for you. that file I'm guessing was saved before the previous version
mortal bone
fullscreen- shouldn't have been able to save
timid fable
yep
runic drum
could be, i stopped updating poeskilltree before the last version
so i just remove fullscreen- from it?
timid fable
yes
timid fable
yes, it's just the app isn't supposed to save, and thus can't load, fullscreen url's
timid fable
it only accepts fullscreen url's when importing, where it will convert it to the regular url
timid fable
๐
waxen ridge
So got it working then?
runic drum
wasn't worth the effort but yeah
chrome topaz
@timid fable @livid dirge @edgy perch if you find a mod missing that you believe should be present, write a reply to this thread https://www.pathofexile.com/forum/view-thread/109153/page/1
coral fjord
does the guy for poe.affix talk here?
wind garden
idk, that just made me wonder, is there a list of all the possible affixes as they come over the public API stream?
@chrome topaz has to have one somewhere
mortal bone
Anyone know if there is an api for the Atlas?
mortal bone
Yeah, it should be the same as a skill tree really
Behind the scenes it is probably a lot of reuse
torpid mesa
would be nice
obtuse citrus
@mortal bone: You can pull the atlas stuff from the gamedata (AtlasNode.dat) I believe it has most of what you would need to make your own kind of atlas
mortal bone
we found a significant problem where item filters were being checked every single frame for every item rather than just when the items initially dropped.
holy shit
jovial bear
yep it's big
mortal bone
that is nuts
bitter wave
So are item filters supposed to be a 1-time thing (ideally?) or was it maybe because they have to check every time they come on screen
mortal bone
Ideally the item filter would be applied to how the item is displayed on the initial drop
it gains the properties of the matching filter
coral fjord
well, if anyone knows the poeaffix.net guy, tell him that the name for the t2 (ilvl 72) percent ES mod is wrong. On his site is is "unconquerable" but in game is is "indomitable"
vapid flame
hey guys, anybody familiar with the Poe Trade Macro (with item info incorporated into it)?
I'm trying to get rid of the update functionaly of it (I have it in my start up folder). Even if I take out the chunk of code from main.ahk file and save it, it comes back .. I'm trying to get rid of it so it doesn't try to update every time I boot
timid fable
@vapid flame I'll take a look later (not on Windows) but you can also open an issue on github to ask for an option to disable updates
btw you want to remove the functionality from one of the other ahk files. main.ahk is generated from the others (Iteminfo, trademacro etc) every time you run the starter script (run_thisโฆ or run_without_adminโฆ)
vapid flame
@timid fable whoa I think I found it in TradeMacroInit.ahk under the trade_data folder .. that's where the function is actually called
@timid fable did a restart and that worked! thanks for the help. I just gave it a ; to edit out the line where the function is called
timid fable
cool np
uneven wyvern
Anybody here use the Lutbot macro?
dark heron
i do
uneven wyvern
An update today says it removes the /remaining command
Why would that get removed?
dark heron
oh my god did i say that
uneven wyvern
o ok
dark heron
brb updating changelog >_>
uneven wyvern
also, for the past 2 updates, i click update and it doesnt update. i have to go to the site and download again. not sure if im the only one
dark heron
hmm. its worked for myself and other people i had test it... what os/is uac disabled?
uneven wyvern
win10
maybe uac is disabled
i did run as admin, clicked update but its still version 137
dark heron
is it read only for some reason?
uneven wyvern
no
dark heron
wait has your ladder been working
frozen shoal
@dark heron I just downloaded your lutbot, and I noticed that there is no option for Breach leagues in the Chars League option in setting, is this an issue?
frozen shoal
Cool, thanks!
dark heron
ggg hasnt updated their api to include them as active leagues yet
frozen shoal
Gotcha, that makes sense!
dark heron
oh wait yes that have brb restarting my api ๐
frozen shoal
lol
dark heron
i checked like 20 minutes ago, dont blame me ๐
frozen shoal
I just discovered your bot 5 minutes ago and have decided to heckle you for petty things!
dark heron
k restart the script itll be there
uneven wyvern
haha
thanks for the macro, its awesome
oh shit queue is upo
@dark heron i downloaded version 138 and it says that my current logout settings are invalid. is this normal?
since i havent logged in or anything since i downloaded it
wait wtf
dark heron
So if you check the settings (f10), youll see in red a steam and 64bit checkboxes.
uneven wyvern
how do you run 64-bit now for poe?
there used to be a checkbox
is 64 default now?
dark heron
in the options
it might be? not sure
but just open the menu, fix that, and then close the menu and it should disappear if you've done it correctly
its just a warning so that you setup the macro correctly for the fastest logout
uneven wyvern
i unchecked 64 bit in the macro and the logout error message disappeared
but i want to run the 64 bit poe. what did they do? lmao
dark heron
so you're running dx9 then ๐
change it under options ingame, then adjust the macro accordingly
uneven wyvern
yeah, they removed the option to choose when opening poe through steam. not sure how to run dx11 now...
ok i found it
remote gull
hello guys, could i have the link to the trade macro
desert roost
The price check macro?
remote gull
yes sir
pulsar moat
pseudo ocean
@here loot filter updater updated for the breach league, check it out: https://www.reddit.com/r/pathofexile/comments/5g56ef/ahk_loot_filter_updater_v04/
timid fable
@pseudo ocean looks cool, please consider distributing via Github or another software repository of your choice. Dropbox isn't great on the trust scale
waxen ridge
Or load scale either.
pseudo ocean
well ive initially made is for my guild and didnt planned to release it so thats why it is on the dropbox
but yeah ill move it to github, that is nice idea
bitter wave
If you're putting it on GH please don't just make a new folder per release/version. Can't simply clone/update GIT to update the files, have to point to the right subfolder (which will change each time)
pseudo ocean
oh okay
well i hope i did all correctly: https://github.com/ginto-sakata/PoE-LootFilterUpdater/releases/latest
bitter wave
Yeah, that looks right (at least structure wise). The one that made me make that comment is GreenGroove's. 2 days ago the folder was "/GG 250 Filter/" now it's "/GG 250a Filter/". If he updates it again you'll need to change your script to point to whatever the new foldername is (Instead of just having to point to the appropriate release tag. (github.com/<username>/<repository>/releases/latest would always be the most recently tagged release as far as I know)
pseudo ocean
got it, thanks
neat tundra
@dark heron just installed your lutbot, pretty cool!
vapid flame
Anybody know how to change the price macro to pull Breach prices? It doesn't seem work atm
remote gull
did you change the league in the config file?
that being said i havent tried it on breach cos my internet is down...
tight igloo
Are there any GGG developers in this channel?
pseudo ocean
IK DX11 is in BETA but I'm encountering really big ARTEFACTS in certain zones, I can't see my character. Tested different AMD driver all the same. Is it Game side or Hdw side?
timid fable
@pseudo ocean this isn't relevant to tool dev. I suggest you submit a bug report with screenshots if possible https://www.pathofexile.com/forum/view-forum/bug-reports
pseudo ocean
Ok I don't understand Tool Dev is but np. I'll make my report
timid fable
tool dev is for third party tools like loot filters, poe.trade, macros etc ๐
wind garden
man the delay on poe.trade is so noticeable at league start
mortal bone
He is processing a lot lol
wind garden
its over a minute right now
ya, its beautiful ๐
The very reason I made my indexer
So I can make money exploiting that difference ๐
wind garden
I should publish a chat PM relay client
Does one exist already for push notification?
pulsar moat
^ Confirm, I use that to get pms to my phone
wind garden
cool, won't bother then
I use prowl push notifications for iphone , but at least there's something out there already
chrome topaz
the delay isn't caused by poe.trade
poe.com is just overloaded
spot the difference
mortal bone
So many items ...
outer jay
@chrome topaz how long do you keep your randomized set of items?
chrome topaz
what do you mean?
outer jay
The set of items you display to the user are randomized on the server right?
chrome topaz
still not sure what you are talking about - you get items you search for, what's here to randomize?
outer jay
Isn't the order that you display randomized?
chrome topaz
on currency website, yes
outer jay
Not on the item website?
chrome topaz
I don't think so
outer jay
What is it based of then?
chrome topaz
I'm not doing anything to enforce a specific order (other than sorting by price)
so it's unspecified what order they come in
outer jay
Hmm, kinda appears that there are waves of people whispering but that might just be because it is overloading
coral fjord
maybe you should organize by stock after price for currency
outer jay
Then you're Fucking over poor users
coral fjord
good point, i was just thinking of convience
outer jay
It'll be better for the buyers but not for the sellers
wind garden
@chrome topaz is poe.trade really behind right now? I've posted some currency for trade and I haven't seen it listed for like 10 minutes
i'm using ~price, if that affects it
chrome topaz
see the announcement at http://poe.trade/html/index-delays.html
wind garden
ah
there's too many stash updates for the GGG server to handle
just checked my log
my parser throttles itself when there isn't enough data to pull a normal chunk size
when it's not throttling it logs that it's behind and needs to catch up
it's been behind for days it looks like
has @compact isle looked into it?
compact isle
in progress
wind garden
cool, thanks
wind garden
panic ensues...
compact isle
lol an unrelated problem ๐
compact isle
potientially fixed now
velvet fog
Hi, poedb here ._./
desert roost
Oh hi!
compact isle
hello poedb man
velvet fog
ouch, Essences.ClientStringsID removed ...
wind garden
@compact isle you the man, looks like it's all good now
actually
i take it back :/
it's back up to 17sec delay
it was faster for a bit
you're still the man, but things don't look like they're 100% yet
wind garden
18sec per get
pretty rough
here the tail of my log
can see approx how long each is taking
wind garden
@compact isle is the an api to request the most recent change id?
ebon oasis
@wind garden poe.ninja has public the next change id if that helps
wind garden
i know but what if poe.ninja is behind too :/
wind garden
oh, the timeouts are just because i had a 30sec timeout set and it's now taking longer than 30sec most of the time >.>
wind garden
approaching catastrophic levels
wind garden
The pichforks are already coming out on reddit
pulsar moat
62 items/sec, wow.
desert needle
the feels.
chrome topaz
patent lantern
oh that post
I enjoyed that guy that said GGG should support market manipulation and currency accumulation as a real playstyle
wind garden
currency accumulation isn't a real playstyle?
compact isle
@wind garden it was usually around 10s for you before this madness right?
wind garden
@compact isle if by "usually" you mean start of breach league, yes.
previous leagues it was around 3 seconds
I'm guessing it was marginally keeping up at start of league and as the player base increased it went over a tipping point where it slowly got further and further behind
we actually have a piece of software at work that regularly streams data from many clients to a single server. It was so close to being able to keep up with the data that it could handle 34 clients streaming data at once. but once we hit 35 or 36 it would get behind and back up.
we were using the standard c# data serializer and it was too slow. So we ended up writing our own customer data packer/serializer to improve performance so that it could handle 36
obviously not the same thing here, but similar idea as far as scaling data processing
everything is fine right up until it's not ๐
compact isle
pretty much, and with so many items even changes in the microseconds have an impact ๐ฆ
wind garden
what would be interesting is to know where the bottleneck is
gathering and processing the stash updates before they're sent out, or the actual sending of updates
if it's the processing, then distributing that work across multiple servers could resolve it
but if it's the actual sending the data, maybe there's been an increase of users of the stash API, then that could be more tricky
not sure how the web server is setup, is it a single server that services all the clients of the stash API?
compact isle
we have 4 webservers
it looks like currently 60% of the time is generating the information to display the items, 40% is converting everything to JSON
on our end it takes around 10s for a full change group
wind garden
any idea how long it takes to serve a GET request?
compact isle
to generate or to send?
wind garden
right now under heavy load
compact isle
10s is the total time
wind garden
wait
are you saying that it generates all that info and JSON at the time of request?
compact isle
yes, the items themselves are in a binary format before then
wind garden
am i wrong in assuming that there's a fair bit of duplicated work, assuming many clients are requesting the same or similar data continuously?
bitter wave
So if 5 tools are all scraping the API using the same changeIDs (since they start from the same data), then you're generating 5x the JSON/5 times the server load?
wind garden
@bitter wave sort of, the tricky part is that the changeIDs aren't necessarily the same for everyone. It all depends on when you request it. What you get is dependent on what you have. So if you and I both request the same change ID, and we're not at the tip of the chain, we should get the same next_change_id
however, if we're at different places in the stream, you're up to date and I'm not. we may never get the same next_change_id
wind garden
i think that's a flaw in design that's hurting here
bitter wave
But that still leads to multiplying out the load.
wind garden
??
compact isle
generating display information is slower due to the new reminder text stuff
much slower
cosmic saffron
stuff telling people what mana leech/stun duration are
wind garden
oh my
bitter wave
all those fun things that make sense once you know the game, but don't understand simply by reference
wind garden
well that's good to know