#tooldev-general
1 messages ยท Page 33 of 1
yes
That should be doable
seems like it
You just want to display that on a per-unique basis, correct?
ya
cause my goal is to get acurate prices for the 1,2, and 5%
which means i need to get the price in exalts and chaos for each item in those goups
groups**
How about changing the avgPriceExalt field to
"avgPriceExalt": {
"percentiles":{
"field": "shop.price.Exalted Orb",
"percents": [1.0,2.0,5.0]
}
}
if i do percentiles on shop.price.Chaos Orb, it's going to give me a totally different set of items than if i did it on Exalted Orb
because not every item has a price in chaos or exalt
So you want to represent the cheapest 1, 2, 5 as a single value regardless of which currency it's priced in
?
heh this is confusing
so for all the instances of a single unique
take those items and divide them into buckets of percent, bottom 1% of items, 2% of those items, and 5% of items
so if you have 100 items, the buckets will have 1, 2 and 5 items in them
correct
then within those buckets, calculate the average of shop.price.Chaos Orb and average of shop.price.Exalted Orb
separately
if none of the items in a bucket have a price in chaos or exalt then return NaN
using percentiles acts on only the items that have exalted orb not null
or chaos orb not null
so in general you have few items with a price in chaos
so you're doing percent on a range of 5 items
vs a range of 200 items
Would this replace the existing aggregations for min price and such, or be in addition?
Hmm, need to think on it a bit
The real problem that I keep getting stuck on is how to get the bottom 5% of items, and then after that calculate the 1, 2, and 5 for those
I don't think you can do it without scripting
i think i just need to chose a different metric
the 1,2,5% doesn't make a lot of sense anyways
what would be more useful would be tracking the average price now, 24, 48, and 72 hours ago
so you could see if it's rising or falling
as well i should track the current lowest price and the 24hr low
@wind garden, well first it looks rly great !!
@wind garden, unfortunately the rumi's concoction numbers for HC prophecy dont make sense
I was watching that item closely before buying one
has been consistently above 1ex
didnt see any item for 25c or close to that
which column are you looking at?
all of them are about 24chaos
hmm k
i can take a look at it in a bit
i'm working on changing the 3 percent columns
to something more useful
but in general this looks like a rly awesome tool
I actually work as a professional trader in finance and most of the stuff we have is shit compared to this
new plan is columns for:
current lowest price
lowest price in the last 24h
Sold count last 24h
MarketCap
Avg Price last 24h
Avg Price last 24-48h
Avg Price last 48-72h
well in my opinion the best statistics are the ones about the order book actually -- what is selling where
average price as you already pointed out is not that useful
the goal with avg price was see if price is trending up or down
or flat
i don't want to implement any sort of chart
normally that doesnt work, maybe it does in poe
so this was like a simple indicator
why wouldn't it? get avg price from mon, tues, wed for example
try it, maybe it will work really great ๐
when I say avg I mean bottom 10%, to exclude things priced way to high
so one interesting thing, often when an item is delisted (I assume that it has a UUID???) it means it traded there
or traded maybe a bit less
I would try to use that as an average price if you want one
every item has a date updated
the last point it is updated is when it goes from verified=YES to verified=GONE
but no unique identifier?
so I can't say Call of the Brotherhood UUID 1212347163876213 belonged to ehtom then Retik and now GGG_Neon
well your new columns would be pretty good anyway I think, though I suspect you would find the first 3 most useful
one thing right now is that elasticsearch 2.3 doens't have the ability to limit permissions on scripting
so trackpete has it disabled for security reasons
that kinda limits what i can do on some of the more complicated queries
it's been a learning process though. I'll work on what i have planned and can make improvements in the future
anyway man looks like a rly great tool
thanks
but if you have a sec let me know on the rumi data
come back later and i'll let you know what i found about the weird data
if you're still in discord i'll mention you so you get a notification
@pseudo ocean I believe I've fixied your bug and completed my updates
i think it was pulling data from Prophecy league instead of PHC
try v1.8
are there a bunch of UUIDs (id field) double in the stash api? Have a check running with StashItem::firstOrNew(['uuid' => $data['id']]); which returns a Model of an StashItem if the UUID already exists and at around 5k items it doesn't create new entries because every UUID already exists for the next 10-15k records
i don't know
but i've been getting weird results from exiletools
it shows the min price for carcass jack as 2ex
but there are none listed at 2ex on poe.trade
uuid is a unique identifier for an item and character
if it changes hands to another character, the uuid gets regenerated
the stash api, however, sends an update anytime a players stash is updated
so if i have 10 items in a tab, and i change 1, i get updates for the other 9 again
so i would expect to see the same uuid multiple times from the stash api
that's why exiletools has shop.updated and shop.modified
there are items that get updated because they were included in a stash update for another item even though they themselves weren't modified
ugh, thats so annoying. guess I will calculate my own UUID to make it truly unique
what are you using it for
uuid is unique for item
if i knew what you were wanating it would easier to answer
I just dump the public stash api data into my database for use with my private terminal search tool and I use the UUID to check if an item already exists in my database
Ran my crawler with the UUID check and it stopped for a few minutes at 5217 records. Now I run it without the UUID check and it is already at 120k
that doesn't seem right
you should see updates for uuids that exist in the database already
but there should be a lot more than 5k
a lot more than 5k uuids
yeah, it continues after 2-3 minutes but during that time all UUIDs that are incoming seem to be duplicates
and all the crawler does is to send HTTP requests to the API and attach next_change_id to the request if it is available from the previous request
there were a ton of empty stash updates from standard
from when old leagues got dumped to standard, all the remove only stashes looked weird
at the moment i completly reset the database before every crawler run
so always from 0
so ya
there will probably be an hour to so where you see nearly no items
if you keep going it should eventually get to the good stuff
alright, so it is normal. Thought I failed on something as simple as a data comparsion haha
ya @desert needle and I were noticing it this week when they had to reindex
my service is setup to pull the next_change_id from his indexer so when he started over, so did mine
I guess I will just let it run without the UUID check for now and then later see how many duplicate UUIDs there are
ya, i'd just be patient with it
if you're at tip and still seeing that behavior i'd be worried
i can give you a recent next_change_id if you wanna test it
8560197-9200557-8460851-10078426-9363238
that's the last one i processed
does it make a performance difference if I use pathofexile.com or @desert needle index?
depends how much you care on performance
but exiletools index is pretty fast
especially after @desert needle updated his backend
he has a notifier to that lets you subscribe for updates before they get indexed
so you don't have the overhead of processing time
he said he saw a few market snipers that were using it to look for vagan daggers
quite successfully to ๐
hold on
i don't think that's it
that's dated august
i wish there was an easy way to search discord history
or better yet, bookmark things
Pretty much what I am building for myself as a terminal app
Yeah and you can't even scroll back farther than ~15k messages
Without massive lag
I'd love to export a channel into a text file or set of them
found it
scrolled up far enough heh
i've used socketio before
i should write a client in c#
Rhino bot, it's for moderating stuff, bans, kicks, word filters, rate limiting
can't find it hmm
!!help
What're you looking for?
Ah
lol
i tried out @desert needle's socketio filter
i get the message "You are limited to 20 filters at a time! 47 is too many!"
oo but i am getting heartbeats
not sure what that means
are there any more undocumented api endpoints like the public stash one?
publish stash?
woops, public stash i mean ๐
not that i know of
not sure if there's stuff for league or character profiles
but i haven't used them
ya something is whack
shows 2ex verified now
but poe.trade sees cheapest price is 2.5ex
and poe.trade is looking at forums and stash api
so i think that 2ex in exiletools is stale
The api says that lifesprig is the 2nd most common unique
Must be tired because I can't figure out what most common is.
got this email today
Sounds like a charmer.
Now if only you could figure out the IP of the person who sent it and block them from using the site.
yes
nope
complain to GGG and maybe they will add something
(it's not even long polling...)
Lol
Your site is fine, don't take let him/her get to you :P
Wonder why that dude's so mad.
He prob messaged like 20+ afk players for trade
Probably. Or he was majorly low-balling and was just ignored. :P
at least it's not death threats like that another guy got sent to him
Which guy?
Oh how about is it possible to change the color of that trade you have already copy so when u refresh the page you won't had to message the same guy again
Similar to when your googling
don't remember his name
sounds like a good idea, @solid whale
but it already says "copied to clipboard"
Yeah I browse through trade a lot so those are just slproblrms I face
But when you refresh that page it will reset
And those that had copied to clipboard would change back to copy instead
it was the currency exchange guy
he had a dude show up as his house and threaten him
or something along those lines
It may have been threatening with an address
The guy threatened to show up at his door
He just took the site down
I think @desert needle hosted the service actually
Yeah I remember that happening. But I didn't realize there was a threat to show up at the guy's house.
Yep
that's terrible
Yeah, some people are awful
Yesterday it said Lifesprig was #2, but thanks for the link
I was using http://api.exiletools.com/uniques/
@analog orbit
Did not realize Roth's was so common.
The chain is really good for EK
the new ancestor totem is OP, 3L and it's killing rares and uniques in a few sec
Is there a price checking script?
that is pretty interesting data
Retik: i tried out @trackpete's socketio filter <-- you could, technically, just create more connections. 20 is an arbitrary limit I set to prevent people from creating hundreds of filters
the hate for klayver was crazy - specifically it was a subset of people who believed that poexchange then exilebro specifically was designed to support flippers
it was a weird cycle, mostly flippers used it so normal people refused to, which meant everything stayed at flipper rates
wasn't until xyz implemented currency trading that we finally got some semblance of "normal" users doing currency trading
but there's still very weird hate
@desert needle i'm not sure it's working like you intended. It's behaving as though the "filter limit" is actually a character limit ona new filter
ie. i use the simple generic filter, it's 28 characters long
i get an error saying filter limit 20 and 28 is too long
if i use a more advanced filter with 300 characters. it says filter limit 20, 300 too long
you must not be submitting the object correctly
maybe
?
nope whew I'm ok
it's an array, not an object
console.log('--> FILTER FAIL: ' + socket.id + ' (' + socket.handshake.query.pwxid + ') ');
io.to(socket.id).emit('error', { error : "You are limited to 20 filters at a time! " + filter.length + " is too many!" });
return;
}```
ah ok
maybe you are submitting it as an object instead of an array?
so the [] is needed
yep
--> FILTER FAIL: /#RSlFlpNPMq4x9giVAAAC (c22e3329-4b7a-40ec-80b3-d26fbc965ab2)```
maybe you're sending it as text instead of JSON?
lol, well
i am
but what does that mean to send it as json?
i thought json was just a format
depending on how you send it, it might get url encoded
oo maybe i need ot add an encoding header
there's a client.js that I know works, and you can peek at exiletra.de/auto for a javascript in-line version
yaaaaa. trying to do it in c# though ๐
all I know is that my server shouldn't see escaped formatted, this is what it normally looks like: --> RECVD FILTER: /#WHsJjzbNEHVWxkIQAAAF (0b1a6ac0-0a3b-4619-b2b0-cdcba58aa774) [{"eq":{"attributes.league":"Standard"}}]
i also frequently get an error saying "server committed a protocol violation
oh, also you're not setting the format right
howso?
the eq gt and lt should be top level objects inside each element of the array
you're thinking elasticsearch format ๐
i copied this from your example though O.o
this is different
wat
nope
unless your stuff is encoding off order
"[{\"league\":{eq:\"Standard\"}}]" vs [{"eq":{"attributes.league":"Standard"}}]
1s try again now?
I was bouncing services to up the limit to 50, maybe it got caught
--> FILTER FAIL: /#EX2-jbKzCL43qmjyAAAC (b5c9216d-1a3a-413f-a683-3745a20350d6) ```
yeah maybe the escaping is preventing the json from being parsed properly
that's the only thing I can think of
that's weird, why is it including the escaping?
fwiw there are a few clients connected and no other problems and I still can't replicate that ;x
I think your c# client is "safe" encoding it, that's all I can think of
@desert needle it's getting the text but it doesn't see it correctly
i shortened it to < 50 characters and now it's failing a foreach
"filter.forEach is not a function"
ya i just don't think the support for socket io in c# is good enough
there's only 2 libraries and they don't have any documentation
if i had to guess, i don't think the [] array around the jSON is valid
Sent Filter: [{"eq":{"attributes.league":"Standard"}}]
looks correct
yeah, not sure what's going on with it
worst case you can mess with node.js, it's pretty easy ๐
client is already written!
ya
but i was wanting to see if i could integrate it with my existing app :/
which is in c#
it's really weird that it's tripping, I mean, theoretically it should be quite simple
are you using this? https://socketio4net.codeplex.com/documentation
socket.Emit("partInfo", newPart);``` that style should work
what does your emit line for the filter look like?
socket.Emit("filter", filterText );
and something like var filterText = ' [ { "eq" : { "attributes.league" : "Standard" } } ]' to set it?
and filterText is [{"eq":{"attributes.league":"Standard"}}]
are you using single quotes around it?
i send it as plain text
ah, that explains it
the server is expecting it to be sent as a javascript object
i.e. var filter = JSON.parse(filterText); before sending filter
but what is a javascript object?
how to do that in c# I have no idea heh
ya
let me see if I can do some manipulation to check
idk i think the library could be broken
gimme 5min I think I can do a workaround
It's been a bit since I did JSON parsing in .NET, but I know there's tools in the framework for it.
oh there is
and it works great
but it converts between c# objects and strings
and right now, i can't send either of those it seems
okay try again sending it as a string
--> RECVD FILTER: /#n8UnupHnDGu0dY10AAAA (459a1da3-a005-4f25-a27c-2aaebfdea4e9) " [ { \"eq\" : { \"attributes.league\" : \"Standard\" } } ]"
--> FILTER is a STRING, converting to Object...
--> FILTER PASS: /#n8UnupHnDGu0dY10AAAA (459a1da3-a005-4f25-a27c-2aaebfdea4e9) ```
you should get a heartbeat response like Connected with session id n8UnupHnDGu0dY10AAAA and pwxid 459a1da3-a005-4f25-a27c-2aaebfdea4e9 Received a heartbeat: You passed a string instead of an object. Attempting to parse this as an object anyway... Received a heartbeat: 1 Valid Filter(s) Accepted! Adding to monitoring queue.
From what I can see, it looks like @desert needle is expecting an object (not an array) or a string that can then be interpreted as JSON
But the .NET library for socketIO seems to always send an array by design
@desert needle works now
what'd you change?
you just convert on the other side eh
guess that works
thanks for the workaround ๐
yep
just added a typeof detection to see if it was a string and convert it to an object
probably should've done that from day 1 but this is my first real project in node.js so didn't occur to me
@desert needle do you know anything about the stale items in your index?
there've been multiple times where the cheapest item that's validated=YES is not even listed on poe.trade
there was a 2ex carcass jack for over a day while the cheapest on poe.trade was 2.2ex
there shouldn't be any stales unless there's a bug of some sort
well that's what i'm suspicious of
I'd need some specific items to look at.
could be poe.trade doesn't have it, could be a bug on my side, could be something else
well the reason i think it's on your side is because the price was outrageous
there would have to be some new thing the stash tab api is doing that I'm not aware of
that doesn't necessarily mean anything except that the guy logged off or ignored tells
assuming you were doing on-line searches on poe.trade
ya i do
is looking at verified=GONE the best way to tell if an item was sold?
i know that also includes de-listed items, but is it the best we have?
there's no way to know if an item was sold, but yeah
it means it was there and now isn't
alright, well i'll keep an eye open for oddly priced items and check offline items on poe.trade next time
man price of shavs has crashed ๐ฆ
also if you were looking at this: http://exiletools.com/uniques/#/Prophecy/Reach of the Council Spine Bow/Past3Days
there is either a bug in those queries or I made the decision to do something weird
because the verified now price is appearing to be some sort of average over that time period
or something else is wonky, 'cuz the cheapest I see right now is 200 chaos and 2.7ex
might have to do some looking into that
what do you mean?
it looks alright to me
current low is 165c
10% avg 1 day ago is 200c
mm i forgot that's 80:1
so 200c a day ago is 2.5ex
current is 165c
which is 2.48ex
pretty darn close
oh, I just saw that if I did modified in the past week it said verified now: 2.0 exalt but I couldn't find anything listed at 2 exalts in the index
that is currently available at least
fyi thanks to @heavy ether I tracked down a bug in the load balancer configuration that was making ~25% of new connections to the rtstashapi fail, woops.
wonder if that explains the "protocol violation" errors i was getting %25 of the time
yeah I had some noob level shit going on
I changed the ports from 6001-6004 to 6000-6003 to match processes 0-3 but only updated the health check targets
so any time a connection got routed to the server at 6003, which was up because it passed the health check, it was actually going to 6004, on which nothing was listening
lol wow it really was 25%
yeah should've balanced out to about 1/4 requests
but only new connections, wouldn't have affected on-going connections
Whoops
thanks to pete for fixing it and providing the service though, ultimately
play....path of exile?
we dont' actually play the game, we just write tools for other people who play the game
:p
but actually, I'm at work and I think @desert needle is away or the rest of the day
he usually disappears around this time
probably in a different part of the world than me
I'm EST, generally work 10-5 and don't tend to be on discord at home ;x
east coast #1
You're in #tooldev-general atm, and saying hi is perfectly okay.
In case anyone's interested in wiki related news/drama https://www.reddit.com/r/pathofexile/comments/4o9k3a/so_long_and_thanks_for_all_the_fish/
the feels
Yeah, sigh
rip
Yeah, that sucks. It is kind of disappointing that a contract like that would be broken
makes you really not want to sell out if they will just replace you with free work in the future
Yeah definitely, and the fact that they're going even more aggressive with ads bringing it down to Wikia's level
Yeah, I had to block their ads because they would made my firefox crash
That's shitty
Yeah, it happened in a computer in which I am forced to run an old version of firefox, but I don't think the scripts embedded in an advertisement should be so intrusive and resource intensive to make your browser crash in any case
it's like the NYT!
Lol
I just don't load the wiki since it started crashing my browser a couple weeks ago
I think ublock origin must do a good job with it, I haven't had any problems
same @desert needle
I'm using ublock and getting issues :<
A wiki should be simple with simple ads to support their cause. They shouldn't even be able to make money off of a open source type web site
uBlock with the default script blockers works for me too
I get that sidebar thing but it doesn't hurt the formatting and could probably remove it
i manually blocked that sidebar
Same
Yeah, you may have blocked an important script
I did that at some point and it would crash
Likely
oh yeah that #siderail is easy to block
But it's not like anyone of us can make a better wiki
the content and overall stuff going on in that wiki is really really good, especially recently
can someone help me with some elasticsearch stuff? been wondering if i can make two queries i have here a single one
but it does suck that a random company is making money off volunteer stuff like that :/
Yes, the PyPoe guy does a wonderful job with the data mining
@crystal hamlet I can try
aight i'll explain and put the queries in a pastebin
That would be like me accepting money for the PoESkillTree.
It isn't all my work, so I shouldn't be making money off of it
Imagine if you un-public'd it and started selling it for $10/pop! :x
The numbers are nice haha
okay so i've got one query that find the current sell offers for a specific currency pair in the exiletools index, and one that uses the data from that to get the total stock people have in their tabs at the time
Peek times we get 50-80K unique views
thought it's a bit awkward to send a long list of account names to the second query
Over the course of the normal couple weeks it is 20K
is uBlock better than adblock plus?
I like it better
Don't use plus. They sold out
Plus allows certain ads
You can pay them to not have your ads blocked.
cere - um, whoah, it sounds like you might be way better off doing that with aggregations. Clarify the goal for me: You want to get a total amount of each currency item availalble for each seller?
i'm already using lots of aggregations
i want to get the total amount of a currency that each seller has in their stash tab
@mortal bone unique views where?
regardless of whether they're listed for sale for the other currency
hrm
Have you guys used POEMate? His iOS/Android tool is pretty top notch, and people have no problem upgrading for the perks. Maybe having something similar for POESkillTree? Not ad-block funded, but so that added functionality (weapon imports? poe.trade imports?) pay back the dev.
and i can do that with those two queries, but it's a bit awkward
@chrome topaz github traffic
sorry, 40k of those are mine. you make good software
who writes POEMate?
@summer shuttle that would be hard to keep track of
@pseudo ocean unique :p only tracks users once with a couple caveats
Evgheni Obrucicov (per Apple Store). Not sure where he's based out of.
@chrome topaz do you have stats that you are willing to share haha
not really
@desert needle - i guess i could do the first query without filtering for the asked currency, and then boil it down in aggregations. would that be a bad idea performance wise though?
@summer shuttle I usually use his since I'm generally planning a tree while outside. Absolutely love it and think it's fair to charge a small amount for extra features you don't really need for building out a skill tree.
funnily enough, the poemate app has smoother scrolling through the tree than any other tree planner i've used
@chrome topaz ah, damn. I figured acquisition would be close to something I see
@crystal hamlet - http://pastebin.com/HamgBire this is an example with aggregations. You may have to increase the size. It will show you the total stack size and total number of slots of each currency type for each person with currency in their inventory
example output { "key": "scorch428", "doc_count": 35, "currency": { "doc_count_error_upper_bound": 0, "sum_other_doc_count": 0, "buckets": [ { "key": "Jeweller's Orb", "doc_count": 7, "sumstack": { "value": 63 } }, { "key": "Cartographer's Chisel", "doc_count": 5, "sumstack": { "value": 15 } }, ....
thanks, let me try that
just to clarify further - what i want at the end, is for each person "selling currency x for currency y and has z amount of x currency in stock in total"
you can get there with more filters at the beginning or go crazier with more nested aggregation buckets probably
I mean, you can literally say show me totals of each currency for each seller at every value any seller is selling them for / etc.
generally anything other than specific information about documents can almost always be done with aggregations
ask Retik, he spent a few hours last week nailing up some insane shit ๐
i'll probably end up spending a few more hours finalizing this stuff. at the end i want to have the same kind of data that you get on the poe.trade currency section, except from your index so i can do more stuff based on that
nod, a fair bit should be possible
I think poe.trade does have a lot more currency data though, I'm not sure how much of it comes just from stash tabs
seems like generally stash tab usage for selling currency is pretty low
you can see on currency.poe.trade which ones are stash api
yup
and it's not many
can't figure out why tbh
it's so much better if you use the api, and i actually never buy from the ones who aren't from the api
and if i list stuff through the API i notice people buy from me even though i'm mostly not the best offer available
figured that's because they see how much currency i have in stock
It's also probably much easier to set up fake listings not through the api
I don't do enough (any really) currency trading to see the behavior there. I imagine there's some level of worry that people might be flippers with fake rates up if they can't "see" the truth.
You can just have a tab solely for setting prices in that case. It's what I did in Perandus: 4 tabs for setting prices, one for normal currency holding, three for coins.
So you could still hide the amounts if you want to.
quite often i will just put some chaos and alch in my sell tab and do stuff like list the alchs at 2.7:1c and the chaos at 1:3.2alch
and just let my currency make me money on the side
I really wish they'd just get rid of having to scrape the forum also. It defeats the point of having an api.
if they do that they're gonna have to provide an alternative for people without premium tabs
No problems with that here. Or at least having forum prices in an api.
I'm hoping that at some point they'll make some premium tab features available to all players.
me too
but then, there are still people who have (legitimate, I guess) reasons for preferring using inventory management tools
they could still use those though, right?
but either way there are a TON of premium tabs, so they're obviously working and making money
inventory management tools do give you a lot more power over pricing
but that is all stuff that could potentially be built into the stash tabs
The problem is as long as you can't get all priced items via an api, you still need to scrape the forum like before in addition to a new system. Which feels extremely backwards to me.
The forum doesn't exist as far as I'm concerned.
GGG doesn't seem to care about it.
They just can't seem to find a way to make it usable by any developer.
for normal trades we're at like 80-90% stash tabs anyways, so i'm actually fine discarding the rest. just not for currency for some reason
I just pretend and hope that they won't fix that problem because they haven't decided when to kill it yet.
everything about the forum is terrible
I think the only person that really still parses forums is @chrome topaz, but I am not sure how much info is actually gained from that
Really the forums are just an easy way to update via acquisition since the updates are sent to the back end
I find people using the forum for currency especially confusing because you can't update your rates as quickly when people log on and off.
There's still some fair amount coming through the forums and acquisition, so poe.trade absolutely needs to index it.
It's just not available to anyone else unfortunately.
i think most of the people listed on poe.trade who are not using the api are manually entering their stuff on poe.trade
in the currency section
you can manually enter offers directly on the page
Ahhh.
@desert needle @mortal bone it'd be supppppeeeer easy to copy the wiki
Mediawiki comes with built in functionality for that sort of stuff
the tricky part would be to get a critical mass of users to switch to the new one i'd imagine
so the new one actually stays more relevant than the old one then
I still own pathofexilewiki.net and org
Yeah, but the curse wiki is now the official wiki
There is no switching at this point
I'm sure that's a conversation Chris might be open to having tbh
Particularly if the community talks openly and rationally abouy it
one "good" thing about Curse hosting it is that they aren't going to up and leave at any point
Whether it's official or not doesn't really matter. If people who update it often go somewhere else, then people who want to use it will follow. So the question is just if you can keep a different one more updated or not.
Best case scenario is a wiki hosted by GGG and edited by community
^^ yes
I would offer to host a free player wiki, for example, but I can't be sure that I won't get bored with poe and stop hosting free poe stuff in a year or something
Wouldn't want the data to be given tk the community by GGG to be honest
How much are your hosting costs anyway
But stuff like the guild war wikis, tf2, etc work really well
I am assuming they would be between $10-50 a month depending on your load
It would be cool of we could get a wiki that was hosted by GGG, but they may have some deal with curse for promotions or something
I was expecting a couple hundred per month. And yeah they likely do given the curse bundle and Prophecy preview.
There's no deal AFAIK
Previews are same they do with any press site
I wrote a couple of them pre-prophecy
Ah, ok. It would be nice if there wasn't an individual actually profiting from community work
That seems really shady to me
To be fair that was me for a long time
But you also contributed your time and effort
This is a third party company that is gaining profit from a community trying to help each other
Yeah, true
Hundreds of communities
reminds me of huffingtonpost
@iamacyborg#5413 I wouldn't expect them to create bad relations with curse by switching what they deem the official wiki, though. At the same time not like official means anything.
At least Huffington pays their writers...sometimes haha
I do know most Curse contractors get paid an insanely low amount
to be fair, it's not really official
as official as a link named "community wiki" on the page is
its not horrible curse hosts it and makes money the problem is Cuse Sucks
I don't really like the idea of a company making money of a community they're not engaged with and that they don't care about
Anyway yeah, transferring the wiki would be fairly simple
Mediawiki comes with import/export functionality
Has anyone here approached Chris on hosting a Wiki? Ideally, they'd just fund it and make sure it doesn't fall apart. The same community would maintain it (as iama said, Mediawiki is pretty easy to set up).
I've got him on Skype so could try
It'd be the same, just no ads
Other games have taken control of unofficial wikis by turning them into officially sponsored ones, yep, something like that would be great
@mortal bone https://api.github.com/repos/xyzz/acquisition/releases ctrl+f download_count
The numbers are a bit different because of how you release I think. You do some little patches here and there when you release
using forums for currency?
I must be missing something, but at least currency.poe.trade doesn't use forums for currency
yeah
most people just log into currency.poe.trade ("manage you shop") and list rates there, without using the stash tabs
seems like pathofexile.wiki domain is available ๐
i haven't really been following the conversation. Does the PoE wiki really need replacing?
you can see even on poe.com there's now a link to curse wiki
so you gonna have a hard time competing with it i think
game>community wiki
Yep, that is what I was saying earlier
and on the page it even says "official poe wiki" now
so i suppose they have some sort of a deal with ggg
Oops! We don't currently offer .skilltree domains. ๐ฆ
no .tree tld either
What framework is the Official PoE wiki using?
@mortal bone could do .build?
@minor charm gamepedia
whatever they happen to run on
@thin ingot .build not a tld either
Thought it was? my bad.
mediawiki of course
why .moe?
sounds nice like poe.xyz
+1
my ES query from earlier does what it should now ๐
it's actually pretty neat now, i get results like this:
there's a .rip tld by the way lmao
@mortal bone it looks nice and easy to remember
It was interesting during that name shift to see how people reacted, how many people insisted on continuing to use poe.xyz like it gave them more street cred or something.
I think poe.trade was a really smart choice though.
man I really wish GGG gave us an easy way to authenticate accounts with third party sites
Maybe we can get @compact isle to bring this up? Some sort of third party authentication.
It doesn't matter about who 'need' this feature. It brings peace of mind the user because they don't need to login with username/password.
It would also make all the workarounds (using the session cookie, using the official pm system, opening a browser page and copying the contents, ...) unnecessary.
yeah, the way that authenticating "set online" links for poe.trade currently works could be made much simpler with this
you could say that 10 people need it (the ~10 tool devs) but loads of people would use it and benefit from it
yeah. that's never happening
it took them over a year I think to fix the official documented leagues API
it's clear they don't care that much
it would also make setting up poe.trade accounts easier, and allow third party systems like seller reviews/etc. I realize it's very unlikely, but that doesn't mean we shouldn't dream IMO ๐
I was thinking of it again specifically in regards to some posts about master crafting scamming, and how a third party site that allowed real reviews of services like that (or lab running/etc.) would be helpful
but making everyone send a message to someone to get an account id on the forums is clumsy for such things
I think the message I sent to xyz for poe.trade years ago is the only pm I've sent on the forums heh
How would you prevent fake reviews, however. Or people using extortion tactics.
by tying it to an actual pathofexile account with associated reputation you can certainly reduce the fake content
I mean you can make as many accounts as you want. I guess you can adjust the value of someone's ratings based on account age, highest level, et cetera though.
yep
bad idea imo
not a fan of reputation systems that aren't based on verified purchases
but the authentication thing would still be great
that feels when someone starts DDOS'ing your free tool ๐ฆ
then you block the 10 IP's doing it and it goes like
guess I need to actually get off my ass and configure some front end rate limiting
People are shit.
it might even have just been a few complete idiots rather than someone doing it on purpose, but the logs show they were basically making 10-20 of the same request at a time over and over again
the fact that it was around 10 IP's making the exact same "useless" requests repeatedly and those requests were getting blocked by the API Gateway makes it extra suspicious though, basically used up all the connections on the API Gateway web server
got rate limiting in place now though, so there's that
somebody forgot a sleep call
haha
it's possible someone accidentally multi-threaded the same calls without a sleep and gave it to their friends as a cool tool but were not noticing they kept getting api errors ๐
I had to block amazon aws and a few /24 networks
the first time I made the index available publicly I had a few people trying to literally download the entire index every few minutes, was bonkers
oof, yeah, not much reason for AWS to be looking at your stuff
when I hosted exilebro people tried to DOS that shit all the time, I was kinda glad when he turned it off
dos how?
there was a poorly coded search that you could run to list all of the available currency trades just by submitting a form, and I'd see a bunch of IP's re-submitting that form 20-30x a second every couple of weeks
I'd get an alert that the CPU usage on the box was maxed out and log on and see the database going crazy, then see logs full of that. Ban those IP's, then a few days later it'd come from somewhere else, like someone had a script.
rate limiting is an obvious no-brainer, dunno why I never bother with it
eh, oauth would be pretty cool
I don't think we have enough publically supported api's at the moment (proper ones) to make it worth it though
is the main reason to do it actually just APIs though? I see the benefit more in authenticating players on third party sites like poe.trade etc
that's true
is @desert needle around?
yay, so i've got a small library now that can generate data for market depth charts based on any currency pair
auto-detecting suitable ranges is proving a bit tricky though
Usually fewer people on on Saturdays from what I've seen
So that might impact things.
During Perandus I'd get very few sales on Saturdays. Most of my sales were around midnight EDT weekdays or all day Sunday.
Though are you looking at specific things?
who
i'm guessing he Emmitt
bad phrasing sorry... more of a general question to see what people are using...
it is ok ^^ i'm using Node mostly but ran into a wall in terms of bug fixing and haven't touched it in a month
touched the code in a month*
emmit i like the update feature in your planner ๐
debugging js is terrible :~(
though im told from people who know better than i that it can be done if you figure it out
debugging node isn't hard to do
is it direct node or transpiled
you can just run the script with "node-debug ...." instead
that starts a local web server with a debugging interface
which you simply open in your browser
to get the node-debug command you need to install node-inspector globally
just an npm package
if you have transpiled ES6 it gets a bit more complicated but should still work if you have source maps set up properly
or you use something like webstorm which has the whole debugging thing integrated
the integrated debugger is very nice. I use it in phpstorm
that change to currency pricing going away when you modify the stack was really bizarre
someone at GGG must've thought that people priced stacks of currency by the stack size, which isn't right according to http://poe.trade/html/currency-stash-tabs.html
Yeah... I thought that was a very odd change on their part. I wonder if it's intended as more of a consistency thing where the note only persists if there's no change to the item in that inventory space
imagine if they were like "moving an item causes the note to be removed" :x
I would be just a bit annoyed if that were to show up in a patch note
I mean, I'm totally imagining this situation, but I can totally see it: "oh man, I wanted to sell this stack of 80 chaos for 1 exalt, but then I used some of the chaos and nobody was interested in giving me an exalt for 70 chaos because I didn't update my note, we should make it clear the notes whenever you change a stack"
and everyone's like "yep, that totally makes sense" without realizing that's not the way we treat stacks, qq
someone also mentioned in a thread, haven't confirmed, but that the same thing happens to Div Cards too
though those probably aren't trade quite as often as currency
It makes sense that it would happen with Div Cards, as they seem to be handled very similarly to currency in most game systems.
i usually just go to currency.poe.trade and manually list it there
I use a public tab that's laid out like so:
Stock on the left, single items to setting prices on the right
I have a currency tab for stock and then 3-5 tabs I set prices using that are organized by from/to currency and placed in a layout matching the currency tab.
the problem with using a premium tab like that is that it doesn't properly link the price to the stack, so we don't know quantity, and if you have two stacks with different prices we don't know reality
the ideal trading method for currency traders would be to just use a public currency tab imo
Two problems with that: 1) You can't put more than one price on a stack, which is a problem if you want to price a currency in 8 other currencies. 2) a currency tab can only hold 5k of a currency in a stack.
The data is still all in public tabs and can be aggregated into separate "number of currency" and "prices of currencyA:currencyB"
interesting
If someone puts two prices for currency A:B then that's obviously user error, so just pick the highest or lowest.
I think I'd have to write an entirely new set of tools to monitor currency in stash tab api's to try to derive all that data if I wanted to track it historically
it's clearly not as simple as "there are 400 exalts listed at 70c, 300 at 72c, etc."
The stack size limit was a major issue for me last league. Had three tabs just for coins.
yeah, it seems like ultimately if indexers could support multiple currency asks that might be the most interesting solution
like sometimes I want fuses or vaal orbs for something but don't want chaos, would be nice to be able to post either/or
On that last one: you mean currency conversions? Or for pricing gear?
both
either
~b/o 4 fuse | 3 vaal for example, sends the message I want either fuse or vaal and don't want chaos/etc.
with premium tabs it could be easier to add more complex notes like that if GGG supported it
then again, I really really wanted them to add actual metadata tags for the note and they didn't want to :/
would have loved json data like currency: Chaos Orb, amount: 5
For something like that you encounter the problem of you have to add all of your alternate prices individually on every item.
agreed, but it's also one of those things that if you really want to do it, it's not a big bother ๐
I miss being able to have extra details on a shop that everyone would read. Can specify accepted currencies, conversion rates or additional conversion fees over current market rates.
Would love to at least have some way to have some account-level info that could be displayed or linked to by trade sites.
yeah there's some very interesting stuff that could potentially be done, but whether or not it's worth it in the long run... seems like GGG has mostly decided not, which I'm sure isn't wrong
was kinda surprised at the overall scarcity of regal orbs
guess people really aren't doing the regal recipe or trying to sell them
those numbers are amount that went through poe.trade or is it current standing in the league ?
oh, crap, I forgot to add a verified filter
that was supposed to be the total amounts of those currency types available right now via the stash tab api in stashes that have been updated in the last 7 days
but the numbers are slightly off because it will include, for example, mirrors that have been sold. woops. Will fix it tomorrow.
albino rhoa is still a thing ?
apparently so! and they're more common than mirrors as far as current player trade stock
it's for fishing right ?
I think it's just for feeling good.
wow holy shit the numbers change drastically just looking at actually available items
only 51k chaos orbs available right now
and only 1k exalteds
damn that's a lot of exalts sold
sounds like a case of https://meta.stackexchange.com/questions/66377/what-is-the-xy-problem rephrase the question and maybe somebody could help
i should have put it in pseudocode to begin with, thank you
@delicate ore You could rewrite your processEvents method like so:
function processEvents ()
for _, event in pairs(events) do
for _, condition in pairs(event.conditions) do
if not event.triggered or condition() then
event.triggered = true;
event.callback()
break
elseif not condition()
event.triggered = false;
break
end
end
end
end
That would only allow an event to be triggered if it was not previously triggered, and only resets the trigger once the condition is no longer met
Although you'll run into issues with multiple conditions, which I didn't take into account.
thank you, a variant of that is what i'm using
So I'm playing with some PoE related code in WPF around items. Subscribing to the clipboard for Ctrl-C copies of items requires a good old classic WndProc handler via interop. Trying to make that a clean library is hilarious, because it requires a window handle to work, either forms or through WPF interop stuff. It makes for a great nostalgia adventure... ๐
Anyone have any relevant experience for implementing OBS plug-ins? I have one that I'd like to either commission or do myself (if there's a scripting implementation or something??)... it would be an automatic Labyrinth tracker based off the client log file for changing zones, and would start a timer on zone in with a hotkey to stop the timer when Izaro is killed. It would also increment through images every zone-in so that you would have a dynamically updating map on screen during the stream. I would do the map images manually every day, so basically just need something that can parse the log file and rename images.
You wouldn't know what mob was izaro
Iirc mob ids are written to the log file and not names
Hrm.. he did mention a hotkey to stop the timer.
Does it have to be an OBS plugin? I can see a general app for this possibly being more useful, and OBS should be able to take a window capture pretty easily, right?
Just for timers, there are existing tools: http://www.speedrunslive.com/tools/
But I like the image integration, I assume you mean each lab area map gets a picture, so it updates your 'current' location, and includes times.
can we have a screenshot?
omg novynn I hope that also means that other entries in that log will have timestamps ๐ฎ a whole new world of chat log datamining
i love it when i switch chars and hear the PING noise and miss the msg
@desert needle don't entries in the logs already have timestamps? o.o
@chrome topaz I'll get you a screenshot once it's implemented!
Whisper Message Log Format:
@From username: message```
With Guild:
```@From <guild> username: message```
Last updated 2016/07/01
Not sure if this is the right place to ask, but somebody made a tool that I found in here but can't find a download link of. It was a tool to see what items you could/should flip in PoE. IIRC, the title literally was "what items to flip". I hope that somebody can tell me/point me in the right direction. Thanks ๐
w00t
hmm i kinda want to make a tool that scans through a tab with currency and tells how much chaos/exalt equiv there is
doesn't procurement do that?
eh i guess. never used it
it was one of the old free ones, i havent used it personally but ive seen people use that function before from one of the old forum trading apps
it was basically a spreadsheet that would fill in your currency and then you set the ratios, so it was slightly better than a straight up excel spreadsheet
i just want to, let's say, press F8 (screenshot) and get some kind of report for current tab
to better evaluate how much i farm an hour/session
acquisition plus can track currency over time
as your total worth though
I guess if you told it to ignore certain tabs then you could do what you want
Ouch, that white background just blinded my retinas.
Would be happy to switch from Curse though.
I just need to rename a css file to fix that
Its just a nitpick. As a proof of concept, its perfect.
Ideally, GGG would pick it up, but that's being pretty optimistic.
I don't hibk they're interested
Think*
I'm going to put a post together on Medium explaining how to export sites of GP and Wikia
Off*
How would that work with the GP's current content license regarding distribution? Just put a note at the bottom stating that all old data past a certain date is from the GP wiki?
Speaking of the wiki, iirc, you were going to ask Chris over skype about hosting the wiki
I'm assuming he didn't get back to you on that, since you said you don't think they're interested
I did speak to him about it, he said he'd raise it internally
But I've not heard back since
That's a pity.
I understand their desire to have a lot of mechanics be unknown and left to discovery, and hosting a wiki that explains all those mechanics in details probably detracts from that whole experience, but, I wonder exactly how much that detracts from the actual game.
Yeah, though I don't think that would change
I doubt GGG would have direct data feeds into the wiki
i don't feel like they're leaning on hiding mechanics as heavily nowadays with the mechanics Q&A thread they're hosting now
Not necessarily hiding mechanics, but hiding stuff like vendor recipes
Oh I highly doubt that too, but after experiencing the convenience of the Guild Wars 1/2 wiki where mechanics were explained, and numbers were there in plain sight, the whole "find out for yourself" is a little hard when there's literally no hard numbers.
Like minion data for example.
Yeah for sure
I do applaud the new Q&A thread though, I'd say its a step in the right direction.
minion data is something that i can't understand them hiding
i think they're embarrased with the skeleton mage dps
Hard to optimize when I have no numbers for reference.
There is no dps tooltip.
What is it?
Optimize by clear speed, not by tooltip
Lightning damage has such a large spread, its hard to get a stable speed.
do most ppl use a loot filter for poe?
Yes.
its a feature implemented by ggg so i doubt its against the tos
and there are a lot of good ones, depends on prefrence
o they implemented it? is there an 'official' filter?
the 'official' filter is default game setting :)
o lol
How it works is you download a .filter file to your My Documents/My Games/Path of Exile/ folder. Then whiile the game is running you go to the Options menu, scroll down to the bottom of the UI tab, and select what .filter file to use.
where do I get the .filter files?
ty
?
Someone can explain me how to avoid lab error all the time? (I have a good PC)
Anyone know how to search for offering to the goddess unique maps on exiletrade?
Doesn't seem like exiletra.de recognizes Offering of the Goddess; sorry.
Lab errors happen about 1 in 20-30 runs for me. Never found a solution.
Came here to let @desert needle know that everytime I access http://http://api.exiletools.com/uniques/ , I get a "too many requests" on initial load. Tried on 3 PCs. I refresh in about a minute and it works, but the leagues are loaded with one button that says {{key}} . I refresh the page AGAIN to get the league names. Not important since the tool works as is, but thought I'd let you know ๐ been offering the link to people who ask for price checks often
@pseudo ocean might be hitting API key limits
@near gate exiletra.de does support offering to the goddess but since we are using the exiletools indexer we will have to wait until this is resolved https://github.com/trackpete/exiletools-indexer/issues/152
For those of you who may be interested, I have removed all authorization / api key requirements from the ExileTools ES Index.
that includes request limits/etc., though there is now per-second rate throttling
Is there any way to add uniques in the offline skill tree planner? Without having to link profiles or stashes?
Also, in the offline skill tree planner, I can't seem to see the "Offenses" summery tab under the "Character Sheet" - its always blank.
No, uniques are currently not possible to craft. You have to import stashes containing them. The "Offenses" tab is probably empty because you have not imported an inventory with items containing skill gems. Selecting skills yourself is also not possible atm.
There are a lot of fixes and improvements to the equipment stuff on the way, but unique crafting and skill selection is not done yet and not planned for the near future.
Good to know. Kind of a bummer I can't build for a unique I don't own yet.
Also is there any mod or tool to hide health and mana orbs in the game's HUD? Or one that let's you change the color of your overhead healthbar to red from green.
Kind of hacky, but you could import the inventory of someone with a public profile and the unique you want as a stash tab and use the item from there.
@desert needle hey Pete, you there?
exiletrade can now use GGG's online API:
https://www.pathofexile.com/forum/view-thread/1602257/page/4/#p13477177
I am trying to search for "amulet addcurse". It hangs unless I choose offline.
yeah getting 403
what do people use for generating loot filters? I remember seeing posts about tools that could do this, but I couldn't find one
@distant heath This might help you visualize: http://bschug.github.io/poedit/poedit.html#Af00CbhA
thanks
Exiletra.de should incorporate an average/mean price for items
maybe if they excluded below 5% and above 95%, because someone could fuck the mean/average with 99mirror prices
yeah
That an the ability to paste in an item and view pricing of items with the same affixes
that one might not be possible
It's doable, I just haven't had a moment to see how the data is being proceessed
oh i misread your comment, i thought you meant averages instead of actual prices
actual prices might be nice
@distant heath people use filtration
somebody just ran a query on our DB, running an EXPLAIN to it shows that it scans:
1,582,023,341,361 rows
Can the person explain why he did that? :>
percentiles are super easy in ElasticSearch fyi
also if anyone is curious I'm working on (very lazily) a decoding service to reformat clipboard text into ExileTools ES JSON format: https://github.com/trackpete/exiletools-indexer/issues/147 once complete, that would allow the ability to paste an item and view similar items
I started writing it with node so it would hopefully be easier for other people to maintain/contribute/improve than all my perl code ;x
@tropic breach fyi: https://www.reddit.com/r/pathofexile/comments/4s5t0j/exiletrade_now_using_gggs_api_for_checking/d57vbqs you should probably add timeout detection to exiletra.de so people don't get endless spinners as complained about in that thread
@desert needle thank you for the similar search, would you be able to configure it to auto-remove certain affixes like thorns?
the initial plan is just to have it be a re-formatting service
then people will need to implement logic around that, deciding if they want to ignore various mods, treat them differently, etc.
but tbh I wouldn't put too much hope in a "similar rare" search
you can see it by doing it on poe.trade, accuracy is VERY low
there just aren't that many items that have all the same/similar stats
yeah thats what i thought might be an issue, the high variance and relatively low amount of items in flux (low in comparison to an amount created by 10x or 50x the current playerbase, like D3 had)
hey guys, what's everyone's favorite loot filter?
I'm more interested in a filter by type than rarity fwiw
I like Neversink's
is there a Neverlink?
Neversink's is probably one of the most popular filters.
i googled "ziggyd loot filter" about a year ago and used it as a base, have edited it many times over
https://www.pathofexile.com/developer/docs/api-resources it only show some repository or is it all?
@frosty obsidian I made my own filter
@frozen moth Doesn't show everything. Take http://api.exiletools.com/info/official-passives.html for instance; this shows you how to download passive skills.
Would anyone be interested in the tools & techniques I've built up over time for Linux? I've found a combinations tools and built up a node library for executing macros. I've used it to integrate the unique price check API and will be adding support for the item data to JSON API to see information such as DPS.
@jaunty topaz is it available for dl?
I'm liking neverlinks
I didn't realize how many 6l and rgb whites drop
@frosty obsidian maybe once I get finished with my colour overhaul
@near gate yes please. i've hit a wall on every PoE app i'm trying to make
@pseudo ocean What wall have you been running into?
@chrome topaz Hey thanks for adding PvP season 2 alt arts to the alternate art list on .trade yesterday :)
We've taken down the public stash api for a little bit
nah, just reducing load to track down another issue
should be back up now!
Thanks!
Anyone care to clarify what "false" league is? :D
http://api.exiletools.com/uniques/#/false
is there anywhere a full list of loot filter functions like SetBorderColor and how they are used? Finished building a visual loot filter builder and want to double check if I missed any functions or created a wrong placeholder like PlayAlertSound [min] [max]
guys would it be possible to make a sort all feature?
or a sort page script?
to consolidate things across ur inventory?
That kind of thing isn't allowed.
A macro can at most do 1 action per button press.
Quick note on that picking up/setting an item down is a server action each, so you shouldn't really be messing with sorting. You could sort your inventory out of game then manually update it though
baubles are grey now god bless neversink
They finally updated their lootfilter? sweet.
i tried. and it shows the same way in firefox
we have like an 80mg up/down line at work
im in south africa.. maybe it's like a restricted ip range or something?
*throttled
if you have internet on your mobile you could try it there
maybe your workplace is blocking it
was acting up for me also, same with some other sites. didn't seem to be related to GGG servers