#wiki | Path of Exile 1 & 2 | Page 9

pure cipher Jul 29, 2021, 9:29 PM

#

Got the datasets and some ideas to do more automated derivation and guesswork of DAT schemas, but it requires work on a whole bunch of systems to get there.

fiery plover Jul 30, 2021, 5:51 AM

#

So poor grammar on the Item acquisition for Bottled Faith.

#

DON'T left the map before he finish the speech.

#

should be dont leave the map

lusty hedge Jul 30, 2021, 8:57 AM

#

Understand that some people that edit the wiki on their free time are not english natives speakers so they can have a "poor grammar"

#

And if you see any mistake, I encourage you to edit it

analog abyss Jul 30, 2021, 9:16 AM

#

I have no idea on programming level. There is a user (L1mer) try to update the specification so that to make the pypoe some sort of working in some area (plus the repoe writer who make a separate fork), but probably I need to learn the code work to try to fix myself for the skill gem export.

And GGG literally wrote it in TOS reverse engineering the game content and data is forbidden, just they don't want to change the enforcement level yet. (The current enforcement level is no banning for reverse engineering but only banning those used it in cheating)

analog abyss Jul 30, 2021, 9:18 AM

#

fiery plover DON'T left the map before he finish the speech.

You can edit and refine the text your self. Just a reminder text as too many people click respawn in the mid of the speech and lost the loot forever

thorn granite Jul 31, 2021, 4:46 AM

#

anyone have access to the database?

#

I've spotted some errors and was under the impression the bots updated the data, so it shouldn't be inaccurate...?

#

or is data still being updated?

#

@gritty shadow

raven bluff Jul 31, 2021, 5:13 AM

#

data hasn't been updated in a few leagues 😦

thorn granite Jul 31, 2021, 5:34 AM

#

hrmm

#

we did the minimap 12 hours ago

#

reminds me I have some work to do on the wiki.. but some other stuff seems out maybe I'll do it myself

gritty shadow Jul 31, 2021, 5:35 AM

#

thorn granite <@!149733337794084865>

I don't know what you're talking about I think you pinged the wrong person

thorn granite Jul 31, 2021, 5:36 AM

#

Oh do you not know omega2k lol

gritty shadow Jul 31, 2021, 5:37 AM

#

no idea who that is

thorn granite Jul 31, 2021, 5:37 AM

#

he runs the path wiki ...

gritty shadow Jul 31, 2021, 5:37 AM

#

he stole me name that bastard

#

ill sue

thorn granite Jul 31, 2021, 5:37 AM

#

yea not likely 🙂 lol

#

also u sussy baka btw

gritty shadow Jul 31, 2021, 5:38 AM

#

https://tenor.com/view/among-us-red-sus-suspect-among-gif-19597730

Tenor

#

AMOGUS?!

#

poggers

thorn granite Jul 31, 2021, 5:38 AM

#

excuse me this is a pathofexile discord please keep it on topic

gritty shadow Jul 31, 2021, 5:38 AM

#

thats what you get for pinging me because some dude has a similar name

thorn granite Jul 31, 2021, 5:39 AM

#

his name is omegak2 actually hmm

#

@grand magnet there he is!

analog abyss Jul 31, 2021, 6:55 AM

#

He is not online in wiki since December, and you got his msg when viewing his github

https://github.com/OmegaK2/PyPoE

(and i guess L1mer stop to maintain his own fork too, he does not response the pull request https://github.com/L1mer)

(ok, i will try to run the fork from https://github.com/brather1ng/PyPoE or pull some file overthere to see is it work to try to run bot in some namespace (sorry no modifier namespace))

analog abyss Aug 1, 2021, 5:22 AM

#

@livid moth It seem the pic from the Template QuoteLore is shifted due to the new skin css. How to fix it?

e.g. error pages

https://pathofexile.fandom.com/wiki/Hillock

pale bear Aug 1, 2021, 7:27 AM

#

Reading some of the comments here on updating the wiki, and I cannot believe that GGG doesn't at least give a spec. Without PoeDB nd similar tools, there basically is no POE.

#

It is incomprehensible that GGG would leave the people making the tools that make their gama playable completely in the dark.

analog abyss Aug 1, 2021, 7:40 AM

#

pale bear Reading some of the comments here on updating the wiki, and I cannot believe tha...

dude.....read it

https://www.pathofexile.com/developer/docs

Executable apps that interact with the game or game files.
This behaviour is strictly against our Terms of Use (section 7b).
Creation or use of these type of applications will result in immediate account termination.

#

the site i posted have all the official resource that the dev want the tool developer to know, but not the spec inside the game file

pale bear Aug 1, 2021, 7:42 AM

#

people should just stop making or updating tools for the next rlease or two.

#

and make people know why you stopped

#

seems to highly depend on the definition of "interact"

analog abyss Aug 1, 2021, 7:45 AM

#

No, it is against TOS but they don't enforce it yet

#tooldev-general message

pale bear Aug 1, 2021, 7:46 AM

#

lol yet. they don't hav e a choice

#

i doubt reading a file placed on your machine can violate TOS.

#

"We don't want you to" isnt really an arguemnt

analog abyss Aug 1, 2021, 7:47 AM

#

#tooldev-general message

Can you read?

#

not sure what you mean. This is in the context of executable applications and they shouldn't contain your OAuth client credentials. They can locally store tokens if they want since those are short lived
zao seems to have been under the misconception that we endorse extracting game data which we do not and never have. We just haven't acted on the accounts engaged in it
on the other hand us publishing these documents doesn't mean we're looking to change our existing level of enforcement

jade mica Aug 1, 2021, 7:55 AM

#

@pale bear why we should stop updating tools? the fact that they exists already means there is no issues with getting data from client (as long as ggg is neutral to it)

pale bear Aug 1, 2021, 7:55 AM

#

i just saw whoever it was say ggg doesn't endorse reading the pack files- not that they can really do much about it
im sure their company will say they can, but doesnt make it so
it would be a corporate death sentence to enforce it.

#

@jade mica ggg's horrible stance against the 3rd party devs that make this game what itis

#

peple bust their asses for no pay to help the game along and ggg basically tells them to fuck off

analog abyss Aug 1, 2021, 7:59 AM

#

I am not suggesting OmegaK2 stop to develop is due to new ToS, but i am saying dev (Novynn) has said before those stuff, at your own risk on tool development so that GGG can change the enforcement level to ban people as they are literally saying it is against ToS but they does not enforce it yet (for cheating of course they will ban, for poedb or pypoe fork such as repoe, it seems not yet)

pale bear Aug 1, 2021, 8:01 AM

#

if just the wiki, pdb, and pob went dead next week, ggg would feel it.,

#

not saying ppl should (and ive oly make 1 edit to the wiki for bad info), but i would deinitely be closer to it

analog abyss Aug 1, 2021, 8:02 AM

#

wiki has been semi-dead due to unable to fetch modifier (actually as of 3.13 still able to extract mod by pypoe, my bad not step in to request bot account right to carry actual edit)

pale bear Aug 1, 2021, 8:03 AM

#

ive thought about helping, but every time i get closer i back away

#

i work in computational finance and trading and have a lot of spare time right now even

#

i waned to do somethign with the passive tree, but i cant get the info

analog abyss Aug 1, 2021, 8:04 AM

#

But now with life cost change, it definitely need someone to fix pypoe for wiki.

For poedb, i think website ad and Patreon revenue are not much, but at least there is a monetary reason to do so (unless you are saying the server cost is greater than revenue)

pale bear Aug 1, 2021, 8:05 AM

#

is pypoe real? last i saw was a mention of it on the ggunpak site

analog abyss Aug 1, 2021, 8:05 AM

#

It is real

https://github.com/OmegaK2/PyPoE

pale bear Aug 1, 2021, 8:06 AM

#

my python is better than my nonexistant other lang that it was in

analog abyss Aug 1, 2021, 8:06 AM

#

the semi-working fork 1
https://github.com/L1mer/PyPoE

the semi-working fork 2

https://github.com/brather1ng/PyPoE

pale bear Aug 1, 2021, 8:06 AM

#

is just more ereverse engineering the format?

#

whats borked?

analog abyss Aug 1, 2021, 8:07 AM

#

OmegaK2 stopped to answered pull request, and just like POB fork, it is a community based project that other people work on its own fork and then merge code

pale bear Aug 1, 2021, 8:09 AM

#

impt question: does it work on linux? im useless as a dev on windows

analog abyss Aug 1, 2021, 8:09 AM

#

While the actual function of pypoe is read the game file, extract the values and parse as either wiki code, or in lua for wiki module. But GGG change the format of its own table time to time. which life cost is a major rework

pale bear Aug 1, 2021, 8:10 AM

#

i have to get some sleep, pm'ing yo my email

analog abyss Aug 1, 2021, 8:10 AM

#

I think py can run in any console? (I use Windows PowerShell to run it)

pale bear Aug 1, 2021, 8:11 AM

#

i have 4 machines in front of me right now, 1 is windows and i need oher peope to help me when it goes down

analog abyss Aug 1, 2021, 8:11 AM

#

and i guess notepad or Visual Studio Code or whatever can do for the editing the py code

lusty hedge Aug 1, 2021, 4:31 PM

#

How to update the gem level progression without hurting my hand changing the value manually ? Is there a method with a spreadsheet ?

analog abyss Aug 1, 2021, 6:33 PM

#

lusty hedge How to update the gem level progression without hurting my hand changing the val...

I think last league (3.14) pypoe fork still works for support gem. For active skill gem, you really need to manually update it or learn py and try to figure out how to incorporate the 3.14 change on cost to pypoe

#

note that Vinifera7 changed the parameter so that pypoe need to incorporate the change in it too

rich widget Aug 1, 2021, 6:35 PM

#

Yeah. The new cost parameters are documented here: https://pathofexile.fandom.com/wiki/Template:Skill#Cost_parameters

#

However, I made sure to include backwards compatibility. So in case you do use the old way of specifying mana cost, it won't break anything.

lusty hedge Aug 1, 2021, 6:36 PM

#

Because I did this for Bladestorm and oh my god, that's was loooooong to update it manually

analog abyss Aug 1, 2021, 6:36 PM

#

Or i guess i need to figure it out myself and read other people fork on the specification on "teaching" pypoe how to read the game file properly

pure cipher Aug 1, 2021, 6:38 PM

#

Kind of three parts to it I reckon. Ensure that enough of PyPoE understands bundles, ensure that the exporter code does it right, and ensure that the spec matches up enough.

#

I never managed to get much farther than trying to specify which tables to export, as the syntax to pass multiple of them into pypoe_exporter is inscrutable.

lusty hedge Aug 1, 2021, 6:39 PM

#

Anyways, the wiki need a rework, like when you want to edit a skill for exemple and you know nothing about the wiki, you just want to edit the cost or the gem acquisition... It's not normal that you have to scrolls about 10K lines to got what you need

#

Like the wiki is very counter-intuitive if you don't have the patience or the fundamentals, so I maybe (not sure) try to rework some of the pages to put them more beginner friendly to edit or to update it

rich widget Aug 1, 2021, 6:41 PM

#

lusty hedge Anyways, the wiki need a rework, like when you want to edit a skill for exemple ...

That's kind of unavoidable though. All of that data has to be defined somewhere.

lusty hedge Aug 1, 2021, 6:41 PM

#

Yes but like, it's not organized

#

The gem level progression is not in the gem level progression section, is in the gem presentation section

#

So if you want to just edit the gem level progression, you will need to pass all of the gem description, cost etc... To have what you want

rich widget Aug 1, 2021, 6:44 PM

#

Yeah, I know. Currently, the skill data for skill gems (and support gems) is stored by the Item template.

lusty hedge Aug 1, 2021, 6:45 PM

#

But I now that it will not be an easy task to rework this etc ... Because of time, private life, working etc... etc...

rich widget Aug 1, 2021, 6:45 PM

#

We could split it up so that the skill data is stored on a separate page in the Skill: namespace, but that doesn't solve the problem of it being convoluted.

lusty hedge Aug 1, 2021, 6:46 PM

#

Yea, I will think about how can we change that

rich widget Aug 1, 2021, 6:46 PM

#

I don't think there's any good way to use the Skill progression template to store the skill data though. I don't see how that can work.

lusty hedge Aug 1, 2021, 6:47 PM

#

Because like, I want to add the new gem, update the gem, add the new items etc.. Like what I did in 3.12, but currently it's very painful to edit it :/

#

I don't have the idea currently, will think about it

grand magnet Aug 1, 2021, 7:07 PM

#

pure cipher Kind of three parts to it I reckon. Ensure that enough of PyPoE understands bund...

the wiki exporter understands bundles just fine, it's just a matter of adjusting the new files/specification and the relevant stuff in the exporter code. A lot of things are just mapped 1:1 from dat to lua export (maybe with minor adjustments for wiki readability)

grand magnet Aug 1, 2021, 7:26 PM

#

rich widget We *could* split it up so that the skill data is stored on a separate page in th...

I'd be wary about splitting things that belong together too much. Cargo is prone to issues, and the more you split things up the more likely you end up into missing/duplicate data for some stupid reason. Gamepedia applied a bunch of fixes, maybe it's better now. I was hoping there would also be proper multi-row stores at some point but that never happened afaik.

Also when you do split things up that means multiplying the pages a user would have to go through and edit to update a skill. Cargo strikes here again, that until all pages are updated and only when the main page containing the item is edited, it will actually update the skill.
So, when you say do seperate pages for each skill level, unless you force a cache update the skill would contain whatever old values it had before, which doesn't really make it any easier for editiors. It's the reason a lot of things are sort-of contained in a single page where it made sense.

The skill template is already simplified from the data variant in that it defines "static" stats. The exporter actually looks at the gem levels and finds stats that never change and puts them into the static value in an efford to reduce clutter on the wiki. One thing I had planned, but never got around to was removing the levelXX = True line since that can be implied from having other values, though that only makes it marginally less cluttered.

bitter sorrel Aug 2, 2021, 9:54 AM

#

Omega_K2 is alive! 🙂

livid moth Aug 2, 2021, 10:29 AM

#

analog abyss <@!293217889270497280> It seem the pic from the Template QuoteLore is shifted du...

The line height applied in the template is messing with that. I'd suggest adjusting that.

livid moth Aug 2, 2021, 1:58 PM

#

https://community.fandom.com/wiki/User_blog:MisterWoodhouse/Retirement_of_legacy_designs

analog abyss Aug 3, 2021, 7:43 AM

#

so we have one month (edit: until August 23rd, 2021) to debug the bugs due to css change....

lusty hedge Aug 3, 2021, 11:46 AM

#

why ?

stone crater Aug 3, 2021, 12:07 PM

#

read the link above

lusty hedge Aug 3, 2021, 12:18 PM

#

Ah that's a bad news

molten echo Aug 3, 2021, 1:45 PM

#

I supposed fandom is the best free option, no other wikis that you might be able to migrate to?

analog abyss Aug 3, 2021, 2:11 PM

#

WTF fandom has yet another color change on its new fandomdesktop skin.....

jade mica Aug 3, 2021, 2:44 PM

#

UX friendly colors, definitely. 😵‍💫 It feels like fandom colors competing with ads for attention 🥲

analog abyss Aug 3, 2021, 2:46 PM

#

molten echo I supposed fandom is the best free option, no other wikis that you might be able...

Someone already fork the POE wiki except that they still figuring out how cargo table work

analog abyss Aug 3, 2021, 4:52 PM

#

actually it just matter time that someone made a fork that work, just like Destiny 2 wiki of fandom is way inferior than destinygamewiki.com or destinypedia.com

It should somewhat profitable to at least cover the server cost. Just it is not sure GGG' pov and the umbrella clause in the TOS. Bungie is quite friendly with tool developer (just they are not that happy to be datamined all the not release quest of the season) but GGG only friendly on the trade API but not the rest of the tools. It just take a blind eye on trade overlay (pricing one) and often stressing it subject to change on enforcement level. And wiki to a certain extend need to scrap all the graphic of skill gem and status icon to the wiki, which such DMCA case (if any), currently should handle by fandom

lusty hedge Aug 3, 2021, 5:34 PM

#

Yea but with all of the PoE content that we got and will get, it will be a hard and long work to have a good forked wiki, and if GGG it's okay with that

analog abyss Aug 3, 2021, 5:47 PM

#

actually most map article are not fixed since 3.1 (or 3.5?)....content are left in the child article, modifier are outdated every league, skill gem and passive outdated every few leagues, actually wiki has not much content to fork. The real thing works are the traffic (which the rmt ad exists and i am not success to report it) and the active wiki editors and the templates, all are the backbone of the wiki

#

and the wiki fork literally copy all the img as far as i know (or at least img with cat that can be discovered by bot are copied)

lusty hedge Aug 3, 2021, 5:51 PM

#

I'm agree with you, I think to have a good wiki, we need to have the entire power on it, like how does it work (coding), database etc.. and the ad (to counter rmt ad, like you said), traffic etc... Since the wiki belongs to fandom, we have just the "content control". So I hope that the one who is currently copying it ? Will succeed

crimson gulch Aug 3, 2021, 5:59 PM

#

lusty hedge Yea but with all of the PoE content that we got and will get, it will be a hard ...

I don’t see why GGG would have any problems with it. There’s no commercial relationship between GGG/Curse/Fandom

analog abyss Aug 3, 2021, 6:07 PM

#

lusty hedge I'm agree with you, I think to have a good wiki, we need to have the entire powe...

It certainly will if every active wiki editors jump the ship and let fandom version be ruin with GGG nerf hammer every league. Some monster and monster article are actually created during 1.0 and never touched by other editors again (except bot edit)

lusty hedge Aug 3, 2021, 6:09 PM

#

analog abyss It certainly will if every active wiki editors jump the ship and let fandom vers...

I'm waiting the ship :>

#

But I think that we also need to currently update the wiki

raven bluff Aug 3, 2021, 6:12 PM

#

analog abyss It certainly will if every active wiki editors jump the ship and let fandom vers...

tbh, I suspect part of the solution there is going to be merge/redirecting a bunch of articles into parent articles with lists

analog abyss Aug 3, 2021, 6:16 PM

#

and BTW here is the all time rank

https://pathofexile.fandom.com/wiki/Special:WikiPoints

Special:WikiPoints

Top Wiki Editors - Official Path of Exile Wiki

livid moth Aug 3, 2021, 7:36 PM

#

Hey all, the Path of Exile Wiki will have the expanded width for anons and users by default now. It will take up to 24 hours for the cache to take effect.

#

Scratch the cache part, the cache was dumped so it should be live for everyone.

rich widget Aug 3, 2021, 7:47 PM

#

analog abyss It certainly will if every active wiki editors jump the ship and let fandom vers...

If it looks like a forked wiki can be sustainable, then I'll happily get on board.

analog abyss Aug 4, 2021, 5:54 AM

#

I never have a look on its current state BTW, only via discord

https://pathofexile.miraheze.org/wiki/Main_Page

Main Page

lusty hedge Aug 4, 2021, 7:16 AM

#

Things start to moves : https://www.reddit.com/r/pathofexile/comments/ox4bvj/would_you_contribute_to_moving_the_wiki_out_of/?utm_medium=android_app&utm_source=share

r/pathofexile - Would you contribute to moving the wiki out of fandom?

531 votes and 153 comments so far on Reddit

lusty hedge Aug 4, 2021, 7:38 AM

#

I've seen a lot of "Why GGG doesn't help?", "Why GGG doesn't gives the data ?etc..." And I think the answer it's simple and can be found couple leagues ago when Chris said "It's been a long time where players was searching for a new recipe, mechanic etc.. And that's why we've added... ...."

#

GGG want us to struggle, to find recipe, to find data, to find everything because they think that's exciting us like the old times, when wikis was edited manually by fans with datas written on a book... And I think they have this nostalgic vision

stone crater Aug 4, 2021, 8:05 AM

#

GGG continues to delete .dat files, and the api has not been improved for many years. It is very likely that more .dat files will disappear in the next league.

rich widget Aug 4, 2021, 8:15 AM

#

stone crater GGG continues to delete .dat files, and the api has not been improved for many y...

Does that mean certain game data no longer exists on the client side? What's an example, if you don't mind me asking?

stone crater Aug 4, 2021, 8:20 AM

#

recently removed or all removed?

#

[
    "AfflictionEndgameAreas.dat",
    "AfflictionRandomSpawns.dat",
    "AlternateQualityCurrencyDecayFactors.dat",
    "AtlasQuadrant.dat",
    "AtlasSector.dat",
    "BestiaryRecipeItemCreation.dat",
    "CharacterStartItems.dat",
    "ChestItemTemplates.dat",
    "ComponentArmour.dat",
    "CustomLeagueMods.dat",
    "DelveFeatureRewards.dat",
    "DelveRewards.dat",
    "EventSeason.dat",
    "EventSeasonRewards.dat",
    "HarbingerMaps.dat",
    "HarvestDurability.dat",
    "HarvestInfrastructureCategories.dat",
    "HarvestObjects.dat",
    "HarvestPlantBoosterFamilies.dat",
    "HarvestPlantBoosters.dat",
    "HarvestSeedTypes.dat",
    "HarvestSpecialCraftCosts.dat",
    "HarvestSpecialCraftOptions.dat",
    "HarvestStorageLayout.dat",
    "IncursionUniqueUpgrades.dat",
    "InventoryId.dat",
    "ItemSets.dat",
    "ItemSynthesisCorruptedMods.dat",
    "ItemSynthesisMods.dat",
    "ItemTemplates.dat",
    "ItemTradeData.dat",
    "LabyrinthRewards.dat",
    "LeagueFlags.dat",
    "LeagueTrophy.dat",
    "LegionRewards.dat",
    "MapStatsFromMapStats.dat",
    "MicrotransactionHudVariations.dat",
    "ModSets.dat",
    "MonsterAdditionalMonsterDrops.dat",
    "MonsterChanceToDropItemTemplate.dat",
    "MonsterStatsFromMapStats.dat",
    "NPCAdditionalVendorItems.dat",
    "NPCShopAdditionalItems.dat",
    "PassiveSkillBuffs.dat",
    "PathOfEndurance.dat",
    "ProjectileVariations.dat",
    "ProphecySets.dat",
    "QuestRewards.dat",
    "QuestVendorRewards.dat",
    "RaceAreas.dat",
    "RandomUniqueMonsters.dat",
    "RitualDaemons.dat",
    "ShopCategory.dat",
    "ShopCountry.dat",
    "ShopCurrency.dat",
    "ShopForumBadge.dat",
    "ShopPackagePlatform.dat",
    "ShopPaymentPackage.dat",
    "ShopPaymentPackageItems.dat",
    "ShopPaymentPackagePrice.dat",
    "ShopPaymentPackageProxy.dat",
    "ShopRegion.dat",
    "ShopToken.dat",
    "StatSets.dat",
    "SupporterPackSets.dat",
    "UniqueFragments.dat",
    "UniqueSets.dat"
]

rich widget Aug 4, 2021, 8:30 AM

#

lusty hedge GGG want us to struggle, to find recipe, to find data, to find everything becaus...

GGG has never been keen on the community data mining PoE. However, it was also a much smaller game way back when, which made it possible – though through no small effort – to keep things fairly up to date on the wiki without relying on data mining.

wooden mural Aug 4, 2021, 8:38 AM

#

I personally would like if game factors, such as gems and their associated values could be automated. While things like certain mechanic or drop locations are manual.

Pretty much how it is currently

analog abyss Aug 4, 2021, 9:41 AM

#

lusty hedge GGG want us to struggle, to find recipe, to find data, to find everything becaus...

gamespot used to have people written full notepad guide

#

and Chris lives in that era. Without Youtube, download trailer in fileplanet is meta, and then gametrailers.com is founded (and then folded)

rich widget Aug 4, 2021, 3:36 PM

#

Yet those guides written in notepad were for games that never changed once they were released, let alone sweeping meta changes every 3 months...

pure cipher Aug 4, 2021, 3:38 PM

#

The big value-add the wiki has over say poedb is the coexistence of hand-written information with machine-updated tables of bulk information.

#

poedb pretty much by design only holds mined and scraped information, organized in many ways.

lusty hedge Aug 4, 2021, 4:26 PM

#

Yes but since it's data mined, it's easier to put it on a website than write every lines manually with some explanation

#

Like, I tried to create the page for Rage Vortex, and there was so many errors and some value I couldn't add because didn't find them

analog abyss Aug 4, 2021, 6:02 PM

#

I guess you can ignore the per level parameter for now and just fill the stat text and mana multiplier , those essential info

Looking at page history of some gem article back to 2013, there must be some way to do it without datamining, just may be miss a few info

lusty hedge Aug 4, 2021, 6:10 PM

#

I've tried to ignore the per level info, but it doesn't work, it must have it and I dont know why otherwise the page doesn't load and we have a cargo error

rich widget Aug 4, 2021, 7:43 PM

#

lusty hedge I've tried to ignore the per level info, but it doesn't work, it must have it an...

Can you show me the error?

lusty hedge Aug 4, 2021, 7:57 PM

#

I will show you this tomorrow, can't now (UTC)

raven bluff Aug 4, 2021, 10:17 PM

#

stone crater ``` [ "AfflictionEndgameAreas.dat", "AfflictionRandomSpawns.dat", "A...

Some of these were removed because they no longer exist in the game. A bunch of the Harvest data files were for the Sacred Grove layout minigame, for example

#

And at least one of the other files you listed looks like a feature in development which was accidentally included. 🙂

grand magnet Aug 4, 2021, 10:32 PM

#

QuestRewards and the one that mod sell prices are the real shitty ones. component armour was moved elsewhere I think?

#

though also shitty if entirely gone

raven bluff Aug 4, 2021, 10:34 PM

#

grand magnet QuestRewards and the one that mod sell prices are the real shitty ones. componen...

#tooldev-general message re. ComponentArmour

#

ModSellPrices is… eh. It's annoying to not have but I suspect that most players don't really care that much. QuestRewards hurts more; I think part of the answer there is going to have to be a close reading of patch notes and manual spot-checking

indigo salmon Aug 4, 2021, 11:47 PM

#

I have created this page https://pathofexile.fandom.com/wiki/Expedition_Logbook, please help me complete the sub-pages and create templates.

rich widget Aug 4, 2021, 11:59 PM

#

indigo salmon I have created this page <https://pathofexile.fandom.com/wiki/Expedition_Logbook...

It looks like the internal class name for the log books is actually "ExpeditionLogbook". I will fix this, and update Module:Game

#

Done.

low flame Aug 5, 2021, 12:55 AM

#

Does it usually take weeks for new content to get a page on the wiki?

rich widget Aug 5, 2021, 1:29 AM

#

low flame Does it usually take weeks for new content to get a page on the wiki?

If there is an article that you think should be on the wiki, you're more than welcome to create it. How long it takes really depends on you.

low flame Aug 5, 2021, 1:30 AM

#

I'm not familiar with creating wiki pages, and thus it would take me vastly more time than it would take someone who's very familiar with it. I'll leave it to other people, for the same reason you (presumably) leave solving mathematical theorems and studying traffic patterns to people who don't have to spend tons of time learning the basics just to get off their feet. Sorry for the nerve I struck, I really was just asking.

rich widget Aug 5, 2021, 1:34 AM

#

It's a meaningless question. No one here is on a schedule.

low flame Aug 5, 2021, 1:35 AM

#

I'm not sure I understand. "Does it usually take weeks for new content to get a page on the wiki" is obviously referring to past patches where new content was added. I haven't played in a long time, so I'm not familiar with how long it usually takes the new content to get up and running on the wiki.

pure cipher Aug 5, 2021, 2:18 AM

#

low flame I'm not sure I understand. "Does it usually take weeks for new content to get a ...

There’s two types of content on the wiki - there’s the hand-written sections on pages and for subjects that are pretty much all human text, as well as things that only humans can find and index like vendor recipes, gem quest rewards, things like that.
Then there’s the data-driven tables and bulk content like skill gem info, mods, level scaling. All that is sourced from game data files and require a fair bit of work from independent developers to keep up to date with the changes GGG make to the files. This aspect of it has been lapsing for leagues.

#

As many parts of the wiki are designed around semi-automatic updates of data, hand-updating them can often be tricky, especially for a newcomer to the structure.

low flame Aug 5, 2021, 2:20 AM

#

Ah, interesting, thanks!

crimson gulch Aug 5, 2021, 9:33 AM

#

From a content PoV, what the biggest hurdle to importing the current wiki to another host? IIRC getting images was a bit of a pain but everything else was fairly simple assuming the correct Wiki extensions were installed

lusty hedge Aug 5, 2021, 11:06 AM

#

All of the new divinations cards has been added

lusty hedge Aug 5, 2021, 11:21 AM

#

I have added the patch note 3.15.1 but without any links because cannot finish it at time

crimson gulch Aug 5, 2021, 12:08 PM

#

Downloading 15k image files from the wiki may take a while 🤔

bitter sorrel Aug 5, 2021, 1:12 PM

#

wow, iamacyborg is still alive too? 😉

crimson gulch Aug 5, 2021, 1:14 PM

#

just about 😅

bitter sorrel Aug 5, 2021, 1:14 PM

#

good to see!

crimson gulch Aug 5, 2021, 1:16 PM

#

you too bud!

crimson gulch Aug 5, 2021, 2:27 PM

#

All page names https://docs.google.com/spreadsheets/d/1Odllve1gRFfBuoKwNIeEUr9Hj5kjPNw9CoGyk7D1nas/edit?usp=sharing

Google Docs

PoE Wiki Pages

Sheet1

Page
O' Eternal
The Kiss Goodnight
The Nameless Play
10x Northern Lights
10x Passive Skill Refund
10x Skin Transfer
15x Dark Fireworks
1 Hour Lethal Solo
1 Hour Multiprojectile Solo
20x Classic Fireworks
3.11
3.11.1
3.11.2b
3.2.0
50x Passive Skill Refund
50x Skin Transfer
5x Skin Transfer...

#

Looks like Fandom's Export util break when trying to generate files > 50MB

crimson gulch Aug 5, 2021, 2:49 PM

#

Yeah so if you want to export revisions you can get ~3k pages at a time via the exporter

crimson gulch Aug 5, 2021, 4:12 PM

#

well, let's see if this works

rich widget Aug 6, 2021, 4:17 AM

#

I've switched over to the new Fandom theme, just so see what it's like to actually edit the wiki with it enabled. It's so goddamn slow to edit anything! I clicked the "edit section" pencil on one page and had to wait about 10 seconds for the visual editor to load, then I had to wait some more switching to the source editor. It used to be fairly slow to edit stuff on Fandom, but this is ridiculous! This is an absolute deal breaker. No joke.

#

Oh, and I forgot to mention. Section editing doesn't even work. Clicking the "edit section" pencil doesn't do anything different than clicking the main "edit" pencil at the top of the page.

rich widget Aug 6, 2021, 4:38 AM

#

The entire editing experience has been gutted. Where's the list of transclusions on page? Where's the debug log and the performance data?

raven bluff Aug 6, 2021, 4:40 AM

#

There's a bunch of utility links that have gone missing too, like WhatLinksHere. Not sure if that's a recent loss or an older one

stone crater Aug 6, 2021, 4:41 AM

#

WhatLinksHere in the right side panel when logon

rich widget Aug 6, 2021, 4:42 AM

#

What links here is down here for some reason.

#

It's also here, but I normally have the side bar collapsed.

raven bluff Aug 6, 2021, 4:45 AM

#

Okay, so it's somewhere that you can't get to without logging in. Not much better

rich widget Aug 6, 2021, 4:45 AM

#

Probably.

#

Yeah, I just checked. It's not shown anywhere if you're not logged in.

#

Oho! There is actually a way to switch back to the full editing experience. Go into your preferences and switch to the Editing tab. Select "Source editor" as your preferred editor.

There seems to be no way to get the full editing experience without doing this, since the Fandom theme defaults to the visual editor and clicking "Edit source" goes to the visual editor in source mode instead, which is useless.

analog abyss Aug 6, 2021, 7:12 AM

#

I have set to source code edit as default btw (not visual edit source code mode). Old habit of source code by default carry over from wikipedia (and carry over my not preview edit bad behaviour)

rich widget Aug 6, 2021, 8:32 AM

#

I did too, but Fandom apparently decided to change my preferences for me.

crimson gulch Aug 6, 2021, 7:24 PM

#

testing import scripts now I've got the whole thing dl'd

analog abyss Aug 6, 2021, 7:50 PM

#

you probably need template and module

#

and modifier are stored in modifier, area in area, monster data in monster namespace and so on

#

despite if pypoe is fixed modifier and area and monster and some module that only store game data in lua can be skipped and just export as new

crimson gulch Aug 6, 2021, 8:00 PM

#

Templates and Modules are all in the import too

#

Basically grabbed everything from every namespace

#

~3GB XML file

crimson gulch Aug 6, 2021, 8:17 PM

#

Slow as hell though

crimson gulch Aug 7, 2021, 6:55 AM

#

#

Daily Deals page is killing me with all the revisions

analog abyss Aug 7, 2021, 8:15 AM

#

I think that page is trivial and some third party site is doing the same thing

analog abyss Aug 7, 2021, 9:13 AM

#

https://pathofexile.fandom.com/wiki/Daily_Deals/2021?action=history is primarily updated by Arrowneus and it has stopped since June 2021

Path of Exile Wiki

2021

Revision history of "Daily Deals/2021" - Official Path of Exile Wiki

rich widget Aug 7, 2021, 9:42 AM

#

There used to be a third party website that kept a historical record of the daily deals at https://mtxhistory.com/. It no longer exists.

#

Either way, I don't really care about keeping a record of it on the wiki, but there was no harm in letting Arrowneus do his thing.

crimson gulch Aug 7, 2021, 10:12 AM

#

Oh yeah, it's fine it just took ages for that one page to run through as it's huge and there were so many updates on it.

#

The import I'm working on is currently at ~6k pages

crimson gulch Aug 7, 2021, 10:44 AM

#

What extensions are critical to the wiki, other than Cargo?

rich widget Aug 7, 2021, 11:05 AM

#

What comes pre-installed? Anything?

#

Ones that I can think of that might need to be installed are EmbedVideo, Math, Scribunto, SyntaxHighlight, and Widgets. There might be others.

crimson gulch Aug 7, 2021, 11:08 AM

#

I ticked all the boxes and got these

#

easy enough to remove stuff or add new extensions though

rich widget Aug 7, 2021, 11:09 AM

#

I think Tabber might be used on a few pages, but I'm personally not a fan of it.

crimson gulch Aug 7, 2021, 11:11 AM

#

Cool I'll take a note of those and get them added. No point doing much until I can confirm the import ran and I've run the image import

#

Looks like it'll take at least another day at this rate though

#

I'm generating another XML dump from Frandom which is just all the newest revisions of pages to try speed up the process, I can add the historical revisions after that

grand magnet Aug 7, 2021, 11:39 AM

#

if you update pypoe you can probably ingore several tens of thousands of pages in the export, since you can reexport them with pypoe

#

specifically mod/skill/monster namespaces

#

I suppose the version history is lost, but I don't think it matters much in those cases

crimson gulch Aug 7, 2021, 11:40 AM

#

I have no idea how to run pypoe though 😬

grand magnet Aug 7, 2021, 11:41 AM

#

well you'd need to update it first since it has been on the poe version of december or so

crimson gulch Aug 7, 2021, 11:44 AM

#

hah yeah I think I'll stick with my current plan for now just to get the basic site up and running

crimson gulch Aug 7, 2021, 12:01 PM

#

A little more real estate than Fandom

analog abyss Aug 7, 2021, 12:45 PM

#

rich widget Either way, I don't really care about keeping a record of it on the wiki, but th...

my point is it is low priority to export the page history and it is no harm for people to keep on their own project (except never answer the talk page and sometimes i have to double check the meta data id is fabricated or genuine )

analog abyss Aug 7, 2021, 12:47 PM

#

rich widget I think Tabber might be used on a few pages, but I'm personally not a fan of it.

Tabber is used in a limited scope . Mainly by wonderful on Maven's Invitations

#

@crimson gulch Is the site live or not? So that i may need bot account right to test pypoe fork on thing that actually exported before in 3.14 (area, monster, lua)

crimson gulch Aug 7, 2021, 12:49 PM

#

live but not open right now

#

I can open it up though

#

Might be worth waiting until the import is done before you try run pypoe on it though

analog abyss Aug 7, 2021, 12:49 PM

#

And meanwhile reddit has someone asking for funding for yet another fork and claiming they have talked to POB and poedb on exporting data.........just sound too fishy to not done anything and start to ask by funding...

crimson gulch Aug 7, 2021, 12:50 PM

#

I've spoken to the guy, he seems like he has decent intentions but doesn't have any experience with running mediawiki

analog abyss Aug 7, 2021, 12:50 PM

#

crimson gulch Might be worth waiting until the import is done before you try run pypoe on it t...

or my be i can try on a limited scope in the fandom to see it need specification update or not (modifier and gem definitive need update)

#

and the previous fork https://pathofexile.miraheze.org/ now it is rotting....

Main Page

crimson gulch Aug 7, 2021, 12:51 PM

#

The problem is folks are putting up wikis without doing anything about the content

#

also hosting on another wiki farm seems counterintuitive

stone crater Aug 7, 2021, 12:53 PM

#

He sent me a message asking for help with the data mining part

crimson gulch Aug 7, 2021, 12:54 PM

#

@analog abyss I can create an account for you so you can dig about

#

DM me what you want here

#

I'll open up all this stuff as soon as the content's in

#

~208k revisions added 😅

#

The site is here until I bother moving to the proper URL, no rush on that front though https://phpstack-640597-2086210.cloudwaysapps.com/w/index.php?title=Main_Page

molten echo Aug 7, 2021, 12:58 PM

#

I'm curious, how would fandom react if current wiki admins "sabotaged" the wiki to remove all its information and instead point to a non-fandom site?
Obviously the site is community managed so it's not like a fandom admin has any standing to object (and also something like the poe wiki is probably going to be too small to ever concern themselves over).
But I have to imagine they'd object to literally salting the earth to help with SEO.

crimson gulch Aug 7, 2021, 12:58 PM

#

Yeah, that's not an option

#

they'll revert edits and ban users

#

also just a bit too petty

rich widget Aug 7, 2021, 1:35 PM

#

molten echo I'm curious, how would fandom react if current wiki admins "sabotaged" the wiki ...

That's really unprofessional, so I wouldn't do that – not that it hasn't crossed my mind.

lusty hedge Aug 7, 2021, 1:37 PM

#

Are we professional ?

rich widget Aug 7, 2021, 1:37 PM

#

But yeah, no. It wouldn't be impossible to revert, and I don't want to entirely burn all of my bridges with Fandom. A lot of their staff came from Gamepedia, after all.

lusty hedge Aug 7, 2021, 1:38 PM

#

I'm against sabotage and if we can make it without do it, it will be fine

crimson gulch Aug 7, 2021, 1:38 PM

#

Yep, although more and more of those folks are leaving

pure cipher Aug 7, 2021, 1:39 PM

#

Looking forward to having a fourth site in the mix of poedb, fandom wiki, and that bullshit RMT site in my search results in arbitrary order 😄

lusty hedge Aug 7, 2021, 1:39 PM

#

I have a question, because I continue to update the wiki, should I stop ? Or continue and you will merge the data after ?

molten echo Aug 7, 2021, 1:39 PM

#

I don't think professionalism is part of the picture when fandom are forcing extensive negative changes to the experience.
But I agree it is objectionable.
Just that if they're not going to listen to their own communities then abandoning Fandom for better options might force them to reconsider some changes.

crimson gulch Aug 7, 2021, 1:39 PM

#

Ranking a new domain is going to be a shitshow tbh

rich widget Aug 7, 2021, 1:39 PM

#

Wait, what bullshit MTX site?

pure cipher Aug 7, 2021, 1:39 PM

#

Sorry, RMT ^_^

crimson gulch Aug 7, 2021, 1:39 PM

#

Google strongly take registration age of domain into consideration when it comes to ranking

lusty hedge Aug 7, 2021, 1:39 PM

#

It's not that hard to put the website at the first position

crimson gulch Aug 7, 2021, 1:40 PM

#

It is very hard

lusty hedge Aug 7, 2021, 1:40 PM

#

But it's costly

crimson gulch Aug 7, 2021, 1:40 PM

#

The current site has a decade of ranking and history behind it

rich widget Aug 7, 2021, 1:40 PM

#

lusty hedge I have a question, because I continue to update the wiki, should I stop ? Or con...

You can continue to update. We'll worry about merging later.

crimson gulch Aug 7, 2021, 1:41 PM

#

I ran the export yesterday but getting a few days worth of revisions is no big deal

lusty hedge Aug 7, 2021, 1:41 PM

#

You can very fast be the first page, like some have tested it if fake website etc... But it cost around 400 to 2000$

crimson gulch Aug 7, 2021, 1:41 PM

#

I'm not convinced that's true

lusty hedge Aug 7, 2021, 1:41 PM

#

crimson gulch I ran the export yesterday but getting a few days worth of revisions is no big d...

Yes and no, like to add all the prophecies cards, it took me 2h30

lusty hedge Aug 7, 2021, 1:42 PM

#

crimson gulch I'm not convinced that's true

Check on YouTube or Reddit posts talking about

crimson gulch Aug 7, 2021, 1:42 PM

#

But from a script perspective it won't take that long

lusty hedge Aug 7, 2021, 1:42 PM

#

And I'm going to re-enter in my full-stacks dev, so I will ask if you want

crimson gulch Aug 7, 2021, 1:42 PM

#

I've worked with a bunch of SEO professionals over the years and if it only cost a couple k to rank a domain they'd be all over it

#

seeing a page from 0.10.0 is a blast from the past http://phpstack-640597-2086210.cloudwaysapps.com/w/index.php?title=Unique_item

Unique item

A unique item is an item with a specific name, unique artwork, and a predetermined list of modifiers. Unique items have the same implicit modifier as a normal item of the same type.
Unique items are meant to be less powerful overall than high-level rare items, but offer unique gameplay and allow special character builds to be based around them. ...

lusty hedge Aug 7, 2021, 1:43 PM

#

I'm agree with that but I don't think that Fandom is investing in SEO specialy for PoE

#

And if we need to transfert :

Reddit post announcement
Fandom announcement
Discord etc...

#

Players will moves by their own

crimson gulch Aug 7, 2021, 1:45 PM

#

yeah, it'll be a long process either way, and that's assuming folks like vini want to go edit a new wiki in the first place

rich widget Aug 7, 2021, 1:47 PM

#

Yeah, I'm hyped.

crimson gulch Aug 7, 2021, 1:47 PM

#

where's my party parrot gif when I need it

rich widget Aug 7, 2021, 1:48 PM

#

I don't have Nitro, RIP

crimson gulch Aug 7, 2021, 1:48 PM

#

Import is currently running through V's on the standard namespace, all the other namespace up next 😬

#

jesus christ these maintenance scripts are slow

rich widget Aug 7, 2021, 1:53 PM

#

I'm sure most of you have seen this already: https://www.reddit.com/r/pathofexile/comments/ozqy5w/project_poe_wiki_an_effort_to_move_the_wiki_out/

r/pathofexile - Project PoE Wiki - an effort to move the wiki out o...

865 votes and 114 comments so far on Reddit

#

Is JourneyToJah on here?

crimson gulch Aug 7, 2021, 1:54 PM

#

I was DMing him yesterday but doesn't look like he's in this server

rich widget Aug 7, 2021, 1:57 PM

#

I'm just wondering why they didn't try getting in touch with anyone on the current wiki before posting this.

crimson gulch Aug 7, 2021, 1:58 PM

#

I think he reached out to @stone crater but yeah, that'd have been a logical step. I guess community folks want to move the wiki but didn't think to speak to editors about it, they just got stuck in

rich widget Aug 7, 2021, 1:59 PM

#

It's not really a problem. I just think we should coordinate our efforts, rather than setting up competing new wikis.

pure cipher Aug 7, 2021, 2:00 PM

#

It's one of those lovely problems where a lot of souls can try their hand at the first step, yoinking data, while the long-term data ingestion and curation is something else.

#

I would like the bikeshed to be blue, btw 😉

crimson gulch Aug 7, 2021, 2:01 PM

#

Yeah, either way once this import is done it'll be much simpler to do a DB dump than have to run the import scripts again if someone wants the wiki moved to another host

molten echo Aug 7, 2021, 2:01 PM

#

For sure. Maybe I am biased but if iamacyborb is already migrating data than I would say he's ahead of journey's efforts, who sounds like he's waiting to see if he can rely on poedb for datamining and still needs to work out porting that info into his wiki.

pure cipher Aug 7, 2021, 2:02 PM

#

For me, whatever assistance I can render in getting tooling and DAT stuff working I would rather channel it into this existing community, wherever we end up going.

crimson gulch Aug 7, 2021, 2:03 PM

#

Is there anything folks need setup from a bot perspective on the wiki?

rich widget Aug 7, 2021, 2:04 PM

#

I don't think so. Not at the moment. We didn't have any true bots running on the wiki, just individual users' bot accounts.

analog abyss Aug 7, 2021, 2:05 PM

#

grand magnet I suppose the version history is lost, but I don't think it matters much in thos...

page history of legacy mod still useful.

crimson gulch Aug 7, 2021, 2:05 PM

#

I can't believe the Daily Deals page has ~3.6k revisions

analog abyss Aug 7, 2021, 2:07 PM

#

crimson gulch Is there anything folks need setup from a bot perspective on the wiki?

I think as long as the "bot" account edit was marked as "bot" so that some people like to filter it out, it is fine. I guess if using pypoe with wiki write access, rather on how to set up password instead

fandom has 2-step password BTW.

https://community.fandom.com/wiki/Special:BotPasswords

crimson gulch Aug 7, 2021, 2:11 PM

#

Ah interesting, I'll look at how I could replicate that if it's something people want/need

crimson gulch Aug 7, 2021, 2:44 PM

#

All content pages done, looks like user talk is being imported now, still be a while before Modules/Templates and all the rest get done though

crimson gulch Aug 7, 2021, 3:34 PM

#

Is there an edit history for this that I could port to Vector.css? https://pathofexile.fandom.com/wiki/MediaWiki:Hydra.css

Path of Exile Wiki

MediaWiki:Hydra.css

MediaWiki:Hydra.css - Official Path of Exile Wiki

rich widget Aug 7, 2021, 3:36 PM

#

Does the import script not also do deleted pages?

crimson gulch Aug 7, 2021, 3:36 PM

#

I don't think so 😬

rich widget Aug 7, 2021, 3:37 PM

#

Well, I can restore it.

crimson gulch Aug 7, 2021, 3:37 PM

#

I'm just running the latest revisions right now, I'll do the full dump of past revisions later once I can confirm modules and templates are working

rich widget Aug 7, 2021, 3:37 PM

#

Isn't this the stylesheet you want though? https://pathofexile.fandom.com/wiki/MediaWiki:Hydradark.css

Path of Exile Wiki

MediaWiki:Hydradark.css

MediaWiki:Hydradark.css - Official Path of Exile Wiki

crimson gulch Aug 7, 2021, 3:38 PM

#

It is, but Hydra is a proprietary Gamepedia skin

#

so I don't have access to the PHP files for it

#

looks like it's just a forked version of Vector though

rich widget Aug 7, 2021, 3:39 PM

#

Of course. Why didn't I think of that?

crimson gulch Aug 7, 2021, 3:45 PM

#

weird, running into a caching issue that's logging me out when I try access Mediawiki namespaced pages

#

Oh yeah that css is going to take a bit of work http://phpstack-640597-2086210.cloudwaysapps.com/w/index.php?title=List_of_unique_rings

List of unique rings

This is a list of unique rings.

#

Ah, Reddit

analog abyss Aug 7, 2021, 4:25 PM

#

Reddit is full of upvote mob that no idea what they are vpvote. There are lots of reader want to change but not many have experience on editing.

#

It is not the same case as POB that before the fork, people already forking and submit pull request to openarl, which he is so busy and people finally find someone as central depositary

#

The previous wiki fork at least teaching anyone that want to fork, they need to deal with CSS and lua table and everything that is datamine . It needs to have the wiki admin and editor hands dirty on actually editing instead of just talk about ask poedb or what is the domain or don't even start their own wiki articles forking

crimson gulch Aug 7, 2021, 4:31 PM

#

I find it odd they've setup a new Discord rather than reaching out to folks here

pure cipher Aug 7, 2021, 4:32 PM

#

I inquired about that, they don't quite like the drama of this server.

analog abyss Aug 7, 2021, 4:32 PM

#

End up what I feel it just ask for money and the project bust or not is not the real concern

pure cipher Aug 7, 2021, 4:32 PM

#

As for what that might imply, heaven knows. I gave them some tech info on how horrible it is to work with the game data.

crimson gulch Aug 7, 2021, 4:33 PM

#

That's not even talking about getting that data into the wiki then using Cargo to actually do stuff with it

#

or the Module files written in LUA

analog abyss Aug 7, 2021, 4:34 PM

#

What I saw Poe cdn stop to public some game asset as PNG that need zao's exe to export DDS instead. Even poedb has dead link pic due to the cdn.

#

Without hand dirty to know how to actually work . Just good luck on their own project.

pure cipher Aug 7, 2021, 4:34 PM

#

With 3.16, legacy CDN URLs will be fully gone.

#

I quite feel with GGG on that, as it's both a big bandwidth cost of hotlinking and a risk of revealing unfinished content by URL guessing.

crimson gulch Aug 7, 2021, 4:36 PM

#

Yeah, that's fair, but they could find other ways to support community efforts to get these files

analog abyss Aug 7, 2021, 4:36 PM

#

What I done it quite often on editing the scalar value of the cdn kmg

pure cipher Aug 7, 2021, 4:37 PM

#

There was some nice value from the CDN when it came to composing map icons for example, they're all loose glyphs in the data files which you have to tint and composite on the base map icon.

#

Flasks are a big one too.

analog abyss Aug 7, 2021, 4:38 PM

#

crimson gulch Yeah, that's fair, but they could find other ways to support community efforts t...

I think map article the Dev still public the parameters of the new map series. But ggg write it black and white content creator should host the fork IMG themselves. Poedb currently not and I guess it save a lot of space from that

crimson gulch Aug 7, 2021, 4:39 PM

#

weird error

analog abyss Aug 7, 2021, 4:40 PM

#

I think audio file can be replaced. The steam folder has all the latest file in .ogg

crimson gulch Aug 7, 2021, 4:40 PM

#

Now that is an old video

#

worst case scenario I can just disable embedvideo and rerun the import

surreal coyote Aug 7, 2021, 5:22 PM

#

pure cipher I quite feel with GGG on that, as it's both a big bandwidth cost of hotlinking a...

is it really a huge costs with cdns and caching?

crimson gulch Aug 7, 2021, 5:24 PM

#

Ah joy, the sight of Lua errors all over a page http://phpstack-640597-2086210.cloudwaysapps.com/w/index.php?title=Aegis_Aurora

Aegis Aurora

Aegis Aurora is a unique .

#

This required a blank edit to fix on Modifier pages, right?

pure cipher Aug 7, 2021, 5:29 PM

#

surreal coyote is it really a huge costs with cdns and caching?

I assume they jam some good coin into CloudFlare.

#

No idea about the scale of things of course, don’t remember if novynn talked about it anything.

crimson gulch Aug 7, 2021, 5:49 PM

#

@rich widget Any idea where the item table is declared?

rich widget Aug 7, 2021, 6:07 PM

#

Hang on. I'm looking

crimson gulch Aug 7, 2021, 6:07 PM

#

Feel like I'm missing something obvious with having to declare the tables

rich widget Aug 7, 2021, 6:08 PM

#

I think you may have to create the tables...?

#

http://phpstack-640597-2086210.cloudwaysapps.com/w/index.php?title=Special:CargoTables

Index.php

crimson gulch Aug 7, 2021, 6:09 PM

#

Yeah so I've created those

rich widget Aug 7, 2021, 6:09 PM

#

Maybe it's being populated?

crimson gulch Aug 7, 2021, 6:09 PM

#

How many tables do you see on Fandom?

#

Oooh actually, that helps me find the links I need

rich widget Aug 7, 2021, 6:10 PM

#

https://pathofexile.fandom.com/wiki/Special:CargoTables

Special:CargoTables

Cargo tables - Official Path of Exile Wiki

crimson gulch Aug 7, 2021, 6:10 PM

#

just running the rebuild script to see if that fixes anything

#

SMW was definitely less of a faff

rich widget Aug 7, 2021, 6:11 PM

#

http://phpstack-640597-2086210.cloudwaysapps.com/w/index.php?title=Template:Item/cargo/items

Template:Item/cargo/items

This template defines the table "items". This table has not been created yet.

#

It says the table hasn't been created yet

crimson gulch Aug 7, 2021, 6:12 PM

#

Where do you see that?

rich widget Aug 7, 2021, 6:13 PM

#

crimson gulch Aug 7, 2021, 6:13 PM

#

🤦‍♂️

#

What's weird is I was able to create some table but the button isn't showing up to create that particular one

#

And now it's showing

rich widget Aug 7, 2021, 6:17 PM

#

shrugR

grand magnet Aug 7, 2021, 6:53 PM

#

generally I'd say, make sure all tables exist

#

then make sure mods are in the db, then base items, then unique items

#

some data is commited via lua modules, might need to null edit those (can find them via the search)

crimson gulch Aug 7, 2021, 7:02 PM

#

Yeah I've found how to create all the tables now so that's working

#

mods are all in the db but might require null edits

crimson gulch Aug 7, 2021, 7:28 PM

#

Some stuff is working http://phpstack-640597-2086210.cloudwaysapps.com/w/index.php?title=Shrapnel_Ballista

Shrapnel Ballista

Shrapnel BallistaAttack, Projectile, Totem, Physical, BowLevel: (1-20)Cost: (5-11) ManaAttack Speed: 50% of baseAttack Damage: (38-44)% of baseEffectiveness of Added Damage: (38-44)%Summons a ballista totem that fires multiple arrows with extreme force, breaking them apart into shrapnel. Enemies can be hit by multiple arrows from the same attack...

#

Slowly burning through Lua errors

#

Seems like stuff is working, need to run rebuild scripts again

analog abyss Aug 7, 2021, 10:24 PM

#

I hate Sunday and insomnia

And this is brather1ng's fork. Trying to exporting league currency

PyPoE.poe.file.specification.errors.SpecificationError: <ERRORS.RUNTIME_ROWSIZE_MISMATCH: 3002>: "ActiveSkills.dat": Specification row size 124 vs real size 125

Well i guess i need to dig out other people's fork to check what has changed once again....

#

And world (area) export too

PyPoE.poe.file.specification.errors.SpecificationError: <ERRORS.RUNTIME_ROWSIZE_MISMATCH: 3002>: "WorldAreas.dat": Specification row size 480 vs real size 504

While the other team which has reddit admin blessing, well not sure they need get their hand dirty on how datamining work or not......

#

And monster as well

PyPoE.poe.file.specification.errors.SpecificationError: <ERRORS.RUNTIME_ROWSIZE_MISMATCH: 3002>: "MonsterVarieties.dat": Specification row size 445 vs real size 437

crimson gulch Aug 7, 2021, 10:35 PM

#

I’m not quite sure they’ve got Reddit admin blessing quite yet

analog abyss Aug 7, 2021, 10:38 PM

#

they claim to have

#

I am waiting L1mer online and reply me, and if the pypoe is partially fix. It is good to go at least exporting this league basetype and currency as well as some of the monster data. Modifier part i guess it take longer as i have no knowledge on programming itself (well, matlab and R is for engineer and mathematician)

pure cipher Aug 7, 2021, 10:40 PM

#

crimson gulch I’m not quite sure they’ve got Reddit admin blessing quite yet

I would assume that it's derived from that one response they got to the first post.

#

cf. https://www.reddit.com/r/pathofexile/comments/ox4bvj/would_you_contribute_to_moving_the_wiki_out_of/h7omj25/

analog abyss Aug 7, 2021, 10:44 PM

#

I think blvcksvn is not entirely means all the admin or talking about switching the link in reddit into their. blvcksvn has edit in POE wiki (fandom) i guess he is talking about he will not edit fandom and will edit the new forked wiki.

raven bluff Aug 7, 2021, 10:44 PM

#

analog abyss And world (area) export too > PyPoE.poe.file.specification.errors.Specification...

for WorldAreas.dat, add the following fields to the end of the definition:

('HeistChance', Field(
    name='HeistChance',
    type='int',
)),
('RitualChance', Field(
    name='RitualChance',
    type='int',
)),
('Unknown110', Field(
    name='Unknown110',
    type='ref|list|int',
)),
('UltimatumChance', Field(
    name='UltimatumChance',
    type='int',
)),
('ExpeditionChance', Field(
    name='ExpeditionChance',
    type='int',
)),

analog abyss Aug 7, 2021, 10:45 PM

#

It just a matter of who get the fork actually work. Sadly the previous attempt was stuck in cargo table

analog abyss Aug 7, 2021, 10:45 PM

#

raven bluff for WorldAreas.dat, add the following fields to the end of the definition: ``` (...

thx

raven bluff Aug 7, 2021, 10:45 PM

#

should be immediately after the definition for DeliriumChance

analog abyss Aug 7, 2021, 10:47 PM

#

It is way too messy that i have a fork to tune the black list of item export. and then brather1ng's has their own fork. Merging the change by me and then by brather1ng is a nightmare as they were not meant to be the central repository

#

or may be i can submit pull request i guess

analog abyss Aug 7, 2021, 11:17 PM

#

raven bluff for WorldAreas.dat, add the following fields to the end of the definition: ``` (...

still have row size 500 vs real size 504

#

may be due to once again i have 3.15.1 ggpk and they change something midleague?

raven bluff Aug 7, 2021, 11:17 PM

#

analog abyss still have row size 500 vs real size 504

did you already have DeliriumChance above HeistChance? if not, add that too

analog abyss Aug 7, 2021, 11:18 PM

#

omegk2 version already have that. omegk2 stop at HeistChance. Unless there is something add before instead

raven bluff Aug 7, 2021, 11:19 PM

#

oh, right

analog abyss Aug 7, 2021, 11:19 PM

#

https://github.com/OmegaK2/PyPoE/blob/dev/PyPoE/poe/file/specification/data/stable.py

raven bluff Aug 7, 2021, 11:20 PM

#

go back up to Unknown32 (near the top of WorldAreas) and change its type from int to ulong

#

I forgot that changed too

analog abyss Aug 7, 2021, 11:21 PM

#

I have to view brather1ng and L1mer's fork to try to deduce what has changed . managing the version now really really messy

#

And i guess instead of "Unknown32", which have 5 in the same file, the naming of unknown may need cleanup to be more specific

raven bluff Aug 7, 2021, 11:25 PM

#

the numbering of unknown fields is always sequential within that single data file, sometimes there's gaps when the purpose of a field is discovered

analog abyss Aug 7, 2021, 11:25 PM

#

well, it works. I guess i need to take a break to deduce the change of the rest (monster , etc ) to make some of the function of pypoe back to functional

#

I mean may be i would name it as "AreaUnknown32" to be better searched and distinguish with the unknown from other game files

pure cipher Aug 7, 2021, 11:39 PM

#

Largest I have is 496, but not sure how late in the league that is.

#

My data ingest is still partial.

raven bluff Aug 7, 2021, 11:49 PM

#

pure cipher Largest I have is 496, but not sure how late in the league that is.

WorldAreas.dat? 3.15.0 was 504 bytes/row, and still is

pure cipher Aug 7, 2021, 11:51 PM

#

Yeah, just behind.

#

Tooling effort spread so thin 😄

analog abyss Aug 8, 2021, 12:00 AM

#

well that part is only a portion of specification that need to fix and brather1ng has done the part that they are using for repoe. And i still need to fix active skill gem, monster and a lot more for pypoe as the wiki exporting script

#

and i guess may be better based on brather1ng 's fork instead of have multiple version of fork which all have some changes that i need to catch up from Jan 2021

analog abyss Aug 8, 2021, 3:06 AM

#

#

Start to have even more drama on not asking what pypoe even is or try to use it on 314 ggpk or whatever and decide that start from guessing the file specification I guess (or setup a scrapper to copy value from poedb?)

lusty hedge Aug 8, 2021, 6:34 AM

#

People always want to complain against things because they want to be a part of something. Like for the wiki transition, I've seen on the Reddit post that people has the same complain as him. "why now ? They could do it since 3.9...".. Whatever just don't look at them, and continue what you are doing

crimson gulch Aug 8, 2021, 6:42 AM

#

analog abyss

Where was that even posted?

stone crater Aug 8, 2021, 6:45 AM

#

in their discord I think

crimson gulch Aug 8, 2021, 7:07 AM

#

https://www.poewiki.net/wiki/Path_of_Exile_Wiki

Path of Exile Wiki

#

Looks like null edits are starting to fix stuff

rich widget Aug 8, 2021, 7:35 AM

#

Just comparing the page load stats to the Fandom wiki...

crimson gulch Aug 8, 2021, 7:35 AM

#

It'll be slow right now, I turned off the Varnish cache while I work on stuff

#

Also probably missing a lot of cache optimisation

rich widget Aug 8, 2021, 7:36 AM

#

It's still way faster though lol

crimson gulch Aug 8, 2021, 7:36 AM

#

the magic of not running a million tracking scripts 😬

rich widget Aug 8, 2021, 7:37 AM

#

Even with an ad blocker, the main page on fandom loaded 6.03MB of data and took over 20 seconds to do so. Plus it keeps trying to load shit in the background.

crimson gulch Aug 8, 2021, 7:38 AM

#

#

https://pagexray.fouanalytics.com/q/pathofexile.fandom.com%2Fwiki%2FPath_of_Exile_Wiki?f=

#

#

Need to check what that fandom request is, probably an image

rich widget Aug 8, 2021, 7:39 AM

#

Yeah, I was wondering about that.

#

It's probably the stylesheet using images from the fandom domain.

crimson gulch Aug 8, 2021, 7:39 AM

#

oooh yeah

#

That Fandom one is wild though, ~400 trackers

rich widget Aug 8, 2021, 7:40 AM

#

Yeah, that's mental...

crimson gulch Aug 8, 2021, 7:41 AM

#

Dude who built that tool is rad he's an ad fraud researcher

#

I did a podcast with him https://www.mql.fm/002-60-million-60-billion-ad-fraud-question-augustine-fou

MQL.fm Marketing Operations with Jacques Corby-Tuech

$60 Million or $60 Billion, the Ad Fraud Question

In this episode I’m joined by Dr Augustine Fou, an experienced marketer and ad fraud researcher.

rich widget Aug 8, 2021, 7:42 AM

#

Oh, you mean the tool for graphing the resources?

crimson gulch Aug 8, 2021, 7:42 AM

#

yeah

rich widget Aug 8, 2021, 7:42 AM

#

cool

rich widget Aug 8, 2021, 8:21 AM

#

We may need the Variables extension. https://www.mediawiki.org/wiki/Extension:Variables

Extension:Variables

The Variables extension allows you to define a variable on a page, use it later in that same page or included templates, change its value, possibly to a value given by an expression in terms of the old value, etc.
It is much like a template, only very lightweight and scoped to only a single page, so you can use many variables on a page without s...

crimson gulch Aug 8, 2021, 8:29 AM

#

Thanks! Will add

#

Done

analog abyss Aug 8, 2021, 9:02 AM

#

lusty hedge People always want to complain against things because they want to be a part of ...

I really don't worry myself as editing has teach me how to fix the cargo query code (or somewhat). Or at least have some time on using pypoe . I never worry myself on assuming i know everything. Problem need to be solved by people, but the shortcut always observed other people work and deduce the solution to my own problem. Or just humble to ask and networking

crimson gulch Aug 8, 2021, 11:04 AM

#

Going through and creating all the remaining Cargo tables now

#

Is anyone able to help with null edits of pages?

crimson gulch Aug 8, 2021, 11:31 AM

#

Script error: The function "store_data" does not exist.

🤔

#

I think all tables have now been created

#

so need null edits to populate everything, it doesn't look like the MW rebuild script helps on that front

#

Okay so just missing _pageData and area_spawn_weight_overrides neither of which appear to be defined anywhere which maybe means they were defined in an old revision

#

strange error 🤔

#

Wiped the dupe table in the DB but that's obviously not a good fix 😂 https://www.poewiki.net/wiki/Stiletto

Stiletto

StilettoDaggerPhysical Damage: 7-27Critical Strike Chance: 6.10%Attacks per Second: 1.50Weapon Range: 10Requires Level 15, 30 Dex, 30 Int30% increased Global Critical Strike ChanceAcquisitionArea level: 15Vendor PricesVendor Offer1x Scroll FragmentWeapon DPSPhysical: 25.5Phys+Chaos: 25.5Total: 25.5MetadataItem class: DaggersMetadata ID: Metadata...

#

All Modifiers created and deduped for this, now getting this error

crimson gulch Aug 8, 2021, 12:34 PM

#

Genuinely surprising

#

LOL, this is getting way better lighthouse scores than the WordPress site we have at work

lusty hedge Aug 8, 2021, 12:57 PM

#

Keep going, you are doing a good job, I can't wait to edit the wiki !

crimson gulch Aug 8, 2021, 12:57 PM

#

It's available to edit now!

#

I was just setting up caching and stuff but it's all good to go

lusty hedge Aug 8, 2021, 12:57 PM

#

Nice, does the leaderboard is still here ?

crimson gulch Aug 8, 2021, 12:58 PM

#

Don't think so

#

but I guess I can add that in

lusty hedge Aug 8, 2021, 12:59 PM

#

Because with the system of points, badges, leaderboard, it help people to have some result with what they are doing so it will encourage them indirectly

crimson gulch Aug 8, 2021, 12:59 PM

#

Yeah that makes sense

delicate sorrel Aug 8, 2021, 12:59 PM

#

Hey guys, just to clarify - i'll contribute personally to the new wiki, but we would need to see some progress before we can endorse it in an official capacity on the sub

crimson gulch Aug 8, 2021, 12:59 PM

#

What sort of progress are you looking for?

delicate sorrel Aug 8, 2021, 1:01 PM

#

I dont think i can give you a benchmark at the moment but we'll be keeping an eye out

crimson gulch Aug 8, 2021, 1:01 PM

#

Fair enough!

delicate sorrel Aug 8, 2021, 1:04 PM

#

Outta curiosity does the wiki still use the old wikis edit styles and stuff?

crimson gulch Aug 8, 2021, 1:04 PM

#

What do you mean by edit styles?

delicate sorrel Aug 8, 2021, 1:04 PM

#

Like the editing ui and the way the metadata tags are set up and stuff

lusty hedge Aug 8, 2021, 1:04 PM

#

I think like time, if the wiki is edited continually it will help for sure, because I care about the "hype" of the transition. A lot of contribution will be needed and in long term

crimson gulch Aug 8, 2021, 1:05 PM

#

delicate sorrel Like the editing ui and the way the metadata tags are set up and stuff

Yeah it should all be the same as the old one

#

I have the Visual Editor installed right now but not 100% sure that's a good idea tbh

delicate sorrel Aug 8, 2021, 1:05 PM

#

Gotcha. It would be great to have some user manuals since that stuff can get annoying

#

I think source editor is way better

lusty hedge Aug 8, 2021, 1:06 PM

#

Yes I was thinking about it

crimson gulch Aug 8, 2021, 1:06 PM

#

Yeah that's a good idea

#

Visual Editor is also just slow as hell

delicate sorrel Aug 8, 2021, 1:06 PM

#

But like even the drop locations for div cards and stuff

#

Its almost impossible to edit them

lusty hedge Aug 8, 2021, 1:06 PM

#

Almost because don't have the knowledge for this or like it's really impossible ?

crimson gulch Aug 8, 2021, 1:07 PM

#

Ah, stuff like that is genuinely more complex because it's handled through transclusion of other pages

delicate sorrel Aug 8, 2021, 1:07 PM

#

There's very few userguides on how to edit those linked data sets which is quite limiting

lusty hedge Aug 8, 2021, 1:08 PM

#

Gem levels too, not for now because it's not a priority in time, but the template of page will need to be reworked

crimson gulch Aug 8, 2021, 1:08 PM

#

A lot of this stuff is hidden in Template: documentation but it makes sense to make that stuff more easily accessible

#

Not that I think that people should have to read tons of docs before they can do anything though, that's counterproductive

lusty hedge Aug 8, 2021, 1:09 PM

#

We've talked about it with Liu because when you want to edit a page, you have the whole gem level at the start

#

I'm agree with that

delicate sorrel Aug 8, 2021, 1:09 PM

#

Yeah just something to keep in mind

#

Most people get turned off from contributing due to having to learn the systems

lusty hedge Aug 8, 2021, 1:09 PM

#

Maybe with commentaries ? In the code source of the page ?

crimson gulch Aug 8, 2021, 1:10 PM

#

There are definitely ways to help there

#

but also from a data PoV you need to balance ease of editing with ease of accurate data through imports

#

which is a fine-line to walk

delicate sorrel Aug 8, 2021, 1:10 PM

#

Plus.. "putrid clositer" as the div card location is kinda sus

#

Haha

#

Thw joys of automation

crimson gulch Aug 8, 2021, 1:11 PM

#

with the transclusion system and Cargo the benefit is a single page gets edited and that propegates through the entire site

molten echo Aug 8, 2021, 1:11 PM

#

Most people get turned off from contributing due to having to learn the systems
I don't think there's any way around that. If it's just information (like skill/unique interactions) or even formulas, a low end user can handle that easily, but I think only experts would be able to produce or tweak templates.

#

Or anything that relies on bots/datamined information

delicate sorrel Aug 8, 2021, 1:12 PM

#

Even just a guide on how to edit the template would be great for more dedicated users

lusty hedge Aug 8, 2021, 1:12 PM

#

And "it's not fun" to edit the wiki, like it took me 2h30 hours to add all the div cards from 3.15

crimson gulch Aug 8, 2021, 1:12 PM

#

Yeah, I think bots will remain necessary unless GGG can help provide data but that seems incredibly unlikely

lusty hedge Aug 8, 2021, 1:13 PM

#

GGG will never do that

#

Because they are nostalgic, I encourage you to look upper, when we've talked about it

delicate sorrel Aug 8, 2021, 1:14 PM

#

Anyway i gotta go for now but yeah let's discuss again later how to improve accessibility

#

Otherwise i fear the wiki might stagnate again

#

The fandom ad machine was only part of the issue

lusty hedge Aug 8, 2021, 1:14 PM

#

Yep, I'm afraid of the hype too

crimson gulch Aug 8, 2021, 1:15 PM

#

Yeah for sure!

#

I'll be here and listening if you @ me

lusty hedge Aug 8, 2021, 1:27 PM

#

For things like {{il|X}} we just need to wait that you fix cargo data problems ?

crimson gulch Aug 8, 2021, 1:28 PM

#

Got a link to a page where you're seeing that?

#

Could be Cargo or a missing extension

lusty hedge Aug 8, 2021, 1:28 PM

#

https://www.poewiki.net/wiki/Astral_Projector

Astral Projector

Astral Projector is a unique .

#

Or here, it didn't find any of the attack skill : https://www.poewiki.net/wiki/Attack

Attack

Attack is one of four damage sources, which deals damage to targets based on the damage values from weapons or unarmed. It can also be based on the defensive values from shields like with or . Skills that deal attack damage have the Attack gem tag.

crimson gulch Aug 8, 2021, 1:29 PM

#

Yeah pages need to be null edited so the Cargo DB can be updated

lusty hedge Aug 8, 2021, 1:29 PM

#

so like just reload the page with a blank edit ?

crimson gulch Aug 8, 2021, 1:29 PM

#

Until the Cargo DB is populated these errors will occur but I'm not sure how to resolve that short of null editing the entire site

#

Yep

#

I need to learn how to setup a basic wiki bot, been a while since I had to do that

lusty hedge Aug 8, 2021, 1:30 PM

#

Purge Cache is for that no ?

#

Oh it doesn't work x)

crimson gulch Aug 8, 2021, 1:30 PM

#

No, need to do a blank edit

#

it's dumb

#

The maintenance script to purge all pages also doesn't do it

lusty hedge Aug 8, 2021, 1:31 PM

#

ah

#

didn't work

crimson gulch Aug 8, 2021, 1:32 PM

#

Yeah need to do it to the pages it's trying to find 🙃

lusty hedge Aug 8, 2021, 1:33 PM

#

aaaaaaah

crimson gulch Aug 8, 2021, 1:34 PM

#

Seeing if this will help

lusty hedge Aug 8, 2021, 1:37 PM

#

Oooh I've understood, like if for exemple a page (page1) is using the data for "Spell Cascade Support", you need to blank edit the page of "Spell Cascade Support" and then blank edit page 1

#

#

But there is only 1 page

crimson gulch Aug 8, 2021, 1:40 PM

#

Yeah that's another issue

#

Try now!

#

Data is getting saved twice in Cargo tables for some reason

lusty hedge Aug 8, 2021, 1:42 PM

#

still got an error

#

Working now!

crimson gulch Aug 8, 2021, 1:43 PM

#

purged the cache, works now

lusty hedge Aug 8, 2021, 1:43 PM

#

and can we purge the cache ? the button seems to not working

crimson gulch Aug 8, 2021, 1:43 PM

#

You can but maybe the caching I've put in is a bit agressive

#

it works for me but takes a few seconds

lusty hedge Aug 8, 2021, 1:44 PM

#

okay

#

#

same, aaah if it's doing it each time, i will always need you xD

#

Yap it's doing it for all the different rings

#

It's normal that we don't have the access to import page like : https://www.poewiki.net/wiki/File:Inpirational_(Champion)_passive_skill_icon.png ?

File:Inpirational (Champion) passive skill icon.png

#

be careful, page like that, will disconnect you, i dont knowwhy

#

Yes, every time I reload a page by blank editing, Cargo seems to readding the data, :

crimson gulch Aug 8, 2021, 2:45 PM

#

Disconnect you?

lusty hedge Aug 8, 2021, 2:46 PM

#

Yea, if try to logging with this page, it will disconnect you

crimson gulch Aug 8, 2021, 2:47 PM

#

Weird, will take a look when I get back home

lusty hedge Aug 8, 2021, 2:48 PM

#

okay!

twin gale Aug 8, 2021, 3:01 PM

#

I've gone down the templates and cargo route on a corp wiki before, imo you want to make 2 sites, one with all the datamined / extracted / databased info in the best possible way. And a wiki for human notes as readable as possible, with some pulls in the wiki on the other to display some convenient info. Maybe even ditch wiki completely and just do a static site generator with a "edit this page" ala github backed docs using a WYSIWYG.

#

but in the end people will complain the wiki is wrong, but not fix it even if they know the answer, it is incredibly hard to promote the shared ownership shared caretaking feeling, not even talking about how such a community invariably starts setting up standards that raise the barrier to entry / mods undoing edits discouraging newcomers (no matter if it was warranted or not) etc

#

that's my 2c anyways

crimson gulch Aug 8, 2021, 3:04 PM

#

That Reddit thread is going as well as I was expecting 😬

grand magnet Aug 8, 2021, 3:04 PM

#

poe reddit is a shithole

#

I honestly wouldn't expect anyone from there to seriously help with anything

twin gale Aug 8, 2021, 3:05 PM

#

having admined a mediawiki for a decade and a half I would never use it again if I had to start over. would use something much simpler and straightforward

#

the power just isn't worth it imo

grand magnet Aug 8, 2021, 3:08 PM

#

crimson gulch I need to learn how to setup a basic wiki bot, been a while since I had to do th...

as far wiki bots are concerned, I'd recommend mwclient library in python. It's not strictly a bot, but very very easy to program a bot to do what you want

#

to give a concrete example of null-editingthings

#

import mwclient
site = mwclient.Site('www.poewiki.net')
site.login('YourUserName', 'YourPassWord')
for page in site.categories['Mods']:
    page.save(page.text())```

analog abyss Aug 8, 2021, 3:15 PM

#

the duplicated entry has happened before in fandom verskon

grand magnet Aug 8, 2021, 3:17 PM

#

it can happen afaik if the wiki itself goes through pages and updates them, causing to add duplicate data if they are already in the db

analog abyss Aug 8, 2021, 3:21 PM

#

https://pathofexile.fandom.com/wiki/User:OmegaK2/cargo

currently gone in fandom version. but map article often has this problem.

but passive skill need pypoe export anyway, last time i only done to rowid 1500 ish and some ascendency was skipped . i will have a look for the notable and basic passive ,it need spec update or not

Path of Exile Wiki

Cargo

User:OmegaK2/cargo - Official Path of Exile Wiki

crimson gulch Aug 8, 2021, 3:57 PM

#

grand magnet as far wiki bots are concerned, I'd recommend mwclient library in python. It's n...

Thanks! Will have a dig into that

crimson gulch Aug 8, 2021, 4:02 PM

#

lusty hedge Yap it's doing it for all the different rings

dupes deleted

crimson gulch Aug 8, 2021, 4:29 PM

#

Any idea what's causing this expand/collapse functionality on certain templates?

#

Makes the page look crappy by default

#

Looks like stuff is starting to propagate through

crimson gulch Aug 8, 2021, 4:56 PM

#

lusty hedge Yea, if try to logging with this page, it will disconnect you

That's fucking bizarre

crimson gulch Aug 8, 2021, 5:13 PM

#

Seems to be something related to the Varnish setup

crimson gulch Aug 8, 2021, 5:59 PM

#

Looks like this is finally running through

grand magnet Aug 8, 2021, 6:14 PM

#

did they really delete your thread or was it just auto hidden due to reportsß

#

?

crimson gulch Aug 8, 2021, 6:14 PM

#

dunno, I've sent mods a DM but no response yet

#

looks like it's back, weird. Probably got reported into oblivion

grand magnet Aug 8, 2021, 6:27 PM

#

yeah I'm guessing autohidden

crimson gulch Aug 8, 2021, 6:32 PM

#

s'all good though

#

I always forget how much of a pain in the arse setting up email is for new websites

crimson gulch Aug 8, 2021, 6:51 PM

#

I'm impressed, already got the first spam bot

#

I'm petty but that delete reason seemed appropriate

lusty hedge Aug 8, 2021, 7:23 PM

#

x)

crimson gulch Aug 8, 2021, 7:43 PM

#

Looks like the Cargo table rebuild I’m running is slooooowwwwlllllyyy fixing the lua errors across the site, it’ll take a while though

#

You can follow progress here https://www.poewiki.net/wiki/Special:CargoTables

Special:CargoTables

#

Skills are starting to populate now https://www.poewiki.net/wiki/Ancestral_Warchief

crimson gulch Aug 8, 2021, 9:02 PM

#

Very glad that means null edits across the board won't be required

rich widget Aug 8, 2021, 11:17 PM

#

https://www.reddit.com/r/pathofexile/comments/p0gt70/the_fifth_new_poe_wiki_poedb_wiki_mode/

#

Well there you go, reddit. Edit to your heart's content.

rich widget Aug 8, 2021, 11:47 PM

#

crimson gulch Any idea what's causing this expand/collapse functionality on certain templates?

That's a javascript, my dude. Is it causing issues?

crimson gulch Aug 9, 2021, 6:03 AM

#

rich widget That's a javascript, my dude. Is it causing issues?

No issues, it’s just ugly 😅

#

Vini, giving you admin user rights in the new site if that’s okay?

rich widget Aug 9, 2021, 6:51 AM

#

Yes. Thanks

crimson gulch Aug 9, 2021, 6:56 AM

#

I’m going to have to turn on email validation for new users to try limit the spam bots

rich widget Aug 9, 2021, 6:56 AM

#

Yes please

#

I saw all of the bots there

#

Email validation isn't too much of a hurdle. For ordinary users to deal with, I mean.

raven bluff Aug 9, 2021, 7:00 AM

#

You will probably need something stronger than email validation, but at least it's a start.

crimson gulch Aug 9, 2021, 7:01 AM

#

Yeah for sure

#

I’m out getting tattooed today but will make sure that’s done by the end of the day

#

I’ll keep an eye on recent changes and block/delete when I see spam though

raven bluff Aug 9, 2021, 7:07 AM

#

You'll probably want to set up one of the third-party CAPTCHA plugins (like reCaptcha or hCaptcha) as well. You'll still get some spambots even with that; one reasonable defensive measure may be to lock down external links and require all domains to be approved

#

There's a pretty short list of sites I can imagine it making sense to link to -- official site, reddit, poedb, github, a couple dozen well-known tools

crimson gulch Aug 9, 2021, 7:10 AM

#

Yeah I'm looking at hcaptcha now

rich widget Aug 9, 2021, 7:10 AM

#

wikipedia, fandom (lel), ...

crimson gulch Aug 9, 2021, 7:10 AM

#

Trying to avoid the big G for service 😅

#

Fandom are getting a single disclaimer link in an about page and that's it

#

Added

#

If you previously created an account you might need to confirm your email

#

from here https://www.poewiki.net/wiki/Special:Preferences

Special:Preferences

lusty hedge Aug 9, 2021, 7:25 AM

#

Single question but where and how passwords / emails are stocked ?

crimson gulch Aug 9, 2021, 7:25 AM

#

Emails and pw's are stored in the MW database

#

Let me find out how pw's are stored

#

but use a password manager

lusty hedge Aug 9, 2021, 7:26 AM

#

yes but they are encrypted ?

crimson gulch Aug 9, 2021, 7:26 AM

#

yeah

#

Old topic but relevant https://webmasters.stackexchange.com/questions/74014/how-does-mediawiki-save-the-passwords

Webmasters Stack Exchange

How does mediawiki save the passwords?

I have mediawiki installed in my local machine. I had to use a form outside wiki which asks the user to upload files with the wiki username and password. In order to achieve this I went through the

lusty hedge Aug 9, 2021, 7:27 AM

#

Okay, I willl look at it

crimson gulch Aug 9, 2021, 7:28 AM

#

https://www.mediawiki.org/wiki/Manual:User_table

Manual:User table

The user table is where MediaWiki stores information about users.
If using Postgres, this table is named mwuser.

#

Check the user_password section there

rich widget Aug 9, 2021, 7:41 AM

#

Normally passwords are hashed. I expect MW is no different.

rich widget Aug 9, 2021, 7:43 AM

#

lusty hedge yes but they are encrypted ?

I believe they are hashed, not encrypted. Storing encrypted passwords in a database really isn't that secure.

#

So in other words, the DB doesn't know what anyone's passwords are. The only thing it knows are the hashed passwords. When you log in, the website applies the hashing algorithm to the password you enter in the login form and if it matches the hashed password stored in the DB, then it says, "Okay, you must have entered the correct password."

crimson gulch Aug 9, 2021, 7:59 AM

#

I'm not 100% sure but I think we'll need cargo:attach templates for all the cargo tables for the Cargo maintenance script to work

rich widget Aug 9, 2021, 8:51 AM

#

Yes. They don't all have attach templates.

#

I'm not sure what the Cargo maintenance script is though, exactly

crimson gulch Aug 9, 2021, 9:00 AM

#

It’s a script to rebuild Cargo tables, basically avoids the null edit step if there’s an attach template

rich widget Aug 9, 2021, 9:02 AM

#

Okay, yeah. I thought that was what you were talking about. It requires the table to have an attach template. My understanding of the way it works is that the attach template is transcluded on each page that stores data to the table. Then the rebuild script uses "What links here" of the attach template to find the right pages.

crimson gulch Aug 9, 2021, 9:07 AM

#

Ah I see

rich widget Aug 9, 2021, 9:10 AM

#

Which table(s) need to be rebuilt?

crimson gulch Aug 9, 2021, 9:11 AM

#

Basically all of them that don’t have an associated attach

rich widget Aug 9, 2021, 9:12 AM

#

I'm looking at the list of tables now. The areas table, for example, doesn't have an attach template. It also currently has 0 rows.

#

Could we run a script to null edit each of the area pages? Wouldn't that effectively build the table?

crimson gulch Aug 9, 2021, 9:48 AM

#

We’d need a bot for that, but yeah

rich widget Aug 9, 2021, 9:49 AM

#

It can be done with AutoWikiBrowser

crimson gulch Aug 9, 2021, 10:20 AM

#

Will have a dig when I’m home

#

Currently getting my thigh tattooed 🙃

#

Just need to be careful with the null edit route as it was generating dupes in Cargo

analog abyss Aug 9, 2021, 10:51 AM

#

Well, time to create an account and testing pypoe after repoe creater say they fixed some part of spec

crimson gulch Aug 9, 2021, 11:08 AM

#

👀👀👀

analog abyss Aug 9, 2021, 11:31 AM

#

any offline dds to png tool recommendation?

#

First "article" done

https://www.poewiki.net/wiki/Necrolord_Boots

Necrolord Boots

Necrolord BootsBoots SkinChanges the appearance of any equipped boots to the Necrolord Boots.156x156pxMetadataItem class: MicrotransactionsMetadata ID: Metadata/Items/MicrotransactionItemEffects/MicrotransactionNecrolordBoots
Necrolord Boots is a boots skin microtransaction. It can be purchased from the shop for 70 points.
The item is part of Ne...

pure cipher Aug 9, 2021, 11:33 AM

#

analog abyss any offline dds to png tool recommendation?

Worst case, ImageMagick's convert probably can do it.

analog abyss Aug 9, 2021, 11:38 AM

#

Well the wiki keep on asking me to login when i try to upload the file for the Necrolord Boots

I guess 4G wireless intenert problem?

pure cipher Aug 9, 2021, 11:38 AM

#

If you want to do it more interactively in a graphic manner, I use xnviewmp to look at thumbnails and do bulk conversions.

analog abyss Aug 9, 2021, 11:42 AM

#

Well, i uses xnviev free version before. I will have a look but for now i just export img one by one

#

@rich widget Just exported the Iron Flask using pypoe fork, i guess it miss the tag in module

https://www.poewiki.net/wiki/Iron_Flask

Iron Flask

crimson gulch Aug 9, 2021, 12:12 PM

#

analog abyss Well the wiki keep on asking me to login when i try to upload the file for the N...

I think it’s a cache issue with pages ending in image file extensions

#

Will look when I’m home

#

Currently enjoying this 🙃

analog abyss Aug 9, 2021, 12:42 PM

#

@rich widget and need to add Expedition to the list of leagues allowed for the drop_leagues parameter

pure cipher Aug 9, 2021, 12:44 PM

#

crimson gulch Currently enjoying this 🙃

visual representation of the wiki structure

rich widget Aug 9, 2021, 1:39 PM

#

analog abyss <@!187743310574518272> and need to add Expedition to the list of leagues allowed...

Done

analog abyss Aug 9, 2021, 1:46 PM

#

is the implict_text transposed to the unique went wrong?

I have 4 lines of Restores Ward on use, but rest seems fine

https://www.poewiki.net/wiki/Elixir_of_the_Unbroken_Circle
https://www.poewiki.net/wiki/Vorana's_Preparation

rich widget Aug 9, 2021, 1:47 PM

#

wtf?

#

It looks like the cargo tables went screwy. They probably need to be rebuilt.

crimson gulch Aug 9, 2021, 1:56 PM

#

I wonder if it duped somehow

rich widget Aug 9, 2021, 2:03 PM

#

This is remarkably common for Cargo

#

Things just dupe sometimes, for no reason

crimson gulch Aug 9, 2021, 2:14 PM

#

🙃

#

Probably not worth thinking about moving back to SMW, right?

rich widget Aug 9, 2021, 2:15 PM

#

No. God no

analog abyss Aug 9, 2021, 2:26 PM

#

BTW is @honest topaz interested in moving too ? But it would be another project for exporting version history. If not, i wonder the zh: (which basically nonone but me used )de: fr: ru: interwiki link need to be discuss their fate

#

I don't have any interest to export zh wiki as there is not much real stuff to be export and i won't have time to write it one by one (and i guess Mainland China has its own POE wiki already)

rich widget Aug 9, 2021, 2:37 PM

#

I didn't forget about the RU wiki, but there's so many issues to discuss. I'm sort of avoiding heaping everything on all at once. Maybe Ruba can continue to hang out on Fandom until we get things figured out.

#

The split with Fandom does unfortunately mean that the interwikis no longer work though.

crimson gulch Aug 9, 2021, 2:44 PM

#

I could import them if they’re wanted

rich widget Aug 9, 2021, 3:14 PM

#

@crimson gulch How do I get AutoWikiBrowser to work?

#

I get this when trying to connect.

crimson gulch Aug 9, 2021, 3:33 PM

#

It should be poewiki.net/w

#

That’s where the index.php file is

#

rich widget Aug 9, 2021, 3:36 PM

#

Okay, we're getting somewhere. What does this mean? I get this when trying to log in.

crimson gulch Aug 9, 2021, 3:43 PM

#

That’s weird

#

Just googling to see what I can find

#

Can you try ticking the https option if not done already?

#

https://phabricator.wikimedia.org/T210916#4791130

rich widget Aug 9, 2021, 3:55 PM

#

Already set

crimson gulch Aug 9, 2021, 4:01 PM

#

Weird

#

I wonder if I’ve set something in the settings file to block it

#

Or maybe a user permission thing?

rich widget Aug 9, 2021, 4:08 PM

#

Are you using something called "autoproxyblock"?

#

@crimson gulch How do you check user groups?

crimson gulch Aug 9, 2021, 4:39 PM

#

https://www.poewiki.net/wiki/Special:ListGroupRights

Special:ListGroupRights

rich widget Aug 9, 2021, 4:39 PM

#

Fucking hell. I figured it out. It needed www.

crimson gulch Aug 9, 2021, 4:40 PM

#

🙃

rich widget Aug 9, 2021, 4:41 PM

#

The thing is that it let me connect without it, but showed that error when I tried to log in.

#

ImmortalCallSkill

crimson gulch Aug 9, 2021, 5:04 PM

#

I’m finally heading home, will be able to fix shit in 90 mins or so

analog abyss Aug 9, 2021, 5:08 PM

#

an it is late night for me. May be tomorrow i would check the pypoe again on how much function left from the fork

crimson gulch Aug 9, 2021, 5:10 PM

#

Sounds good! Anything you need me to look at?

#

Other than fixing the cache issue on File pages

rich widget Aug 9, 2021, 5:30 PM

#

@crimson gulch I believe you need to create the namespaces that are missing.

#

https://www.poewiki.net/wiki/Area:1~1~town This should be in the Area namespace, but it appears to actually be in the main namespace

Area:1~1~town

#

Create these namespaces, please. Try to keep the ids the same, if you can.

grand magnet Aug 9, 2021, 6:14 PM

#

That's pretty bad actually, you'd need to kill all pages before creating the name spaces

#

I believe it goes nuts if you do the name space after the fact and gets confused

crimson gulch Aug 9, 2021, 6:16 PM

#

Shit, I wonder if the import got fucked up because the namespaces didn't already exist

#

Ok, looks like I can assign the name space to a given ID

#

Need to test though

crimson gulch Aug 9, 2021, 6:26 PM

#

rich widget Create these namespaces, please. Try to keep the ids the same, if you can.

Where did you see the id numbers? Trying to check the ones I've created are correct

crimson gulch Aug 9, 2021, 6:29 PM

#

grand magnet I believe it goes nuts if you do the name space after the fact and gets confused

Looks like there's a script for it https://www.mediawiki.org/wiki/Manual:NamespaceDupes.php

Manual:NamespaceDupes.php

namespaceDupes.php is a maintenance script located in the maintenance directory that can be used to clean up inaccessible titles after adding a namespace (or interwiki prefix).

rich widget Aug 9, 2021, 6:36 PM

#

https://www.poewiki.net/wiki/Special:AllPages

Special:AllPages

crimson gulch Aug 9, 2021, 6:37 PM

#

<option value='10000'>Buff</option><option value='10001'>Buff talk</option>

#

That worked

rich widget Aug 9, 2021, 6:37 PM

#

Yeah. It's correct

crimson gulch Aug 9, 2021, 6:37 PM

#

Just creating the rest then running the script

#

Created

<option value='2300'>Gadget</option><option value='2301'>Gadget talk</option><option value='2302'>Gadget definition</option><option value='2303'>Gadget definition talk</option><option value='10000'>Buff</option><option value='10001'>Buff talk</option><option value='10002'>Passive Skill</option><option value='10003'>Passive Skill talk</option><option value='10004'>Modifier</option><option value='10005'>Modifier talk</option><option value='10006'>Monster</option><option value='10007'>Monster talk</option><option value='10008'>Stat</option><option value='10009'>Stat talk</option><option value='10010'>Skill</option><option value='10011'>Skill talk</option><option value='10012'>Area</option><option value='10013'>Area talk</option><option value='10014'>Guide</option><option value='10015'>Guide talk</option>

#

#

Starting to come through

#

Done

#

That number looks wrong with Modifiers though 🤔

#

This looks correct now though https://www.poewiki.net/wiki/Area:1~1~town

Area:1~1~town

#

Okay no, looks good https://www.poewiki.net/wiki/Special:AllPages?from=&to=&namespace=10004

Special:AllPages

#

We now have 6 lines 🙃

rich widget Aug 9, 2021, 6:58 PM

#

yay

crimson gulch Aug 9, 2021, 7:03 PM

#

Just deleted the dupe in the DB, now only shows Restores Ward on use x 3

rich widget Aug 9, 2021, 7:06 PM

#

How do you delete?

crimson gulch Aug 9, 2021, 7:06 PM

#

I'm literally having to delete manually in the DB right now

#

which is not the right way but it's best I can do until I have a fix for CARGO DUPING STUFF

#

minus caps

rich widget Aug 9, 2021, 7:08 PM

#

The table rebuild script is slow, huh?

crimson gulch Aug 9, 2021, 7:09 PM

#

Yeah, mega slow

#

I'm going to increase the size of the Droplet I'm using to one with more CPU this evening and re-run everything again tomorrow

#

I've taken the whole week off as I'm getting tattooed Wednesday and Thursday too so have a lot of time this week to make shit work

#

This might be a good workaround while I trying find the real solution https://www.mediawiki.org/wiki/Extension_talk:Cargo#Cargo_duplicate_row_workaround

Extension talk:Cargo

rich widget Aug 9, 2021, 7:13 PM

#

It's going, but oh so slowly.

crimson gulch Aug 9, 2021, 7:13 PM

#

yeah 🙃

#

It's having to delete everything and recreate them all with the correct namespaces

#

Just creating the _Pagedata table for Cargo now

#

not sure if that's used anywhere but saw it's on Fandom and it has to be created using a separate script

rich widget Aug 9, 2021, 7:24 PM

#

I don't think it's used anywhere, but I guess it won't hurt.

crimson gulch Aug 9, 2021, 7:25 PM

#

yeah

rich widget Aug 9, 2021, 7:25 PM

#

It does let you query by page category, so there's that

crimson gulch Aug 9, 2021, 7:25 PM

#

Yeah, might be useful for a bot

#

Looks like it gets used in a few places https://www.poewiki.net/w/index.php?title=Special:Search&profile=all&search=_pageData&fulltext=1

Index.php

rich widget Aug 9, 2021, 7:29 PM

#

Hmm. That said, I have no idea why this query is joining with _pageData. https://www.poewiki.net/wiki/edit/List_of_fossils

List of fossils

List of fossil items.

crimson gulch Aug 9, 2021, 7:30 PM

#

yeah I'm trying to work out what that's achieving

#

@grand magnet Any idea why you set it up that way?

grand magnet Aug 9, 2021, 7:35 PM

#

It's not in the query though?

rich widget Aug 9, 2021, 7:35 PM

#

I just removed it

grand magnet Aug 9, 2021, 7:36 PM

#

well it does some unnecessary shrug

#

Oh I renember now I think

#

I think it used to query categories on the page

#

Probably just forgot to remove when I copied the query

rich widget Aug 9, 2021, 7:37 PM

#

So it was a holdover from an older query. Gotcha

raven bluff Aug 9, 2021, 8:00 PM

#

I do feel like it might make sense to "pre-bake" more data, instead of making Cargo figure it out at runtime. In particular, it'd probably be good to move away from queries which depend upon substring matching, e.g. to identify items with modifiers related to a particular topic

crimson gulch Aug 9, 2021, 8:12 PM

#

I just null edited a page and didn't get a dupe 🎉

#

I spoke too soon, page was rebuilding so they're all duped in the new table 😮‍💨

#

Downloading Cargo 2.2 which is the version on Fandom to see if it's an extension error

bleak comet Aug 9, 2021, 8:19 PM

#

Fandom version is heavily edited if I recall correctly.

crimson gulch Aug 9, 2021, 8:19 PM

#

🙃

#

I've managed to break the whole site doing that anyway

#

and we're back

#

but 2.2 is not playing nice with things

crimson gulch Aug 9, 2021, 8:45 PM

#

Yes, duplication of entries in Cargo is an issue - when pages are saved
while a recreate process is ongoing, or two recreate processes for the same
table run at the same time, it can lead to duplicate rows.

🤔

https://sourceforge.net/p/semediawiki/mailman/message/36016946/

crimson gulch Aug 9, 2021, 9:47 PM

#

How tho

raven bluff Aug 9, 2021, 9:56 PM

#

om nom bandwidth nom nom

#

27 GB is nothing though, DO bandwidth is cheap

crimson gulch Aug 9, 2021, 10:04 PM

#

Yeah and that’s with Varnish turned off for most of the day

#

And mostly file transfers to the box itself

delicate sorrel Aug 9, 2021, 10:32 PM

#

@rich widget hey, I was wondering if you had a moment to chat real quick. sent a friend request so we can speak in dm

delicate sorrel Aug 9, 2021, 11:22 PM

#

@crimson gulch if you have a moment that would be fine too

analog abyss Aug 10, 2021, 12:03 AM

#

when pages are saved while a recreate process is ongoing

well if the cargo table duplication is due to pages are saved while a recreate process is ongoing, i guess i have messed it up by edited some modifier

Time to have my character climb to Act 10 for my Templar project then https://www.poewiki.net/wiki/Templar#Text_and_Speech

(sure i can copy from https://oriath.net/Audio/Templar/ BTW)

Templar

The Templar is a strength/intelligence hybrid character class.
The armors associated with the Templar's strength and intelligence are Chainmail Coifs/Helmets, Chainmail/Ringmail, Mesh/Chain Gloves, Mesh/Chain Boots, and Kite Shields.

raven bluff Aug 10, 2021, 12:31 AM

#

analog abyss > when pages are saved while a recreate process is ongoing well if the cargo ta...

oriath.net should be all up to date fwiw, feel free to copy from there 🙂

#

and btw, the reason the oni-goroshi drop line shows up is because the game treats that as a character audio event for each character. it's not part of the sword's lines because you aren't wielding it yet

analog abyss Aug 10, 2021, 12:42 AM

#

in wiki it is done by timeline basis, so that i need to have a playthrough. But to safe my time on typing all over again i guess i just copy and paste is the best way to do it

#

I never done all ear since 3.0 so that other editors have done amazing job on documented the 3.0 era dialogues. Just may be missing a lot of new league dialogues for whatever reason on editors not active on it anymore

pure cipher Aug 10, 2021, 12:50 AM

#

I ran All Ears and No Stone Unturned based on the Google Sheet, the instructions still work.

#

There has been no additions since whatever it was, 3.9

#

That is: https://www.reddit.com/r/pathofexile/comments/ec1zb2/39_all_earsno_stone_unturnedlocomancerno_loose/

analog abyss Aug 10, 2021, 12:55 AM

#

i mean in wiki it miss a lot of new dialogues . I think post 3.13 (Meven) some dialogues has changed too

#

the all ear wiki page may be up to date. but i am unsure in the npc article it has documented the correct up-to-date dialogues or not

pure cipher Aug 10, 2021, 1:13 AM

#

Right, I have no experience with those 🙂

analog abyss Aug 10, 2021, 1:16 AM

#

anyway it is the fundamental problem of the wiki. You can have a website dedicated to static content of the game by datamining. But for the wiki, which meant to be edited (not much page except template and module are protected from edit), seems either rely on the player community or setup bot to pour content in it

pure cipher Aug 10, 2021, 1:17 AM

#

Is there too much information in the wiki, if there's such a thing?

analog abyss Aug 10, 2021, 1:21 AM

#

yeah, may be the solution is leaving an ext link and let people to click it to read the latest info. poedb also has the more complete quest log of each quest. Some quest article is not written in a walkthough manner (as quest log sometimes unclear and misleading) but a partial collection of quest log and quest dialogues

but for the area, monster, skill and modifier, since it is used by wiki editors to describe the interactions, it needed to be datamined into the wiki but currently pypoe is not working in 100% state.

#

I admit poedb open to "wiki"-like edit would make that site have even more advantage that any traditional Mediawiki-based POE wiki and the forks

#

for example https://pathofexile.fandom.com/wiki/The_Trialmaster, it has the monster datacard datamined and displayed, but the monster skill is not yet datamined (it "can" be mined but way too messy to do it for all monster skill), while poedb did datamined the monster skill. Both site does not have descriptive info to digest the datamined data or from the experience of player that actually killed the boss, which poedb would have an advantage if player referring to the internal stat ids of the monster skill in their walkthough on the boss fight

stone crater Aug 10, 2021, 2:14 AM

#

In fact, the wiki is maintained by very few people. I have 4 people who have applied for editing permission, but now 0 wiki have written it.

analog abyss Aug 10, 2021, 2:48 AM

#

This is another reason. In the past there are more editors

analog abyss Aug 10, 2021, 3:40 AM

#

and for the dispute on twinned POE wiki fork (actually triple for the first fork attempt). I think the site ownership can entrusted to Vinifera7 or subreddit mod or GGG themselves and date to date management without dispute Vinifera7 and other existing fandom wiki admins can do that job in new forks. I just never able to understand Vinifera7 was not invited in JourneyToJah's team and let Vinifera7 (and other wiki admins and vet) absent from the discussion and decide to go ahead and decide to insist JourneyToJah himself needed to be the leader in the project

grand magnet Aug 10, 2021, 3:51 AM

#

I don't think any of us were contacted, or even mentioned

analog abyss Aug 10, 2021, 3:54 AM

#

I have left my comment in their discord after reading the comment (which i re-posted part of it here) of JourneyToJah , and then in their team there is people try to settle the dispute between JourneyToJah and iamacyborg. Don't bother to go there to try to read the followup (which i don't want to boil my emotion and my usually not so assume good faith bad habit).

bitter sorrel Aug 10, 2021, 4:30 AM

#

btw more often than not it's just "armour", not "armours".

analog abyss Aug 10, 2021, 4:31 AM

#

bitter sorrel btw more often than not it's just "armour", not "armours".

You mean grammar in the wiki article or just wrong channel? I admit i have bad grammar and a lots of stuff related to lanuage

bitter sorrel Aug 10, 2021, 4:32 AM

#

oh sorry, i was referring to the templar blurb above 🙂

#

"The armors associated with the Templar's strength"

#

English has a few tricky bits, like most languages I imagine 🙂

analog abyss Aug 10, 2021, 4:34 AM

#

i think the context is refer to the item (Body Armour, Shield, Helmet) but in-game Armour means Armour (rating) and then the actual armor piece

#

so that i think the word armor should be substituted but i don't have one in mind

bitter sorrel Aug 10, 2021, 4:36 AM

#

perhaps "The armour types associated with the Templar"?

#

or even "The types of armour associated with the Templar" but this is less pretty imho

analog abyss Aug 10, 2021, 4:37 AM

#

changed

bitter sorrel Aug 10, 2021, 4:38 AM

#

ugly spelling/grammar hurts my eyes, i can't help it lol

#

regarding the future of the wiki(s), i **really **think GGG needs to help by providing data like they do for the passive tree and item filters.

#

for example, would it really kill them to release a JSON or whatever containing skill gem info on the day of the league start?

analog abyss Aug 10, 2021, 4:47 AM

#

In that case the email should be send by subreddit mod such as blvcksvn (has another alias in discord), not random guy (the thread has upvote count as crowning as the leader of the project?). Or i am not sure OmegaK2 as wiki admin has asked before or not

bitter sorrel Aug 10, 2021, 4:48 AM

#

i'm sure he has before

analog abyss Aug 10, 2021, 4:50 AM

#

In their team discord they are wishing GGG bless them and decide to pour data to their project. If it is that easy what not GGG host a wiki like a few years ago?

#

wiki are meant to be edit by editor (i believe player have way more time than GGG employee to this voluntary job) unless GGG decide to host one. And they decide to not host one for a long time why suddenly they will change ?

#

I still hope they release json so that i have day 0 POB btw

bitter sorrel Aug 10, 2021, 4:53 AM

#

🙂

#

can you imagine trying to keep a wiki up-to-date every league without datamining anything?

stone crater Aug 10, 2021, 4:55 AM

#

7.i. Reverse engineer, de-compile or disassemble the Website, Materials or Services or seek to establish the technical processes, operations and communication protocols of the Website, Materials or Services through any means, including without limitation by reference to the input or output of the Website, Materials or Services or the internal structure and workings of the Website, Materials or Services.

analog abyss Aug 10, 2021, 4:55 AM

#

well, the wiki already have outdated modifier . it is not updated in 3.13 as desptie pypoe still work at that time. no one run a wiki bot . While ruba has done it in ru-wiki.

bitter sorrel Aug 10, 2021, 4:56 AM

#

exactly @stone crater , GGG are actually the opposite of helpful at the moment 😉

stone crater Aug 10, 2021, 4:57 AM

#

when they remove QuestVendorGems.dat from client, I ask for help. and they response they will remove anything that client don't need to prevent datamining

analog abyss Aug 10, 2021, 4:58 AM

#

stone crater > 7.i. Reverse engineer, de-compile or disassemble the Website, Materials or Ser...

this is just the umbrella clause that reserved to use but not using right now . At least i have used pypoe and submit some pull request to the pypoe fork and i am not banned yet. I even talk about pypoe in public in official forum. For sure it is more than happy if they release all mod in json, but i don't think they will.

ZiggyD, well-known friend of GGG, has asked mod group problem in public and we still rely on datamine to know mod group or learn it in hard way by bricked item from woke orb

bitter sorrel Aug 10, 2021, 4:58 AM

#

the current situation is certainly frustrating from our point of view

#

maybe they could make full data for an item available once it's "dropped" once?

rich widget Aug 10, 2021, 5:04 AM

#

grand magnet I don't think any of us were contacted, or even mentioned

That's correct. I posted some concerns on the initial reddit thread posted by JourneyToJah, and was basically told, "It won't be an issue." JourneyToJah has not reached out to me before or since.

bitter sorrel Aug 10, 2021, 5:05 AM

#

have they completely removed QuestVendorGems.dat from the client? they don't add it back in on launch day?

analog abyss Aug 10, 2021, 5:07 AM

#

bitter sorrel have they completely removed QuestVendorGems.dat from the client? they don't ...

no. i think. So that some quest reward in wiki was stuck in 3.11 as it need people like me to read the patch note and manually change it (Luckily they did mention the change in quest reward, but at the same time for sure they can display in their website that the quest as of that league, ALL the quest reward instead of changed rewards only)

bitter sorrel Aug 10, 2021, 5:32 AM

#

well that seems like a disproportionately aggressive response... how many hours until someone finds all the new gems on a vendor anyway?

stone crater Aug 10, 2021, 5:34 AM

#

they are in patchnote, but sometimes wrong

analog abyss Aug 10, 2021, 5:34 AM

#

the company is terrible in doc in general. Someone asked question in official forum and he has read all the item filter announcement since 2.0 and spotted unannounced change and then the official page https://www.pathofexile.com/item-filter/about is somewhat outdated

Path of Exile

Path of Exile is a free online-only action RPG under development by Grinding Gear Games in New Zealand.

bitter sorrel Aug 10, 2021, 5:36 AM

#

patchnotes are manual intervention too, which is not ideal

stone crater Aug 10, 2021, 5:36 AM

#

their official web site still link to https://pathofexile.gamepedia.com/ as official wiki

Official Path of Exile Wiki

bitter sorrel Aug 10, 2021, 5:37 AM

#

do they actually gain anything from GGG as the "offical" wiki though, other than the title?

analog abyss Aug 10, 2021, 5:39 AM

#

stone crater their official web site still link to https://pathofexile.gamepedia.com/ as offi...

at least they renamed the text in the pull down menu from official wiki to community wiki

stone crater Aug 10, 2021, 5:39 AM

#

any plan to change it to the new one?

bitter sorrel Aug 10, 2021, 5:40 AM

#

oh sorry chuanhsing i missed your point entirely 😉

analog abyss Aug 10, 2021, 5:41 AM

#

stone crater any plan to change it to the new one?

Don't know, other team has sent email to wish to have GGG blessing . But until the poe wiki fork is stable i don't think it is the time to cut the traffic to our (maintained by existing active editors of fandom wiki) wiki fork

analog abyss Aug 10, 2021, 5:43 AM

#

bitter sorrel well that seems like a disproportionately aggressive response... how many hours ...

so that some people spotted the error and then report to GGG as missing quest reward, since so many people play league to have a fresh start and check the gem they want from the quest (or most of the time false positive due to rely on outdated wiki that since we all are volunteer, so that can't make it up-to-date all the time)

bitter sorrel Aug 10, 2021, 5:44 AM

#

i think chuanhsing was pointing out that the link should be changed to https://pathofexile.fandom.com/

#

for now at least

analog abyss Aug 10, 2021, 5:44 AM

#

this is minor detail that gamepedia is a redirect to fandom

rich widget Aug 10, 2021, 5:51 AM

#

analog abyss Don't know, other team has sent email to wish to have GGG blessing . But until t...

What other team though?

#

@crimson gulch Do you want to install this extension? https://www.mediawiki.org/wiki/Extension:Interwiki

crimson gulch Aug 10, 2021, 6:01 AM

#

delicate sorrel <@!169413467885928448> if you have a moment that would be fine too

Sorry man was late my time, free today

crimson gulch Aug 10, 2021, 6:01 AM

#

rich widget <@!169413467885928448> Do you want to install this extension? https://www.mediaw...

Will do

crimson gulch Aug 10, 2021, 6:15 AM

#

rich widget What other team though?

JourneytoJah and co have created a new Discord and are working on another fork there

#

They’re struggling with a lot if basic MW stuff though and there’s a lot of talk about stuff they want to add or have on the wiki that shows they don’t really know or understand what’s already there

rich widget Aug 10, 2021, 6:17 AM

#

crimson gulch JourneytoJah and co have created a new Discord and are working on *another* fork...

crimson gulch Aug 10, 2021, 6:17 AM

#

I’ve mentioned multiple times over the last couple days they should come speak to editors here but…

#

They’re also trying to fork PyPoe without talking to Omega

stone crater Aug 10, 2021, 6:23 AM

#

crimson gulch They’re also trying to fork PyPoe without talking to Omega

PyPoe is public project, should be fine just fork

rich widget Aug 10, 2021, 6:23 AM

#

I mean, that's not really a problem

#

Open source software forks all the time

crimson gulch Aug 10, 2021, 6:34 AM

#

Yeah just seems weird to not speak to the creator to understand what needs changing

stone crater Aug 10, 2021, 6:37 AM

#

He should think that the wiki has not been updated for a long time, even if he finds the original team, there will be no improvement. Therefore, he intends to form a brand-new team by himself to solve the current dilemma.

rich widget Aug 10, 2021, 6:37 AM

#

I can understand a group breaking off and doing their own thing if there is an irreconcilable difference in vision between them and the mainstay group, but again, that discussion never took place.

crimson gulch Aug 10, 2021, 7:20 AM

#

On the bright side the creator of Cargo responded to a query I had about dupes so hopefully we can see some movement there https://www.mediawiki.org/wiki/Extension_talk:Cargo#Also_suffering_from_duplicate_rows

Extension talk:Cargo

analog abyss Aug 10, 2021, 7:20 AM

#

The problem is they never really start anything and in the stage of guessing and reverse engineering the wiki template and already want their project is one and only one for the community

crimson gulch Aug 10, 2021, 7:22 AM

#

Scaling up the server

#

it might be down intermittently in the next 10 mins

analog abyss Aug 10, 2021, 7:31 AM

#

It just can't play a blame game in us for allegedly suddenly had an idea of fork in the past weekend. It is success or not still depend their own team .Even we don't fork , they still need to be assume people have a choice to read their and fandom.

crimson gulch Aug 10, 2021, 7:41 AM

#

Running this again https://www.mediawiki.org/wiki/Manual:Rebuildall.php

Manual:Rebuildall.php

#

Should be faster now there are more CPU cores available

crimson gulch Aug 10, 2021, 9:02 AM

#

Just noticed the Math extension is missing, will add

rich widget Aug 10, 2021, 2:07 PM

#

https://www.mediawiki.org/wiki/Extension:Cargo/Storing_data#Field_parameters

Extension:Cargo/Storing data

The creation of data structures, and storage of data, is done in Cargo exclusively via templates.
Any template that makes use of Cargo needs to contain calls to the parser functions #cargo_declare and #cargo_store; or, more rarely, calls to #cargo_attach and #cargo_store.
#cargo_declare defines the fields for a table of data, #cargo_store stores...

#

@crimson gulch You were wondering whether we set fields that should be unique as unique

crimson gulch Aug 10, 2021, 2:09 PM

#

Yeah so one thing I'm thinking is maybe we've not set an actual unique key on the tables, hence why they're storing duplicates

rich widget Aug 10, 2021, 2:10 PM

#

Well, every table has a unique key built in with cargo. It's the _pageID field

#

At least, I think so. Let me actually check on that

#

https://www.mediawiki.org/wiki/Extension:Cargo/Storing_data#Database_storage_details

Extension:Cargo/Storing data

The creation of data structures, and storage of data, is done in Cargo exclusively via templates.
Any template that makes use of Cargo needs to contain calls to the parser functions #cargo_declare and #cargo_store; or, more rarely, calls to #cargo_attach and #cargo_store.
#cargo_declare defines the fields for a table of data, #cargo_store stores...

crimson gulch Aug 10, 2021, 2:12 PM

#

rich widget Aug 10, 2021, 2:12 PM

#

My bad, it's the _ID field. The _pageID field is not unique

crimson gulch Aug 10, 2021, 2:12 PM

#

Yeah, that might be the issue

rich widget Aug 10, 2021, 2:13 PM

#

That's an interesting point, actually.

#

I'll have to look into that more.

crimson gulch Aug 10, 2021, 2:16 PM

#

I'm not familiar with Lua but this looks like it has potential?

`-- mw.logObject(m_cargo.map_results_to_id{results=mw.ext.cargo.query('mods,spawn_weights', 'mods._pageID, spawn_weights.tag', {where='mods.id="Strength1"', join='mods._pageID=spawn_weights._pageID'}), field='mods._pageID'})
function m_cargo.map_results_to_id(args)
-- Maps the results passed to a table containing the specified field as key and a table of rows for the particular page as values.
--
-- args
-- results : Table of results returned from mw.ext.cargo.query to map to the specified id field.
-- field : Name of the id field to map results to
-- the field has to be in the fields list of the original query or it will cause errors.
-- keep_id_field : If set then don't delete _pageID.
-- append_id_field : If set then append the id to the table sequentially as well which allows preserving
-- the id order they were found in.
--
-- return
-- table
-- key : The specified id field
-- value : Array containing the found rows (in the order that they were found)
local out = {}
for _, row in ipairs(args.results) do
local key = row[args.field]
if out[key] then
out[key][#out[key]+1] = row
else
out[key] = {row}

        -- Append the ids sequentially, this allows preserving the order
        -- the ids were found:
        if args.append_id_field ~= nil then
            out[#out+1] = key
        end
    end

    --Discard the pageID, don't need this any longer in most cases:
    if args.keep_id_field == nil then
        row[args.field] = nil
    end
end

return out

end`

rich widget Aug 10, 2021, 2:17 PM

#

What am I looking at?

crimson gulch Aug 10, 2021, 2:17 PM

#

This is part of this page https://www.poewiki.net/wiki/Module:Cargo

Module:Cargo

rich widget Aug 10, 2021, 2:17 PM

#

Oh, okay

rich widget Aug 10, 2021, 2:42 PM

#

So I'm looking at how the mods table is declared. It looks like the id field is not actually defined as unique.

#

that is, the id field, not the _ID field

crimson gulch Aug 10, 2021, 2:43 PM

#

I wonder if that may be the issue?

rich widget Aug 10, 2021, 2:44 PM

#

It might be. Thing is, it doesn't explain why cargo dupes rows

crimson gulch Aug 10, 2021, 2:46 PM

#

No, it doesn't, and what's weird is doing a null edit saves two rows but further edits don't create additional dupes

rich widget Aug 10, 2021, 2:47 PM

#

Really...? Do you have a way to reproduce that?

#

I've never seen that happen before.

crimson gulch Aug 10, 2021, 2:48 PM

#

yeah so if you check here you can see what's stored in the table https://www.poewiki.net/wiki/Special:CargoTables/mods

Mods

#

I've been finding a mod that's not in there, and then null editing it

#

it creates two rows

#

doing another null edit doesn't add anything

#

In the backend I've also deleted one of the rows to see what'd happen, doing another null edit in that case recreates the dupe row

rich widget Aug 10, 2021, 2:51 PM

#

https://www.poewiki.net/wiki/Special:CargoQuery?title=Special%3ACargoQuery&tables=mods%2C+&fields=mods._ID%2C+mods._pageID%2C+mods._pageName%2C+&where=mods._pageName+%3D+"Modifier%3AAbyssAddedLightningDamageWithAxesJewel1"&join_on=&group_by=&having=&order_by[0]=&order_by_options[0]=ASC&limit=&offset=&format=

Special:CargoQuery

#

Click on Modify query to see the query

#

It looks like it's just a straight up dupe. The only difference is the value of the _ID field.

crimson gulch Aug 10, 2021, 2:53 PM

#

Yeah, so maybe on that table we need to set the pageName or pageID as a unique key

rich widget Aug 10, 2021, 2:54 PM

#

Is that even possible to do?

crimson gulch Aug 10, 2021, 3:00 PM

#

Yeah so I think you can add the unique parameter to a field definition to define it as unique

#

https://www.mediawiki.org/wiki/Extension:Cargo/Storing_data#Field_parameters

Extension:Cargo/Storing data

The creation of data structures, and storage of data, is done in Cargo exclusively via templates.
Any template that makes use of Cargo needs to contain calls to the parser functions #cargo_declare and #cargo_store; or, more rarely, calls to #cargo_attach and #cargo_store.
#cargo_declare defines the fields for a table of data, #cargo_store stores...

rich widget Aug 10, 2021, 3:01 PM

#

Okay, but the _pageID field is declared automatically. You don't declare it.

crimson gulch Aug 10, 2021, 3:01 PM

#

maybe on this field definition on line 98 of Module:Mod?

id = { name = 'id', field = 'id', type = 'String', wikitext = i18n.tooltips.id, },

rich widget Aug 10, 2021, 3:03 PM

#

So what happens when Cargo decides to create a duplicate row then? It throws an error? That's not very helpful.

crimson gulch Aug 10, 2021, 3:04 PM

#

I think it just won't save the new value

#

or at least, another value

#

Hopefully it'll still allow the value to be overriden when it needs to be

rich widget Aug 10, 2021, 3:05 PM

#

Let's put that idea on hold. What I want to try is setting up the attachment template for the mods table and rebuild the table that way.

#

That is, if you're done running scripts and stuff.

crimson gulch Aug 10, 2021, 3:06 PM

#

54,000 pages in, another ~12k to go

rich widget Aug 10, 2021, 3:06 PM

#

Okay. I'm not going to edit anything until that's done.

crimson gulch Aug 10, 2021, 3:06 PM

#

But if you try create the attachment table that'd be fine

#

and then we press to button to rebuild when the other script is done

rich widget Aug 10, 2021, 3:07 PM

#

Cargo is just sensitive. You remember that we created the Mod namespace after the mod pages were already in, right?

crimson gulch Aug 10, 2021, 3:08 PM

#

yeah

rich widget Aug 10, 2021, 3:08 PM

#

Well, I'm pretty sure that's what's screwing it up.

crimson gulch Aug 10, 2021, 3:08 PM

#

It was happening before then I think

rich widget Aug 10, 2021, 3:08 PM

#

We just need to let Cargo rebuild the table.

crimson gulch Aug 10, 2021, 3:08 PM

#

let's do that

rich widget Aug 10, 2021, 3:09 PM

#

Shouldn't I wait?

crimson gulch Aug 10, 2021, 3:09 PM

#

How long do you think it'll take to create the attach template?

rich widget Aug 10, 2021, 3:09 PM

#

Five minutes...

crimson gulch Aug 10, 2021, 3:09 PM

#

ah yeah then let's wait a bit

#

This take a while https://www.mediawiki.org/wiki/Manual:Rebuildall.php

Manual:Rebuildall.php

rich widget Aug 10, 2021, 3:10 PM

#

I don't know what that does exactly, but I just thought I should wait while it's running.

crimson gulch Aug 10, 2021, 3:10 PM

#

It should be safe to abort via ctrl+C if you get bored.

I am definitely bored

#

It should actually be fine if you go ahead, this script won't touch cargo tables

rich widget Aug 10, 2021, 3:11 PM

#

Oh, okay

#

@grand magnet If you have a minute, I could use your help. Where does Module:Mod actually store rows to the mods table? I'm just not seeing it. https://www.poewiki.net/wiki/Module:Mod

Module:Mod

bleak comet Aug 10, 2021, 3:26 PM

#

m_util.args.from_cargo_map

#

there's a store at the end of it

#

m_cargo.store(frame, cargo_values)

#

Seems a little circular though...

#

That util function should probably move to m_cargo if it isn't there already

rich widget Aug 10, 2021, 3:29 PM

#

Yeah I see. That util function seems like it's doing things over and beyond what it's purpose is. It should just validate args...

bleak comet Aug 10, 2021, 3:33 PM

#

m_cargo.parse_field_arguments might be the "modern" way

#

https://pathofexile.fandom.com/wiki/Module:Monster

Path of Exile Wiki

Module:Monster

Module:Monster - Official Path of Exile Wiki

#

monsters uses that one

#

Might be possibly to replace m_util.args.from_cargo_map with m_cargo.parse_field_arguments.

rich widget Aug 10, 2021, 3:35 PM

#

Good to know

#

1 row populated every 5 minutes. https://www.poewiki.net/wiki/Special:CargoTables/mods?_replacement

Mods

#

I'll just check back next week then.

crimson gulch Aug 10, 2021, 3:46 PM

#

It runs based on traffic to the site, I'll run the jobqueue script once the other is done

#

actually fuck it, this one is more important

#

#

This should run through 10k items in the queue

#

Running through the cosmetics table right now

#

Looks like we've somehow got some triplicates in the Areas table https://www.poewiki.net/wiki/User:Iamacyborg/test

Test

rich widget Aug 10, 2021, 3:52 PM

#

wtf

#

why, Cargo?

crimson gulch Aug 10, 2021, 3:53 PM

#

I wonder if we can just modify the queries on pages so it ignores dupes

#

That way stuff works, even if the DB is messy

#

Reassuring from the extension dev 😬

Okay, yes, I see the problem. That's very strange, and I don't know why it's happening.

rich widget Aug 10, 2021, 3:55 PM

#

😅

crimson gulch Aug 10, 2021, 4:01 PM

#

Ok looks like the mods table is populating now

rich widget Aug 10, 2021, 4:05 PM

#

They seem to all be going at the same time.

crimson gulch Aug 10, 2021, 4:08 PM

#

yeah, it's weird, at least the number is going up in the right direction 😅

#

no dupes in those tables so far

#

you can query the replacement tables like this

{{#cargo_query: table=cosmetic_items__NEXT |fields=_pageName, COUNT(_pageName) |having=COUNT(_pageName) > 1 |group by=_pageName |order by= COUNT(_pageName) DESC }}

#

Hoo boy https://www.poewiki.net/w/api.php?action=query&format=json&meta=siteinfo&siprop=statistics

#

193k items in the job queue

rich widget Aug 10, 2021, 4:20 PM

#

The cosmetic_items table appears to be done, so I'm going to replace

crimson gulch Aug 10, 2021, 4:20 PM

#

sounds good

rich widget Aug 10, 2021, 4:21 PM

#

No dupes.... yet

crimson gulch Aug 10, 2021, 4:26 PM

#

running again, things might slow down as I've set it to ignore memory limits

#

queue is down to 170k

#

~149k looks like this should clear relatively soon

crimson gulch Aug 10, 2021, 5:04 PM

#

~100k

crimson gulch Aug 10, 2021, 6:06 PM

#

seems to be running through a bunch of cache update jobs at the mo but slowly clearing down

crimson gulch Aug 10, 2021, 6:28 PM

#

~41k

crimson gulch Aug 10, 2021, 7:03 PM

#

🤞

#

Data's coming in without dupes https://www.poewiki.net/wiki/Special:CargoTables/mods?_replacement

Mods

crimson gulch Aug 10, 2021, 7:22 PM

#

Looks like it's stalling at 2661 mods, I wonder if that's to do with the linktable or something

#

On the bright side, null editing a modifier that's in the new table didn't create a dupe

round flame Aug 10, 2021, 7:40 PM

#

Hi, I heard the poe wiki is forking from fandom. Im curious if that's true and if theres some sort of current status on the new wiki. I edit quite a bit on the oldschool runescape wiki, which forked from fandom a few years back and the POE wiki has been talked about a bit among the editors there. Might be useful to talk to some of the folks there if new forks of the poe wiki are spinning up and you want help from a wiki that has successfully split from fandom

#

no worries if not, just thought Id throw it out there

rich widget Aug 10, 2021, 7:45 PM

#

round flame Hi, I heard the poe wiki is forking from fandom. Im curious if that's true and i...

Yep. The situation is that we're currently working on building the data tables on the new wiki poewiki.net. It's not quite ready to go, so we haven't been promoting it.

#

I should also tell you that there is a competing wiki project that was started by someone else. They began work on their project without contacting any of the existing wiki editors, so it seems that they want to go it alone or form a completely separate group of editors.

round flame Aug 10, 2021, 7:49 PM

#

Oh interesting. Maybe thats the reddit post I saw then 👀 Cool to hear that youre working on a fork though, hopefully it goes well. Feel free to reach out if you want help or advice, I can forward you to the right people on the osrs wiki

rich widget Aug 10, 2021, 7:50 PM

#

Just check this space from time to time.

round flame Aug 10, 2021, 7:51 PM

#

Yeah, Ill keep an eye on this for sure

formal forge Aug 10, 2021, 7:51 PM

#

Definitely would recommend trying to consolidate the various forks

#

You're going to have a hard enough time winning against a dead fandom wiki

#

The technical migration is probably the easiest of the three migrations you need to successfully fork away from fandom

rich widget Aug 10, 2021, 7:52 PM

#

What do you identify the other two as?

formal forge Aug 10, 2021, 7:52 PM

#

Migrating the editor community, and migrating the reader community

rich widget Aug 10, 2021, 7:53 PM

#

Yeah, that's understandable.

formal forge Aug 10, 2021, 7:53 PM

#

I don't have much of a sense of where the editor community is/whether any people are interested in staying on fandom, but even if you're very successful, you'll still have some low-information editors not know about the fork inadvertently working on the old one

#

And it can be challenging to communicate with them

crimson gulch Aug 10, 2021, 7:53 PM

#

Yeah you can’t really advertise the fork on fandom itself

formal forge Aug 10, 2021, 7:54 PM

#

And then "migrating the reader community" is basically code for SEO

rich widget Aug 10, 2021, 7:54 PM

#

Right lol

formal forge Aug 10, 2021, 7:54 PM

#

I run the runescape/osrs wikis btw - we've been through those exact hurdles before

crimson gulch Aug 10, 2021, 7:55 PM

#

The seo thing I see as a multi-year process tbh, even optimistically a dead fandom wiki is going to outrank a new one even if it gets a lot of links from other high ranking sources

#

Doesn’t help that the comms guy for fandom is a mod on a bunch of gaming subs

formal forge Aug 10, 2021, 7:56 PM

#

It's a multi-year process for sure, but you can probably get to a majority hold in a matter of months if you know how Google works

#

There are a lot of discoveries we made along the way

#

and FWIW I think most folks' dislike of fandom far outweighs loyalty to a particular reddit mod

#

as you can see from the fact that all of these "fandom sucks, let's make a new wiki" posts get like 3000 upvotes, lol

crimson gulch Aug 10, 2021, 7:57 PM

#

Lol yeah

#

Amusingly that was always the attitude about wikia when I was at Curse

formal forge Aug 10, 2021, 7:58 PM

#

We had an opportunity to go to Gamepedia in about 2014, and boy am I glad we dodged that bullet

rich widget Aug 10, 2021, 7:58 PM

#

Yeah, previously it was "Gamepedia sucks", even though Gamepedia was awesome in comparison.

formal forge Aug 10, 2021, 7:59 PM

#

anyway, if you guys get stuck anywhere, I'd love to help out

crimson gulch Aug 10, 2021, 7:59 PM

#

I’m honestly pissed that a single company has a stranglehold on gaming wikis

formal forge Aug 10, 2021, 7:59 PM

#

if you were a bit earlier in the process I'd offer to host POE on the same infrastructure we do for osrs/runescape

rich widget Aug 10, 2021, 7:59 PM

#

crimson gulch I’m honestly pissed that a single company has a stranglehold on gaming wikis

Uh, yeah...

crimson gulch Aug 10, 2021, 8:00 PM

#

formal forge if you were a bit earlier in the process I'd offer to host POE on the same infra...

I’ve got it on a DO box but would love to pick your brain on that front

raven bluff Aug 10, 2021, 8:00 PM

#

crimson gulch The seo thing I see as a multi-year process tbh, even optimistically a dead fand...

touhou wiki had that exact problem when they forked -- it looks like touhouwiki.net is finally outranking the mostly-dead fandom wiki but it took years for that to happen

formal forge Aug 10, 2021, 8:01 PM

#

The main difficulty of SEO-forking is beating down Google's duplicate content penalty

#

most people don't know about this

crimson gulch Aug 10, 2021, 8:01 PM

#

Yeah that’s an obvious hazard

#

Guess it helps to work in marketing 😬

formal forge Aug 10, 2021, 8:02 PM

#

but quite often, your forked wiki will be #2 for some query behind fandom

#

but due to the way google tries to not show the "same page" twice, your 2nd-place result won't show up at all

#

so you need to do some clever things to make it show up

#

and then eventually, the goodwill from your community will mean enough people click the #2 result to get it up to #1

#

but you won't be able to do that last step unless you do the clever things to get it to show up in the first place

crimson gulch Aug 10, 2021, 8:03 PM

#

You’ve given me a lot to think about

formal forge Aug 10, 2021, 8:03 PM

#

that's definitely a phase-3 type of issue though

crimson gulch Aug 10, 2021, 8:03 PM

#

Still need to iron out some issues with Cargo 🙃

formal forge Aug 10, 2021, 8:04 PM

#

getting the technical stuff and getting the editor community are much more important earlier on

#

I will also say it's pretty important to get the editor community as on-board as you can, before fandom starts locking things down

#

Or at least, have some way to communicate with most of the power-users

rich widget Aug 10, 2021, 8:04 PM

#

How do you mean "locking things down"?

crimson gulch Aug 10, 2021, 8:05 PM

#

I guess we have the benefit of most folks being here

formal forge Aug 10, 2021, 8:05 PM

#

they will probably desysop and block all of you eventually

rich widget Aug 10, 2021, 8:05 PM

#

I guess so. I don't expect that will happen any time soon.

#

We have admins on there who haven't been active in a long time as it is.

formal forge Aug 10, 2021, 8:06 PM

#

I guess I don't have too much experience with the current crop of fandom community managers, but previously things got very nasty very quickly

crimson gulch Aug 10, 2021, 8:06 PM

#

If it’s anything like Gamepedia they’ll pay someone a couple hundred bucks a month to take over and run things

formal forge Aug 10, 2021, 8:06 PM

#

it's all fun and games until you're actually threatening their revenue stream

crimson gulch Aug 10, 2021, 8:06 PM

#

And expect them to work 20+ hours a week for that