PoE Shops Indexer — search for items with ease

I am interested in technical details of your indexer. What language and technique you use? Is it possible to take a peek at source code somewhere?

btw: If there's only a brute-force web scraping involved, they probably won't let this site continue anyway as it probably costs them quite a lot of traffic (if there are many users).

Having an API for this (forum) would be amazing, but that's a fairy tale right now imo :)
Last edited by Balron#5045 on Mar 29, 2013, 7:13:20 AM
The CDN issues shouldn't be related.

Indexers are just scraping forums, but they don't need to load anything other than the HTML itself (the last <script> tag contains the data for every item displayed on that page), so they're generating way less traffic than normal users.
And an API wouldn't change that much, the same data sent would be the same, just in a different format.

Now if Xyz was hammering the forums too hard at times, some firewall might have automatically blocked it as it would do for any DoS attack...
IGN: EthInvictus

Trading Forums Enhancer: http://www.pathofexile.com/forum/view-thread/244736
"
xyz wrote:
"
Jonix wrote:
damn this sucks.

Is there anything we can do? like bombard POE with requests to unban ur servers ip?

No idea. I was told devs are still at GDC so I'll wait for reply for another couple of days.


That explains why my swords weren't displaying when i filtered >300 dps 1h swords/thrusting sword..

If this is resolved, would I have to re-upload the items on the sales forum, or will it start picking it up on search?
ign KlearSpeed

1.3 Torment - Scion Kinetic Build Guide (HC Viable)
http://www.pathofexile.com/forum/view-thread/1146976
That really is abysmal and i wondered why no one wants to buy my stuff, without this indexer Trading is inpossible. My Thread in the Threading section is on page 4 or higher after 5 mins.

I kind of feel like I may aswell Vendor my 2 stash tabs of gear because Trading in the current state is awful without this. !
dunno why u all are crying. no xyz equals to cheaper items.
48;49;46;47;58;72;79;83;52;72;52;87;66;87;96;70;86;96;80;89;96;95;90;94;93;83;85;91;95;88;94;92;94;86;83;94;95;95;95;91;94;98;87;88;92;96;89;88;94;96;80;92;94;92;96;84;90;75;86;91;95;94;94;95;95
poexplorer.com?
Kuduku giveth and Kuduku taketh away.

IGN: QueenAtziri
"
Cilibinarii wrote:
poexplorer.com?


I appreciate the ad man, but let's not pollute his thread with my stuff ;)
Track your map runs: http://pathofmaps.com (retired)

Retired item indexer: https://github.com/niuage/poexplorer
PoeExplorer.com could be next.....is there any reason why it wouldnt?
"
UncleTilty wrote:
dunno why u all are crying. no xyz equals to cheaper items.


Makes it impossible to find items, I'm not going to browse through 100+ "godly items" just to find vendor trash. Also your quality item don't sell since buyers cant find them.
"
xyz wrote:
"
paranoic00 wrote:
one of my items (I didn't tested other items actually) doesn't show up in the list. If I search for it by the exact name it does show up, but if i organize the specific list by category, in this case dps, doesn't show up, it should be the 2nd in the list.
is it a bug?
thx

p.s. it's a claw, "rage barb eye gouger".

Server's IP is still banned. I have already contacted support, no useful reply yet. I'll shut down the tool if I won't get reply by 30th. Sorry.



OMG please do not let your site die, honestly trading in this game is a complete joke without poe.xyz the idea of setting up shops in a forum thread is absolutely retarded. No one can ever find the item they need in 5k pages of vendor trash. Add to that 50% of the stores don't even list an IGN so you can't even contact them. It's hard to imagine a worse scenario for sharing information so trades can be executed.

IGN: Kill_All_Sparrows

Report Forum Post

Report Account:

Report Type

Additional Info