#Leri Build

1 messages · Page 1 of 1 (latest)

brave temple
#

hello

fathom gale
#

opening

dark cypress
#

hi

past agate
#

test

fathom gale
#

@past agate can talk in here

past agate
#

so imagine i can run 10 firefox on core nr.1, 10 on core nr. 2 and so on. 5900x is better

#

?

fathom gale
#

what is the workload

past agate
#

i not programer

fathom gale
#

can you link it so we can see how it runs?

past agate
#

it just go to shop urls

#

and copy data

#

and put everything together how i need

fathom gale
#

so its a web scraper?

past agate
#

probably yes

#

but i simple for that need run multi browsers

#

on different processes with different firefox profiles

fathom gale
#

Ok so.. doing this with browser plugins is going to be bloody nightmare ish with a hell of a lot of overhead

past agate
#

the more i can do, the more i can collect data

fathom gale
#

@spring bough

past agate
#

ye, but it's free and i can do it myself

fathom gale
#

come in here

spring bough
#

I saw

#

threads are bad

#

w/e

#

@past agate Look, from what you've said about these tasks a 3600X would suffice just fine, a 3700(X) would already be pushing it slightly overkill, ultimately it's hard to give a great answer to your question if you don't have data for the task you're doing 😄

past agate
#

ye, i thinked that 5900x can be to much

fathom gale
#

they can run on fuck all

#

you got a gpu?

past agate
#

ye, but only 1650s

fathom gale
#

thats fine

past agate
#

170eur cost

fathom gale
#

gpu wont be used

past agate
#

ye, i use it only for monitor hehe

fathom gale
#

so if go for something like a 5600x slap it in the overkill x570 that you have because you are out of the return window and spend some time learning how web scraping product pages works

past agate
fathom gale
#

so yea thats not the way to do this

past agate
#

but i have apps where i collect changes also

fathom gale
#

thats got a fuck ton of overhead for no gain

past agate
#

for example price droops and so on

fathom gale
#

so api price tracking.

past agate
#

not only

#

comments and so on

fathom gale
#

yea you are looking for a better solution to your workload not a computer that can scale a shit workload

#

so because you were trying to scale a bad application, the hardware requirements would be absurd. optimising the application you are running is the first step not buying better hardware

#

and this is why you got some very dodgy advice.

past agate
#

understand what you mean

#

this is reason why i want build my own, because it's cheaper

#

they do same job, just because they doing it for you, it's more expensive

fathom gale
#

then build your own in something like python

past agate
#

it's like rent server

#

ye

#

nice from software perspective, but it's still cost like rent server

#

also they not say how often they refresh pages

#

my solution to save cpu power is simple slow that rate

#

but ideal is copy per 3 sec

fathom gale
#

you will get ip banned.

#

and it will take forever

past agate
#

no, if you proxed

fathom gale
#

its not feasible to scale like that

past agate
#

i found how i can fix it

fathom gale
#

find yourself a discord for it, there is bound to be one, work out what the requirements are then come back for the computer to build

past agate
#

ok!

#

maybe you know some CPU calculator

#

where you could calculate how much CPU need that and that task

fathom gale
#

not till you have the workload

past agate
#

;/

#

ok thx

#

p.s. don't give mod rights for people who don't want listen or talk

#

because what happened before for me was horrible

#

Thank you a lot, i probably gonna try make my own server, but i gonna try find new ways for software

#

simple then you use remote server it lagging to much to control it