Hi, I have about 600 gig data about 4 mil

Question

Data Science

Пользователь 61b7e

Hi, I have about 600 gig data about 4 mil

record
how many ram i need for processing with spark and get some query like select and aggregation and order them?

0

10.07.2018

2 ответов

13 просмотров

Anjan

If you can let it process the data and wait for a pretty long time then you can go with as low as 8GiB RAM. What processor are you using that always matters . Now if you can afford i7 kind of processor and some quality GPU with 12-16 GiB of ram . That's gonna run fantastic, without problems like hanging or something else. Choice is yours . And not using cloud processing is a good idea( sometimes ) Privacy matters .

0

12.07.2018

Камаl Iqlааs · Accepted Answer

Камаl Iqlааs

Use VM

0

12.07.2018

Похожие чаты

Hi, I have about 600 gig data about 4 mil

2 ответов

Похожие вопросы