Arik Chakma
274082fd77
* refactor: clean to roadmap content * refactor: move shared helpers into scripts/lib
7 lines
510 B
Markdown
7 lines
510 B
Markdown
# Big Data Tools
|
|
|
|
Big data tools process datasets too large to fit in a single machine's memory using distributed or out-of-core computation. Dask and PySpark are the primary Python tools for scaling beyond what Pandas and NumPy can handle. They provide familiar DataFrame-like APIs while distributing computation across cores or clusters.
|
|
|
|
Visit the following resources to learn more:
|
|
|
|
- [@article@4 Types of Big Data Technologies (+ Management Tools)](https://www.coursera.org/articles/big-data-technologies) |