Skip to content

Coop Big Data Analytics track

The Coop Big Data track adds on top of the Regular baseline the tools needed for Data Mining, NLP, Computer Vision, climate sciences and data engineering.

On an existing Debian:

Fenêtre de terminal
sudo apt install aims-os-bigdata

(Pulls aims-os-math automatically if not already there.)

python3-dask and python3-distributed for parallel pandas / numpy.

PyArrow, Polars and DuckDB are not in Trixie main. Install on demand:

Fenêtre de terminal
pipx install pyarrow polars duckdb
# or
mamba install -c conda-forge pyarrow polars duckdb

python3-nltk. spaCy, gensim and HuggingFace Transformers are not packaged in current versions by Debian. Install on demand:

Fenêtre de terminal
pipx install spacy gensim transformers
# or
mamba install -c conda-forge spacy gensim transformers

python3-opencv (cv2). python3-skimage is in aims-os-math for the scientific side.

python3-xarray, python3-netcdf4, python3-cartopy for labelled arrays, NetCDF reading, and cartographic projections on matplotlib.

  • postgresql-client + python3-psycopg2
  • mariadb-client
  • redis-tools
  • python3-pymongo

No daemons: AIMS labs point at external DB hosts.

  • Case Study from Industries in Big Data
  • Data Mining and Big Data Analytics
  • Database
  • Climate Dynamic, Mathematical Methods for Climate
  • Computer Vision
  • Generative AI (the libs are here, the models via Transformers)
  • Machine Learning (supervised + unsupervised)
  • Natural Language Processing

See the full mapping for the breakdown.

PyTorch, TensorFlow, JAX, Keras are not pre-installed. These frameworks move faster than the Debian release cycle. Install on demand:

Fenêtre de terminal
pipx install torch jax tensorflow keras
# or (recommended for CUDA/GPU)
mamba create -n ai python=3.13 pytorch jax tensorflow jupyterlab
mamba activate ai