Guides

Installing fastdup

Suggest Edits

Prerequisites and supported software/hardware

Operating system

  • Ubuntu 22.04 LTS
  • Ubuntu 20.04 LTS
  • Ubuntu 18.04 LTS
  • Mac OSX M1 Chip (tested on Big Sur)
  • Mac OSX M2 Chip (tested on Ventura)
  • Mac Intel Chip (tested on Mojave)
  • CentOS 7.9 (via stable release)
  • Amazon Linux 2 (via stable release)
  • Windows 10 Server (via WSL)

Software versions

  • Python 3.8, 3.9, 3.10, 3.11, 3.12 (via pip)
  • Note: conda is not recommended
  • pyenv installed python is not working on Mac, install python using brew install [email protected]

Hardware support

  • CPU (GPU not needed!)

Installing fastdup

macOS

This is the recommended installation method for all Mac, Ubuntu 18-20, Debian 10, Windows Server 10.
Will not work for Centos 7.9, RedHat 4.8.

python3.10 -m pip install -U pip
python3.10 -m pip install fastdup

Notes:

  • If you are using macOS, you may need to install python with brew using brew install [[email protected]](mailto:[email protected])
  • You may need to upgrade your pip, using the command python3.10 -m pip install -U pip

Ubuntu 22.04/20.04/18.04 LTS Machine Setup

Required machine setup

sudo apt update
sudo apt -y install software-properties-common
sudo add-apt-repository -y ppa:deadsnakes/ppa
sudo apt update
sudo apt -y install python3.x
sudo apt -y install python3-pip
sudo apt -y install libgl1-mesa-glx
python3.x -m pip install --upgrade pip

Using stable release

This is mandatory for CentOS 7.9 / RedHat 4.8 and similar OS.

  • download the latest wheel for your system from our release page. Assuming the wheel file is found in your working folder, run:
python3.x -m pip install *.whl

CentOS 7 Setup / Amazon Linux 2 / RedHat 4.8

sudo yum -y install epel-release
sudo yum -y update
sudo yum -y groupinstall "Development Tools"
sudo yum -y install openssl-devel bzip2-devel libffi-devel xz-devel
sudo yum -y install wget
sudo yum install redhat-lsb-core # for lsb_release
sudo yum install -y ffmpeg ffmpeg-devel # for video support

Download and istall CentOS 7 whl image from our release page.

python3.7 -m pip install <path of the downloaded whl>

Windows 10/11 (Using WSL)

To install WSL follow the instructions here.

  • Enable WSL on your machine (Search -> powershell-> right click -> run as administrator)
wsl --install
  • Reboot your machine
  • Inside the Ubuntu shell, run the following installers (you will be asked for password you entered before).
sudo apt update
sudo apt -y install software-properties-common
sudo add-apt-repository -y ppa:deadsnakes/ppa
sudo apt update
sudo apt -y install python3.x
sudo apt -y install python3-pip
sudo apt -y install libgl1-mesa-glx
pip3 install --upgrade pip
python3.x -m pip install fastdup

Upgrading fastdup

You can upgrade an existing fastdup installation by passing the -U option to pip install:

python3.10 -m pip install -U fastdup

Uninstalling fastdup

You can uninstall fastdup using the following command:

python3.10 -m pip uninstall fastdup

Updated 4 months ago