For most cases, installation is as simple as:

pip3 install -U pip 
pip3 install -U fastdup

Latest fastdup is available for Mac M1 12 and higher, Ubuntu 20 and higher, Windows 10 and higher (via WSL).

Legacy versions are: Ubuntu 18, CentOS 7, Mac Intel.

​
Below we list common issues and prerequisites for various platforms:

  1. Ubuntu 22.04/20.04 Preliminaries
  2. Mac OSX Preliminaries
  3. CentOS 7 Preliminaries
  4. Amazon Linux 2
  5. Windows Server 10 Preliminaries
  6. Pypi setup using pip
  7. Preinstalled docker
  8. Common installation errors

fastdup is currently supported on Ubuntu 20.04/22.04/24.04 or 18.04 OS, CentOS 7.9, Amazon Linux 2, RedHat 4.8, Mac OS 10+ using Intel or M1 CPUs, and Windows 10, 11 Server (via WSL).

​
Ubuntu 24.04/22.04/20.04 LTS Machine Setup

Required machine setup:

sudo apt update
sudo apt -y install software-properties-common
sudo add-apt-repository -y ppa:deadsnakes/ppa
sudo apt update
sudo apt -y install python3.9
sudo apt -y install python3-pip
sudo apt -y install libgl1-mesa-glx
python3.9 -m pip install --upgrade pip

​
Mac OS Setup 

# Install python:
brew install python@3.9
python3.9 -m pip install --U pip
python3.9 -m pip install fastdup

Note: When using conda on Mac M1 or Mac M1 Pro, make sure you install conda for ARM (and not conda for Intel). Otherwise, it will not be possible to install.

​
CentOS 7 Setup / Amazon Linux 2 / RedHat 4.8 

sudo yum -y install epel-release
sudo yum -y update
sudo yum -y groupinstall "Development Tools"
sudo yum -y install openssl-devel bzip2-devel libffi-devel xz-devel
sudo yum -y install wget
sudo yum install redhat-lsb-core # for lsb_release
sudo yum install -y ffmpeg ffmpeg-devel # for video support

Download and install the CentOS 7 .whl image from our release page.

python3.7 -m pip install <path of the downloaded whl>

​
Amazon Linux 2 Setup 

sudo yum install mesa-libGL -y

Download and install the CentOS 7 .whl image from our release page.

python3.7 -m pip install <path of the downloaded whl>

​
Windows 10/11 Server/Pro Setup Using WSL2

​
Setting up WSL2

The below instructions are for Windows Server 10. More detailed instructions are here.

For Windows 10+11, follow the instructions here.

  • Enable WSL on your machine (Search -> PowerShell -> right-click -> Run as Administrator):
Enable-WindowsOptionalFeature -Online -FeatureName Microsoft-Windows-Subsystem-Linux
Enable-WindowsOptionalFeature -Online -FeatureName VirtualMachinePlatform
  • Reboot your machine.
  • Check that WSL is enabled using the command:
Get-WindowsOptionalFeature -Online -FeatureName Microsoft-Windows-Subsystem-Linux
  • Download Ubuntu 22.04 from https://aka.ms/wslubuntu2204.
  • After the download, run PowerShell as admin, go to your download folder (e.g., C:\Users\YourName\Downloads):
cd C:\Users\YourName\Downloads
Expand-Archive .\Ubuntu_2204.zip .\Ubuntu_2204
cd .\Ubuntu_2204\
.\ubuntu2204.exe

This will take a few minutes. You will see an output like:

Please create a default UNIX user account. The username does not need to match your Windows username.
Enter new UNIX username: your_username
Enter new UNIX password: ********
Retype new UNIX password: ********
passwd: password updated successfully
Installation successful!

​
Pip Package Setup

This is the recommended installation method for all Mac, Ubuntu 18-20, Debian 10, and Windows Server 10.

python3.9 -m pip install -U pip
python3.9 -m pip install fastdup

​
Docker

​
Pull from Docker Hub

docker pull karpadoni/fastdup-ubuntu-20.04

​
Build Your Own Docker

docker build -f Dockerfile -t fastdup-ubuntu .

​
Common Installation Issues and Their Solutions

​
Error: fastdup-0.39-cp38-cp38-manylinux_2_31_x86_64.whl is not a supported wheel on this platform

  • Ensure you are on Ubuntu 20.04 or 18.04 (via lsb_release -r) or Mac M1 Big Sur/Mac Intel Mojave (via sw_vers).
  • Ensure you are using the correct Python version (e.g., Python 3.8).
  • Update pip: python3.8 -m pip install -U pip.
  • Install using python3.8 -m pip install ... instead of pip install ....