# tensorflow-gpu-macosx

**Repository Path**: ksf_admin/tensorflow-gpu-macosx

## Basic Information

- **Project Name**: tensorflow-gpu-macosx
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 1
- **Created**: 2019-03-08
- **Last Updated**: 2020-12-19

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# tensorflow-gpu-macosx

Unoffcial NVIDIA CUDA GPU support version of Google Tensorflow 1.8 for MAC OSX 10.13

**Description:**

    Since Google Tensorflow claimed that tensorflow-gpu no longer supports 
    MAC OSX since 1.2.0 due to the OpenMP issue of clang of Apple,
    I built this unoffcial tensorflow-gpu for MAC OSX so that
    Hackintosh users or Mac users with eGPU can run tensorflow-gpu with CUDA.

**Requirement:**

    1. Must use python3 instead of python2

    2. Must be installed on MAC OSX 10.6+

    3. Must install Nvidia GPU drivers

    4. Must install Nvidia CUDA toolkit 9.1 (if not, you need to re-compile by yourself)

    5. Must install Nvidia CUDA cudnn 7.0 (if not, you need to re-compile by yourself)

    6. Must set up cuda environment (make sure 'nvcc -V' shows the cuda version '9.1')

    7.CUDA compute capability is in [3.0,5.0] (if not, you need to re-compile to get a better performance)

# HOW TO BUILD TENSORFLOW-GPU FOR MAC OSX?

## NOTICE 

1.INSTALL NVIDIA DRIVER

2.INSTALL NVIDIA CUDA TOOLKIT (9.1 OR LATER)

3.INSTALL NVIDIA CUDA CUDNN (7.0 OR LATER)

4.SET UP CUDA ENVIRONMENT (MAKE SURE

    nvcc -V

WORKS AND PRINTS CUDA VERSION)

5.INSTALL XCODE/COMMAND LINE TOOL 9.3+

6.INSTALL HOMEBREW

7.INSTALL COREUTILS USING 

    brew install coreutils

**8.INSTALL LLVM USING**

    brew install llvm
    
**9.INSTALL OPENMP USING** 

    brew install cliutils/apple/libomp

**10.INSTALL BAZEL 0.16.1 FROM GITHUB**
*(https://github.com/bazelbuild/bazel/releases, newer/older version may cause failure)*

12.GIT CLONE TENSORFLOW

    git clone https://github.com/zylo117/tensorflow-gpu-macosx

13.CD TENSORFLOW SOURCE DIR

14.CONFIG(skip this step if your CUDA version is same as mine)

    ./configure
      #Please specify the location of python.: Accept the default option
        #Please input the desired Python library path to use.:  Accept the default option
        #Do you wish to build TensorFlow with Google Cloud Platform support? [Y/n]: n
        #Do you wish to build TensorFlow with Hadoop File System support? [Y/n]: n
        #Do you wish to build TensorFlow with Amazon S3 File System support? [Y/n]: n
        #Do you wish to build TensorFlow with XLA JIT support? [y/N]: n
        #Do you wish to build TensorFlow with GDR support? [y/N]: n
        #Do you wish to build TensorFlow with VERBS support? [y/N]: n
        #Do you wish to build TensorFlow with OpenCL SYCL support? [y/N]: n
        #Do you wish to build TensorFlow with CUDA support? [y/N]: y
        #Please specify the CUDA SDK version you want to use, e.g. 7.0.: 9.1
        #Please specify the location where CUDA 9.1 toolkit is installed.: Accept the default option
        #Please specify the cuDNN version you want to use.: 7
        #Please specify the location where cuDNN 7 library is installed.: Accept the default option
        ##Please specify a list of comma-separated Cuda compute capabilities you want to build with.
        ##You can find the compute capability of your device at: https://developer.nvidia.com/cuda-gpus. (GTX10X0: 6.1, GTX9X0: 5.2)
        #Please note that each additional compute capability significantly increases your build time and binary size.: 6.1,5.2,5.0,3.0
        #Do you want to use clang as CUDA compiler? [y/N]: n
        #Please specify which gcc should be used by nvcc as the host compiler.: Accept the default option
        #Do you wish to build TensorFlow with MPI support? [y/N]: n
        #Please specify optimization flags to use during compilation when bazel option "--config=opt" is specified:  Accept the default option
        #Would you like to interactively configure ./WORKSPACE for Android builds? [y/N]: n

    export CUDA_HOME=/usr/local/cuda
    export DYLD_LIBRARY_PATH=/usr/local/cuda/lib:/usr/local/cuda/extras/CUPTI/lib
    export LD_LIBRARY_PATH=$DYLD_LIBRARY_PATH
    export PATH=$DYLD_LIBRARY_PATH:$PATH

    # bazel clean --expunge # Use this if you failed to compile before.

**15.BUILD**

    bazel build --config=cuda --config=opt --cxxopt="-D_GLIBCXX_USE_CXX11_ABI=0" --action_env PATH --action_env LD_LIBRARY_PATH --action_env DYLD_LIBRARY_PATH //tensorflow/tools/pip_package:build_pip_package

**16.NCCL PATCH**
  
  You can compile NCCL_OPS by yourself (not necessary):

    gcc -c -fPIC ./nccl_patched/nccl_ops.cc -o ./nccl_patched/_nccl_ops.o
    
    gcc ./nccl_patched/_nccl_ops.o -shared -o ./nccl_patched/_nccl_ops.so
  
  Then replace the original nccl lib:

    mv ./bazel-bin/tensorflow/contrib/nccl/python/ops/_nccl_ops.so ./bazel-bin/tensorflow/contrib/nccl/python/ops/_nccl_ops.so.bk

    cp ./nccl_patched/_nccl_ops.so ./bazel-bin/tensorflow/contrib/nccl/python/ops/



16.BUILD PYTHON BINDING USING

    ./bazel-bin/tensorflow/tools/pip_package/build_pip_package/ ./tmp/tensorflow_pkg

17.INSTALL PYTHON WHEEL USING 'pip3 install /tmp/tensorflow_pkg/*.whl'

18.REINSTALL XCODE/COMMAND LINE TOOL 9


**NOTICE**

    This version will not supports multi-cpu/machine training.
    
    It's not like you are gonna need it anyway.

**INSTALL:**

    **Either compile from src through pypi (not recommended)**
        pip3 install tensorflow-gpu-macosx
    **or install from relese (the easiest way)**
        pip3 install *.whl