title: python 3 and tensorflow on AWS EMR
body: <p>For EMR AWS has tensorflow 1.9 as part of the software stack for release 5.17. I have my own bootstrap script to install python 3.6 and tensorflow 1.9, I took out the tensorflow installation - but it didn't work -- I get on the master node, run <code>python3</code>, I get into my new python 3.6 but there is no tensorflow in my installation. I must have installed a new python, I guess my question is how do I use the native python3 installation with tensorflow on AWS EMR, with spark - and am I lucky enough for that python3 to by 3.6? </p>
  
  <p>This is my bootstrap script:</p>
  
  <pre><code>#!/usr/bin/env bash
  
  sudo yum -y upgrade
  sudo yum -y install git autoconf automake libevent-devel python36.x86_64 python36-pip.noarch python36-devel.x86_64
  
  sudo python36 -m pip install --upgrade pip
  
  sudo python36 -m pip install --upgrade wheel cython
  
  sudo python36 -m pip install py4j jupyter ipython pandas scipy pyyaml scikit-learn ipykernel matplotlib seaborn h5py configobj ujson
  
  echo -e "\n\n" &gt;&gt; ~/.bashrc
  echo 'export PYSPARK_PYTHON=/usr/bin/python36' &gt;&gt; ~/.bashrc
  </code></pre>
  
  <p>I guess I'll try it without a bootstrap script, maybe it will just work?</p>