Install Solr 5.x

Follow instructions to install Java 8 and Solr 5.5.4. We just need steps 1 and 2

Install Java 8

sudo apt-get install python-software-properties
sudo add-apt-repository ppa:webupd8team/java
sudo apt-get update
sudo apt-get install oracle-java8-installer

Install Solr 5.5.4

cd /tmp  
wget http://mirrors.ukfast.co.uk/sites/ftp.apache.org/lucene/solr/5.5.4/solr-5.5.4.tgz  
tar xzvf solr-5.5.4.tgz solr-5.5.4/bin/install_solr_service.sh --strip-components=2  
sudo bash ./install_solr_service.sh solr-5.5.4.tgz   
ls -l /opt/  
ls -l /opt/solr-5.5.4/  
sudo service solr status

Open port 8983 to incoming traffic in Azure portal (add inbound port)