Our client wanted to setup the cloudera data science workbench in on-prem however existing infrastructure is don't have support for redhat 7.2 build which is main prerequisite for cds. due to that our client decided to move the cloudera manager and data science workbench setup in AWS cloud.
I will post another blog on how to install the cloudera manager using CDS and cloudera data science workbench in AWS. In this blog i will share on , how we setup the cloudera director in AWS cloud.
Cloudera director is nothing but provide UI and command line interface to dynamically create Cloudera manager environments and spin/scale cloudera clusters dynamically in Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure by just providing how many instances we want for master/worker and gateway.
we have already crated VPC/ security groups/subnets/redhat 7.2 instance for cloudera director in aws.
Cloudera director installation:
1.Install the jdk1.8
2.install the wget packages if wget command is not working
3.create a Cloudera Director repository by running this command :cd /etc/yum.repos.d/
sudo wget "http://archive.cloudera.com/director/redhat/7/x86_64/director/cloudera-director.repo"
4.Install Cloudera Director server and client by running the following command:sudo yum install cloudera-director-server cloudera-director-client
5.Start the Cloudera Director server by running the following command:sudo service cloudera-director-server start
6.If the RHEL 7 or CentOS firewall is running on the EC2 instance where you have installed Cloudera Director, disable and stop the firewall with the following commands:sudo systemctl disable firewalld
sudo systemctl stop firewalld
Once the server is started, it will fail by default, because the backend metastore needs to be configured.
Edit the property file under /etc/cloudera-director-server/application.properties
I will post another blog on how to install the cloudera manager using CDS and cloudera data science workbench in AWS. In this blog i will share on , how we setup the cloudera director in AWS cloud.
Cloudera director is nothing but provide UI and command line interface to dynamically create Cloudera manager environments and spin/scale cloudera clusters dynamically in Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure by just providing how many instances we want for master/worker and gateway.
we have already crated VPC/ security groups/subnets/redhat 7.2 instance for cloudera director in aws.
Cloudera director installation:
1.Install the jdk1.8
2.install the wget packages if wget command is not working
3.create a Cloudera Director repository by running this command :cd /etc/yum.repos.d/
sudo wget "http://archive.cloudera.com/director/redhat/7/x86_64/director/cloudera-director.repo"
4.Install Cloudera Director server and client by running the following command:sudo yum install cloudera-director-server cloudera-director-client
5.Start the Cloudera Director server by running the following command:sudo service cloudera-director-server start
6.If the RHEL 7 or CentOS firewall is running on the EC2 instance where you have installed Cloudera Director, disable and stop the firewall with the following commands:sudo systemctl disable firewalld
sudo systemctl stop firewalld
Once the server is started, it will fail by default, because the backend metastore needs to be configured.
Edit the property file under /etc/cloudera-director-server/application.properties
No comments:
Post a Comment