A. Install packages [python 2.7] yum install httpd yum install httpd-devel yum install python-pip pip install django yum install mod_wsgi # case of python 2.7 [python 3.X] yum install pcre-devel wget http://mirrors.koehn.com/apache//httpd/httpd-2.4.23.tar.gz tar xvzf httpd-2.4.23.tar.gz configure make install download site : https://github.com/GrahamDumpleton/mod_wsgi/releases wget https://github.com/GrahamDumpleton/mod_wsgi/archive/4.5.7.tar.gz tar xvzf 4.5.7.tar.gz cd /<extract path> ./configure –with-apxs=/usr/local/apache2/bin/apxs make install B. Create Django Project django-admin […]
sudo wget -O /etc/yum.repos.d/jenkins.repo http://pkg.jenkins-ci.org/redhat/jenkins.repo sudo rpm –import http://pkg.jenkins-ci.org/redhat/jenkins-ci.org.key yum install jenkins ./etc/sysconfig/jenkins : – JENKINS_PORT=”변경” – JENKINS_AJP_PORT=”변경” service jenkins restart
Hadoop – Hbase Cluster with Docker on AWS 1. Problems of Hadoop1 – data streaming – map process and reduce process are seperated – job tracker manage all jobs alone (too busy) . cannot manage resource(cpu, memory) effectively – SPOF weakness (name node dies whole system dies) 2. Solution of Hadoop2 – job tracker is […]
If you want to remove all database migration settings and start from zero base you can use “migrate –fake”. Follow the bellow process will helps you to reset your jango database env. [delete migration file] go to your app folder then you will see folder name “migration” delete all the contents inside that folder except […]
1. Check current base size docker info 2. Stop docker sudo service docker stop 3. Backup Image and Container & clear Docker mv /var/lib/docker/image /<someplace> mv /var/lib/docker/containers /<someplace> rm -rf /var/lib/docker 4. Increase the size cd /usr/bin/ sudo docker daemon –storage-opt dm.basesize=50G 4. Restart and check Base Disk sudo service docker start docker info
About Map Reduce Code 1.Ordering with Map Reduce (A) Binary Search we are going to make a map reduce program which return N numbers of keywords from the top rank (ordered by number of appears) Hadoop support beautiful sorting Library which is called PriorityQueue and by calling peek you can get keyword on the […]
Build & Run Example Code 1. download maven – download maven build tool from site using apt-get sudo apt-get install maven 2. get test source code using wget wget https://s3.amazonaws.com/hadoopkr/source.tar.gz 3. build source with mvn cd /home/<user>/source/<where pom.xml> mvn compile 5. upload local file to hadoop hadoop fs -copyFromLocal README.txt / 6. execute on hadoop […]
Get Ubuntu Docker – docker pull ubuntu Start Container docker run -i -p 22 -p 8000:80 -m /data:/data -t <ubuntu> /bin/bash Install Jdk sudo add-apt-repository ppa:openjdk-r/ppa sudo apt-get update sudo apt-get install openjdk-7-jre .bashrc export JAVA_HOME=/usr/lib/jvm/… export CLASSPATH=$JAVA_HOME/lib/*:. export PATH=$PATH:$JAVA_HOME/bin HADOOP 1.2.1 install download hadoop and unpack root@4aa2cda88fcc:/home/kim# wget http://apache.mirror.cdnetworks.com/hadoop/common/hadoop-1.2.1/hadoop-1.2.1.tar.gz root@4aa2cda88fcc:/home/kim# mv ./hadoop-1.2.1.tar.gz /home/user root@4aa2cda88fcc:/home/kim# […]