sudo wget -O /etc/yum.repos.d/jenkins.repo http://pkg.jenkins-ci.org/redhat/jenkins.repo sudo rpm –import http://pkg.jenkins-ci.org/redhat/jenkins-ci.org.key yum install jenkins ./etc/sysconfig/jenkins : – JENKINS_PORT=”변경” – JENKINS_AJP_PORT=”변경” service jenkins restart
Deep Learning Research Group
Hadoop – Hbase Cluster with Docker on AWS 1. Problems of Hadoop1 – data streaming – map process and reduce process are seperated – job tracker manage all jobs alone (too busy) . cannot manage resource(cpu, memory) effectively – SPOF weakness (name node dies whole system dies) 2. Solution of Hadoop2 – job tracker is […]
If you want to remove all database migration settings and start from zero base you can use “migrate –fake”. Follow the bellow process will helps you to reset your jango database env. [delete migration file] go to your app folder then you will see folder name “migration” delete all the contents inside that folder except […]
1. Check current base size docker info 2. Stop docker sudo service docker stop 3. Backup Image and Container & clear Docker mv /var/lib/docker/image /<someplace> mv /var/lib/docker/containers /<someplace> rm -rf /var/lib/docker 4. Increase the size cd /usr/bin/ sudo docker daemon –storage-opt dm.basesize=50G 4. Restart and check Base Disk sudo service docker start docker info
About Map Reduce Code 1.Ordering with Map Reduce (A) Binary Search we are going to make a map reduce program which return N numbers of keywords from the top rank (ordered by number of appears) Hadoop support beautiful sorting Library which is called PriorityQueue and by calling peek you can get keyword on the […]
Build & Run Example Code 1. download maven – download maven build tool from site using apt-get sudo apt-get install maven 2. get test source code using wget wget https://s3.amazonaws.com/hadoopkr/source.tar.gz 3. build source with mvn cd /home/<user>/source/<where pom.xml> mvn compile 5. upload local file to hadoop hadoop fs -copyFromLocal README.txt / 6. execute on hadoop […]
Get Ubuntu Docker – docker pull ubuntu Start Container docker run -i -p 22 -p 8000:80 -m /data:/data -t <ubuntu> /bin/bash Install Jdk sudo add-apt-repository ppa:openjdk-r/ppa sudo apt-get update sudo apt-get install openjdk-7-jre .bashrc export JAVA_HOME=/usr/lib/jvm/… export CLASSPATH=$JAVA_HOME/lib/*:. export PATH=$PATH:$JAVA_HOME/bin HADOOP 1.2.1 install download hadoop and unpack root@4aa2cda88fcc:/home/kim# wget http://apache.mirror.cdnetworks.com/hadoop/common/hadoop-1.2.1/hadoop-1.2.1.tar.gz root@4aa2cda88fcc:/home/kim# mv ./hadoop-1.2.1.tar.gz /home/user root@4aa2cda88fcc:/home/kim# […]
가. centOS Docker 설치 docker pull centos https://hub.docker.com/_/centos/ 나. Container 연결 centos Docker 를 기본으로 필요한 것들을 설치하고 이미지로 생성하여 개인 Repository 에 등록하는 순서로 진행하고자 한다. docker run -t -i centos 다. 개인 이미지를 만들자 컨테이너에 접속해서 원하는 라이브러리든 환경이든 구성을 한다. 예를 들면 아래와 같은 행위를 말하는 것이다. 지신이 설정하고자 하는 환경을 모두 구성한 후에 […]
처음 AWS EC2 환경을 구성하고 아무것도 없는 상태에서 테스트를 진행하였습니다. AWS – EC2 OS : RedHat 64bit 가. 삭제하기 기존에 설치된 Docker 를 사용하거나, 신규 설치인 경우에는 불필요 yum list installed | grep docker docker-engine.x86_64 1.12.1-1.el7.centos @docker-main-repo sudo yum -y remove docker-engine.x86_64 rm -rf /var/lib/docker 나. 자동설치 sudo yum update curl -fsSL https://get.docker.com/ | sh [trouble shooting when ssh […]
로컬에 있는 내용을 무시하고 git 에서 내려 받기 git fetch –all git reset –hard origin/master 특정 branch 에서 내려받기 git fetch –all git reset –hard origin/some_branch 작업중인 내용을 branch 로 만들고 내려받기 git checkout master git branch (branch name) git fetch –all git reset –hard origin/master