2017-2 Personal Project
Web Service project: Big Data Analyzer
- Draw Big Data Analyze Graph
- Fast Analysis
- Free Discussion
- Browser
- Internet Explorer
- Microsoft Edge
- Chrome
- Safari
- Mobile
- Sign Up
- Input Data & Analyze Data
- Discussion other people
- AWS
- PHP, HTML, SQL
Figure 1. Flow of big data analyzer
- Top Menu
- Contents
- Creator Information
<!DOCTYPE html>
<html>
<head>
<title>Welcome!</title>
<link rel="stylesheet" type="text/css" href="./css/english.css">
</head>
<body>
<div id="nav">
<!--Top menu-->
</div>
<div>
<!-- contents -->
</div>
<div id="Hyorm">
<!-- Creator Information -->
</div>
</body>
</html>
- Input User Data(.csv)
- Write Article
<form action="../process/register.php" method="POST">
<div class="container">
<!– input Data -->
</div>
</form>
<form id="article" action="../process/write_process.php" method="POST“>
<!– Write Article -->
</form>
- Banner
- Mouseover Menu
<a id="big" href="../app/main.php">
<img src = "../img/banner.png" width="100%" height="35%">
</a>
<a href="../app/main.php">
<img src = "../img/trevel.jpg"
onmouseover="this.src='../img/trevel_hover.jpg’”
onmouseout="this.src='../img/trevel.jpg'" width="48%"
height="23%">
</a>
- multipart/form-data
- textarea
- fileI/O process
<div id="img">
<p id="name">Welcome to Big Data World!</p>
<form action="../process/fileI.php" method="POST“
enctype="multipart/form-data">
<input class="browse" type="file" name="userfile">
</div>
<div>
<textarea name='val' rows="10" cols="40"></textarea>
<input class="submitbtn" type="submit" value="INPUT">
</form>
</div>
- Data Base information
- Count
- Bar Chart
- printData
$sql = "SELECT COLUMN_name, COLUMN_TYPE FROM INFORMATION_SCHEMA.COLUMNS WHERE TABLE_NAME='".$id."'";
$que = "SELECT count(distinct ".$_POST['name'].") FROM ".$id;
$que = "SELECT count(".$_POST['name'].") FROM ".$id;
$sql = "select ";
if($rowPro=="count")$sql .="count(".$row."), ";
else $sql .="".$row.", ";
if($colPro=="count"){
$sql .="count( ";
if($colDed=="dedupNo")$sql .="distinct ".$col.") ";
else $sql .= $col.") ";
}
else {
$sql .= $col." ";
}
$sql .="from ".$id." ";
if($rowDed=="dedupNo")$sql .="group by ".$row." ";
<canvas id="canvas" width="800" height="520"></canvas>
<script type="text/javascript">
var elem = document.getElementById('canvas');
var context = elem.getContext('2d');
context.font = '20px sans-serif'; context.fillStyle = '#000';
context.lineWidth = 1;
getRod();
function drawLine(x1, y1, x2, y2){
context.moveTo(x1, y1); context.lineTo(x2, y2);
}
function getRod(){
context.clearRect(0, 0, canvas.width, canvas.height);
var selectX = "<?=$row?>"; var selectY = "<?=$col?>";
if(selectX=="Empty"){
context.fillText('No Element', 350, 100);
context.closePath(); context.stroke();
}else{
var rowArr = <?=json_encode($rowArr)?>;
var colArr = <?=json_encode($colArr)?>;
var arrNum = '<?=$arrNum?>’; var colNum = '<?=$colNum?>';
var sql = <?=json_encode($sql)?>
context.fillText(sql, 200, 30);
drawLine(80, 450, 80, 50);
drawLine(80, 450, 640, 450);
context.fillText(selectX, 650, 450); context.fillText(selectY, 70, 30);
context.closePath(); context.stroke();
context.fillStyle= '#ab162a’; context.lineWidth = 560/arrNum/5;
if(560/arrNum/5<1)context.lineWidth = 1;
context.beginPath();
var i = 0;
for(i = 0; i < arrNum; i++){
drawLine(120+560/arrNum*i, 450, 120+560/arrNum*i, 400-400*colArr[i]/colNum);
}
context.closePath(); context.stroke();
}
}
</script>
- Data Base Table
$sql = "select count(*) FROM information_schema.columns where table_name='".$id.“’”;
$sql = "SELECT * FROM ".$id."";
function expandTable($id){
html = $id."</td><td>";
return $html;
}
while ($row = mysqli_fetch_row($result)) {
echo "<tr><td>";
for($i = 0; $i<$num ; $i++){
echo expandTable($row[$i]);
}
}
- multipart/form-data
- Create User Name DB
- Delete User Name DB
$sql = "create table `bda`.`".$id."`(".$_POST['val'].")";
$uploaddir = '../data/';
$uploadfile = $uploaddir.basename($_FILES['userfile']['name']);
$fileName = $_FILES['userfile']['name’];
$sql = "LOAD DATA LOCAL INFILE '/var/www/html/data/".$fileName."' INTO TABLE `".$id."` FIELDS TERMINATED BY ','";
$sql = "drop table ".$id."";
Reference: http://php.net/manual/kr/features.file-upload.post-method.php
- Write Answer
- Write Article
if($board == 'Free') $board = "free";
else if($board == 'Credit') $board = "credit";
$sql = "INSERT INTO ".$board." (`title`, `writer`, `text`, `time`) VALUES ('$title','$id','$content', CURRENT_TIMESTAMP)";
$sql = "INSERT INTO answer (`postid`, `type`, `writer`, `text`, `time`) VALUES ('$post_id', '$board', '$id','$content', CURRENT_TIMESTAMP)";
- User’s Data DB
- Signup
ID: VARCHAR(100), NOT NULL, PRIMARY KEY
NAME: VARCHAR(100), NOT NULL
PASSWORD: VARCHAR(100), NOT NULL
BIRTH: INT, NOT NULL
- Credit
postId: INT, NOT NULL, AUTO_INCREMENT, PRIMARY KEY
title: VARCHAR(100), NOT NULL
writer: VARCHAR(100), NOT NULL
text: VARCHAR(50000), NOT NULL
time: FLOAT, NOT NULL
$sql = "create table `bda`.`".$id."`(".$_POST['val'].")";
- free
postId: INT, NOT NULL, AUTO_INCREMENT, PRIMARY KEY
title: VARCHAR(100), NOT NULL
writer: VARCHAR(100), NOT NULL
text: VARCHAR(50000), NOT NULL
time: FLOAT, NOT NULL
- answer
postId: INT, NOT NULL
type: VARCHAR(20), NOT NULL
writer: VARCHAR(100), NOT NULL
text: VARCHAR(5000), NOT NULL
time: FLOAT, NOT NULL
- Instance
- TYPE: t2.micro
- Availability zone: us-west-2a
- AMD ID: ubuntu/images/hvm-ssd/ubuntu-xenial-16.04-amd64-server-20171121.1 (ami-0def3275)
- Inbound:
- HTTP – TCP(Protocol), 80(Port Range), Anywhere(Source)
- SSH – TCP(Protocol), 22(Port Range), Anywhere(Source)
- Install
- Apache/2.4.18 (Ubuntu)
- PHP 7.0.22-0ubuntu0.16.04.1 (cli) (NTS)
- MySQL 5.7.20-0ubuntu0.16.04.1 (Ubuntu)
- PHP
- /etc/php/7.0/apache2/php.ini
- /etc/php/7.0/cli/php.ini
- php.ini
- upload_max_filesize
- post_max_size
- max_execution_time
- max_input_time
- memory_limit
- (post_max_size > upload_max_filesize >= memory_limit)
-TODO
- Main
- Change analyze background by linking with main image.
- Data
- Change input method.
- Analyze
- Added various modeling to data analysis.
- Resolving bin count errors on graph
- World
- Modified to be able to upload images for better discussion.