- Demo
- Start single node CookIM in docker
- Start multiple nodes CookIM in docker compose
- Manual install prerequisites
- How to run
- Architecture
###Demo
$ sudo docker pull cookeem/cookim$ sudo docker run -d -p 8080:8080 cookeem/cookimBrowser to access:
If use want to modify HTTP port to 18080, just use the command below:
$ sudo docker run -d -p 18080:8080 cookeem/cookimRun command below to obtain container ID
$ sudo docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
9c353289cf37 cookeem/cookim "/root/cookim/entry.s" 4 seconds ago Up 2 seconds 0.0.0.0:8080->8080/tcp stoic_borg
Run command below to debug container
$ sudo docker exec -ti #CONTAINER ID# /bin/bashRun command below to stop container and remove container already exited
$ sudo docker stop #CONTAINER ID#
$ sudo docker rm #CONTAINER ID#Change into CookIM directory, run command below, start multiple nodes CookIM servers in docker compose mode. This way will start 3 container: mongodb, cookim1 and cookim2
$ sudo docker-compose up -d
Creating docker_mongodb_1
Creating docker_cookim1_1
Creating docker_cookim2_1After run docker compose, use different browser to access the URLs below to connect to cookim1 and cookim2
You can add config in docker-compose.yml (in CookIM directory) to add CookIM server nodes, this example show how to add cookim3 in docker compose:
cookim3:
image: cookeem/cookim-cluster
volumes:
- /tmp:/root/cookim/upload
environment:
HOST_NAME: "cookim3"
WEB_PORT: "8080"
AKKA_PORT: "2551"
SEED_NODES: "cookim1:2551"
ports:
- "8082:8080"
depends_on:
- mongodb
- cookim1$ sudo docker-compose stop
$ sudo docker-compose rmDownload JDK8 binary, download URL is here:
http://www.oracle.com/technetwork/java/javase/downloads/index.htmlDownload binary file, the URL like this:
$ wget http://download.oracle.com/otn-pub/java/jdk/8u111-b14/jdk-8u111-linux-x64.tar.gzExtract the compressed file in any directory you want:
$ tar zxvf jdk-8u111-linux-x64.tar.gzConfig the environment path variable, add config below at the end of /etc/profile:
$ sudo vi /etc/profile
export JAVA_HOME=<Your java binary directory>
export CLASSPATH=$JAVA_HOME/lib/tools.jar
export PATH=$JAVA_HOME/bin:$PATHOpen a new terminal to make environment variable available, run command below to check install correct or not:
$ java -version
java version "1.8.0_65"
Java(TM) SE Runtime Environment (build 1.8.0_65-b17)
Java HotSpot(TM) 64-Bit Server VM (build 25.65-b01, mixed mode)Download Scala 2.11 binary, download URL is here:
http://scala-lang.org/download/all.htmlDownload binary file, the URL like this:
$ wget http://downloads.lightbend.com/scala/2.11.8/scala-2.11.8.tgzExtract the compressed file in any directory you want:
$ tar zxvf scala-2.11.8.tgzConfig the environment path variable, add config below at the end of /etc/profile:
$ sudo vi /etc/profile
export SCALA_HOME=<Your scala binary directory>
export PATH=$PATH:$SCALA_HOME/binOpen a new terminal to make environment variable available, run command below to check install correct or not:
$ scala
Welcome to Scala 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_65).
Type in expressions for evaluation. Or try :help.
scala> Download SBT 0.13.13 binary, download URL is here:
http://www.scala-sbt.org/download.htmlDownload binary file, the URL like this:
$ wget https://dl.bintray.com/sbt/native-packages/sbt/0.13.13/sbt-0.13.13.tgzExtract the compressed file in any directory you want:
$ tar zxvf sbt-0.13.13.tgzConfig the environment path variable, add config below at the end of /etc/profile:
$ sudo vi /etc/profile
export SBT_HOME=<Your sbt binary directory>
export PATH=$PATH:SBT_HOME/binOpen a new terminal to make environment variable available, run command below to check install correct or not:
$ sbt
[info] Set current project to cookeem (in build file:/Users/cookeem/)
Download MongoDB 3+ binary, download URL is here:
https://www.mongodb.com/download-center?jmp=nav#communityNotice: 3.4.x MongoDB has unfixed bug in CookIM, please do not use this version, we recommend to use 3.2.11
Download binary file, the URL like this:
$ wget https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-amazon-3.2.9.tgzExtract the compressed file in any directory you want:
$ tar zxvf mongodb-linux-x86_64-amazon-3.2.9.tgzConfig the environment path variable, add config below at the end of /etc/profile:
$ sudo vi /etc/profile
export MONGODB_HOME=<Your mongoDB binary directory>
export PATH=$PATH:MONGODB_HOME/binCreate mongodb database file directory, mongodb use /data/db as default database file directory
$ sudo mkdir -p /data/dbOpen a new terminal to make environment variable available, run command below to check install correct or not.
By default mongodb listen port 27017
$ mongod
2016-12-06T17:24:06.268+0800 I CONTROL [initandlisten] MongoDB starting : pid=2854 port=27017 dbpath=/data/db 64-bit host=cookeemMac.local
2016-12-06T17:24:06.268+0800 I CONTROL [initandlisten] db version v3.2.9
2016-12-06T17:24:06.268+0800 I CONTROL [initandlisten] git version: 22ec9e93b40c85fc7cae7d56e7d6a02fd811088c
2016-12-06T17:24:06.269+0800 I CONTROL [initandlisten] OpenSSL version: OpenSSL 0.9.8zh 14 Jan 2016
2016-12-06T17:24:06.269+0800 I CONTROL [initandlisten] allocator: system
2016-12-06T17:24:06.269+0800 I CONTROL [initandlisten] modules: none
2016-12-06T17:24:06.269+0800 I CONTROL [initandlisten] build environment:
2016-12-06T17:24:06.269+0800 I CONTROL [initandlisten] distarch: x86_64
2016-12-06T17:24:06.269+0800 I CONTROL [initandlisten] target_arch: x86_64
2016-12-06T17:24:06.269+0800 I CONTROL [initandlisten] options: {}
2016-12-06T17:24:06.270+0800 I - [initandlisten] Detected data files in /data/db created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
2016-12-06T17:24:06.270+0800 I STORAGE [initandlisten] wiredtiger_open config: create,cache_size=9G,session_max=20000,eviction=(threads_max=4),config_base=false,statistics=(fast),log=(enabled=true,archive=true,path=journal,compressor=snappy),file_manager=(close_idle_time=100000),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
2016-12-06T17:24:07.639+0800 I CONTROL [initandlisten]
2016-12-06T17:24:07.639+0800 I CONTROL [initandlisten] ** WARNING: soft rlimits too low. Number of files is 256, should be at least 1000
2016-12-06T17:24:07.701+0800 I NETWORK [HostnameCanonicalizationWorker] Starting hostname canonicalization worker
2016-12-06T17:24:07.701+0800 I FTDC [initandlisten] Initializing full-time diagnostic data capture with directory '/data/db/diagnostic.data'
2016-12-06T17:24:07.737+0800 I NETWORK [initandlisten] waiting for connections on port 27017git clone https://github.com/cookeem/CookIM.git
cd CookIM$ mongod &Open another terminal, back to CookIM directory, run command below to download sbt dependencies, this will spend couples minutes
$ cd ..
$ sbt consoleIf use sbt to download dependencies is too slow, you can use the dependencies we prepared for you locate in libs directory
There are two ways to start CookIM server: sbt and java
a. sbt way: change to CookIM directory, use sbt and sbt dependcies to start CookIM server:
$ cd #CookIM directory#
$ sbt "run-main com.cookeem.chat.CookIM -h localhost -w 8080 -a 2551 -s localhost:2551"b. java way: change to CookIM directory, use java and prepared jar libs to start CookIM server:
$ cd #CookIM directory#
$ java -classpath "libs/*" com.cookeem.chat.CookIM -h localhost -w 8080 -a 2551 -s localhost:2551Command above has start a web server listen port 8080 and akka system listen port 2551
Parameters:
-a,--akka-port akka cluster node port
-h,--host-name current web service external host name
-n,--nat is nat network or in docker(docker mode must set)
-s,--seed-nodes akka cluster seed nodes, seperate with comma, example:
localhost:2551,localhost:2552
Open another terminal, start another CookIM server to test message communication between servers:
a. sbt way: change to CookIM directory, use sbt and sbt dependcies to start CookIM server:
$ cd #CookIM directory#
$ sbt "run-main com.cookeem.chat.CookIM -h localhost -w 8081 -a 2552 -s localhost:2551"b. java way: change to CookIM directory, use java and prepared jar libs to start CookIM server:
$ cd #CookIM directory#
$ java -classpath "libs/*" com.cookeem.chat.CookIM -h localhost -w 8081 -a 2552 -s localhost:2551Command above has start a web server listen port 8081 and akka system listen port 2552
**CookIM server make from 3 parts: **
- akka http: provide web service, browser connect distributed chat servers by websocket
- akka stream: akka http receive websocket message (websocket message include TextMessage and BinaryMessage), then send message to chatService by akka stream way, websocket message include JWT(Javascript web token), if JWT verify failure, chatService stream will return reject message; if JWT verify success, chatService stream will send message to ChatSessionActor
- akka cluster：akka stream send websocket message to akka cluster ChatSessionActor, ChatSessionActor use DistributedPubSub to subscribe and publish message in akka cluster. When user online session, it will subscribe the session; when user send message in session, it will publish message in akka cluster, the actors who subscribe the session will receive the publish message
- When akka http receive messsage from websocket, it will send message to chatService flow, here we use akka stream graph:
- Websocket message body include JWT, flowFromWS use to receive websocket message and decode JWT;
- When JWT verify failure, it will broadcast to filterFailure to filter to fail message; When JWT verify success, it will broadcast to filterSuccess to filter to success message;
- When akka stream created, builder.materializedValue will send message to connectedWs, connectedWs convert message receive to UserOnline message, then send to chatSinkActor finally send to ChatSessionActor;
- chatActorSink send message to chatSessionActor, when akka stream closed if will send UserOffline message to down stream;
- chatSource receive message back from ChatSessionActor, then send message back to flowAcceptBack;
- flowAcceptBack will let the websocket connection keepAlive;
- flowReject and flowAcceptBack messages finally send to flowBackWs, flowBackWs convert messages to websocket format then send back to users;
- users: users table
*login (login email)
nickname (nickname)
password (password SHA1)
gender (gender: unknow:0, boy:1, girl:2)
avatar (avatar abs path, example: /upload/avatar/201610/26/xxxx.JPG)
lastLogin (last login timestamp)
loginCount (login counts)
sessionsStatus (user joined sessions status)
[{sessionid: session id, newCount: unread message count in this session}]
friends (user's friends list: [friends uid])
dateline (register timestamp)
- sessions: sessions table
*createuid (creator uid)
*ouid (receiver uid, when session type is private available)
sessionIcon (session icon, when session type is group available)
sessionType (session type: 0:private, 1:group)
publicType (public type: 0:not public, 1:public)
sessionName (session name)
dateline (created timestamp)
usersStatus (users who joined this session status)
[{uid: uid, online: (true, false)}]
lastMsgid (last message id)
lastUpdate (last update timestamp)
- messages: messages tables
*uid (send user uid)
*sessionid (relative session id)
msgType (message type)
content (message content)
fileInfo (file information)
{
filePath
fileName
fileType
fileSize
fileThumb
}
*dateline (created timestamp)
- onlines: online users table
*uid (online user id)
dateline (last update timestamp)
- notifications: receive notifications table
noticeType (notification type: "joinFriend", "removeFriend", "inviteSession")
senduid (send user id)
*recvuid (receive user id)
sessionid (relative session id)
isRead (notification is read: 0:not read, 1:already read)
dateline (created timestamp)
There are two websocket channel: ws-push and ws-chat
ws-push send sessions new message to users, when user not online the session, they still can receive which sessions has new messages
/ws-push channel
up message, use to subscribe push message:
{ userToken: "xxx" }
down message:
acceptMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "accept", content: "xxx", dateline: "xxx" }
rejectMsg: { uid: "", nickname: "", avatar: "", sessionid: "", sessionName: "", sessionIcon: "", msgType: "reject", content: "xxx", dateline: "xxx" }
keepAlive: { uid: "", nickname: "", avatar: "", sessionid: "", sessionName: "", sessionIcon: "", msgType: "keepalive", content: "", dateline: "xxx" }
textMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "text", content: "xxx", dateline: "xxx" }
fileMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "file", fileName: "xxx", fileType: "xxx", fileid: "xxx", thumbid: "xxx", dateline: "xxx" }
onlineMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "online", content: "xxx", dateline: "xxx" }
offlineMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "offline", content: "xxx", dateline: "xxx" }
joinSessionMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "join", content: "xxx", dateline: "xxx" }
leaveSessionMsg:{ uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "leave", content: "xxx", dateline: "xxx" }
noticeMsg: { uid: "", nickname: "", avatar: "", sessionid: "", sessionName: "xxx", sessionIcon: "xxx", msgType: "system", content: "xxx", dateline: "xxx" }
message push to browser:
pushMsg: {
uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "xxx",
content: "xxx", fileName: "xxx", fileType: "xxx", fileid: "xxx", thumbid: "xxx",
dateline: "xxx"
}
ws-chat is session chat channel, user send and receive session messages in this channel
/ws-chat channel
up message:
onlineMsg: { userToken: "xxx", sessionToken: "xxx", msgType:"online", content:"" }
textMsg: { userToken: "xxx", sessionToken: "xxx", msgType:"text", content:"xxx" }
fileMsg: { userToken: "xxx", sessionToken: "xxx", msgType:"file", fileName:"xxx", fileSize: 999, fileType: "xxx" }<#BinaryInfo#>binary_file_array_buffer
down message:
rejectMsg: { uid: "", nickname: "", avatar: "", sessionid: "", sessionName: "", sessionIcon: "", msgType: "reject", content: "xxx", dateline: "xxx" }
keepAlive: { uid: "", nickname: "", avatar: "", sessionid: "", sessionName: "", sessionIcon: "", msgType: "keepalive", content: "", dateline: "xxx" }
textMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "text", content: "xxx", dateline: "xxx" }
fileMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "file", fileName: "xxx", fileType: "xxx", fileid: "xxx", thumbid: "xxx", dateline: "xxx" }
onlineMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "online", content: "xxx", dateline: "xxx" }
offlineMsg: { uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "offline", content: "xxx", dateline: "xxx" }
joinSessionMsg:{ uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "join", content: "xxx", dateline: "xxx" }
leaveSessionMsg:{ uid: "xxx", nickname: "xxx", avatar: "xxx", sessionid: "xxx", sessionName: "xxx", sessionIcon: "xxx", msgType: "leave", content: "xxx", dateline: "xxx" }
noticeMsg: { uid: "", nickname: "", avatar: "", sessionid: "", sessionName: "xxx", sessionIcon: "xxx", msgType: "system", content: "xxx", dateline: "xxx" }
message push to browser:
chatMsg: {
uid: "xxx", nickname: "xxx", avatar: "xxx", msgType: "xxx",
content: "xxx", fileName: "xxx", fileType: "xxx", fileid: "xxx", thumbid: "xxx",
dateline: "xxx"
}