Microsoft/pai

1 Release published by 1 person

• Published v0.7.1 v0.7.1: August 2018 Release Aug 31, 2018

70 Pull requests merged by 15 people

• Merged #1144 refactor paictl.py Sep 3, 2018
• Merged #1256 support adding job/data/script/docker from marketplace Sep 3, 2018
• Merged #1239 rely on docker to rotate logs for watchdog/job_exporter Sep 3, 2018
• Merged #1254 Fix BUG of reusing the authenticated GitHub client. Sep 3, 2018
• Merged #1251 [PAIShare] add yaml editor highlight Sep 3, 2018
• Merged #1250 remove old done file Sep 3, 2018
• Merged #1249 Fix clear in search of marketplace Sep 3, 2018
• Merged #1245 [PAIShare] Fix search API hang error. Sep 3, 2018
• Merged #1246 fix search in marketplace Sep 3, 2018
• Merged #1177 Configuration Storage module Sep 3, 2018
• Merged #1241 Implement marketplace homepage & details page Sep 3, 2018
• Merged #1242 [PAISHARE]Add cursor pointer style and update submit job page style Aug 31, 2018
• Merged #1228 [doc] add faq for private job image / Adjust the order to make web portal as the first choice for job submission at entry page Aug 31, 2018
• Merged #1237 add loading when submit job Aug 31, 2018
• Merged #1143 [doc] deployment add checkout release branch at dev-box Aug 31, 2018
• Merged #1240 [PAIShare] Fix GitHub PAT display error. Aug 31, 2018
• Merged #1221 Add an configuration for etcd's persistent data path. Aug 31, 2018
• Merged #1188 Remove unnecessary volume of docker root dir in pai's service Aug 31, 2018
• Merged #1236 [PAIShare] Fix error of no PAT registered. Aug 31, 2018
• Merged #1238 [PAISHARE]Job message is in the white block and modify submit button disabled function Aug 31, 2018
• Merged #1130 fix tf version Aug 31, 2018
• Merged #1235 Paishare Aug 31, 2018
• Merged #1234 [PAIShare] add loading before recommandation load Aug 31, 2018
• Merged #1232 [PAIShare] Add local cache for GitHub access. Aug 31, 2018
• Merged #1183 Jenkins CI: support multiple slashes in branch name Aug 31, 2018
• Merged #1192 [doc]fix zookeeper metric export port Aug 31, 2018
• Merged #1210 check api resources before install proxy Aug 31, 2018
• Merged #1227 Fix pod keeps retrying `pull image` Aug 31, 2018
• Merged #1224 [Paishare] Upload dockimage handler Aug 31, 2018
• Merged #1229 verify user input and update some UI Aug 31, 2018
• Merged #1140 modify grafana view to keep consistent with yarn Aug 31, 2018
• Merged #1035 Yife/yarn exporter Aug 31, 2018
• Merged #1198 [Paishare] Set/Get Github Pernal Access Token Aug 30, 2018
• Merged #1223 Paishare Aug 30, 2018
• Merged #1219 fix add task error Aug 30, 2018
• Merged #1216 [doc] add log rotation for job log doc Aug 30, 2018
• Merged #1202 Add k8s retry Aug 30, 2018
• Merged #1195 label watchdog:true in cluster-object-model Aug 30, 2018
• Merged #1214 label watchdog:true in cluster-object-model Aug 30, 2018
• Merged #1213 minify grafana config and exclude template files to avoid too large c… Aug 30, 2018
• Merged #1212 fix k8s version to 1.9.9 Aug 30, 2018
• Merged #1206 refine dev-box dockerfile Aug 30, 2018
• Merged #1170 minify grafana config and exclude template files to avoid too large configmap Aug 30, 2018
• Merged #1174 [Fix branch name]Fix the env file path resolving in webportal. Aug 30, 2018
• Merged #1209 service start retry, if the start.sh failed. Aug 30, 2018
• Merged #1181 Disable set virtual clusters of admin Aug 29, 2018
• Merged #1205 [PAIShare] add job suffix to avoid job name dup Aug 29, 2018
• Merged #1197 wait for k8s to be ready Aug 29, 2018
• Merged #1204 Disable jenkins build for branch 'paishare' Aug 29, 2018
• Merged #1167 Zhaoyu/env support Aug 29, 2018
• Merged #1149 Zhaoyu/hdfs access Aug 29, 2018
• Merged #1199 Add service deployment document. Aug 29, 2018
• Merged #1117 bugfix: check nvidia-smi exists before run `nvidia-smi -q -x` Aug 29, 2018
• Merged #1111 faq for user resources limit of vc Aug 29, 2018
• Merged #1182 [doc]add release note link at entry page Aug 29, 2018
• Merged #1171 add alert manager doc Aug 29, 2018
• Merged #1115 [doc] faq How to diagnose job problems through logs Aug 29, 2018
• Merged #1196 fix submit job error Aug 29, 2018
• Merged #1172 retry get_auth_token if token_file empty Aug 29, 2018
• Merged #1187 [PAISHARE]Modify submit job page style and submit button disable Aug 28, 2018
• Merged #1148 Clean k8s data in every jenkins deployment Aug 28, 2018
• Merged #1184 [Launcher]: Support ACL Backward Compatibility Aug 28, 2018
• Merged #1180 Support edit yaml Aug 28, 2018
• Merged #1179 Paishare Aug 28, 2018
• Merged #1168 [PAIShare] add modal for data, docker and script Aug 28, 2018
• Merged #1176 Checkin configuration upload lib. Aug 28, 2018
• Merged #1173 check user login in submit job page Aug 28, 2018
• Merged #1169 Checkin configuration download library. Aug 28, 2018
• Merged #1165 Fix jenkins Aug 28, 2018
• Merged #1164 Add configmap_storage util to configuration storage library Aug 28, 2018

10 Pull requests proposed by 7 people

• Proposed #1201 [faq] Deep learning training based on a large number of small files on Hadoop HDFS problem. Aug 29, 2018
• Proposed #1208 [DON'T MERGE]test only! skip PAI services Aug 30, 2018
• Proposed #1220 Handle UnicodeEncodeError of convert unicode string to ascii string Aug 30, 2018
• Proposed #1222 secure kubelet public api, close http port, add auth to https port Aug 30, 2018
• Proposed #1230 Add support for random docker root dir for kubelet Aug 31, 2018
• Proposed #1247 Add docker executor to help preserve job Sep 3, 2018
• Proposed #1253 [paictl] Add warning for delete operation Sep 3, 2018
• Proposed #1255 [doc] add hdfs access link at job submission doc Sep 3, 2018
• Proposed #1257 accelerate e2e test Sep 3, 2018
• Proposed #1258 [PAIShare] Load upload dockerimage form from json-editor schema Sep 3, 2018

32 Issues closed by 14 people

• Closed #1244 How to load data like code from HDFS to container? Sep 3, 2018
• Closed #1217 [exporter] exporter's log rotation refactor Sep 3, 2018
• Closed #1084 How to solve the problem "Failed to getApplicationProgress from RequestManager"? Sep 3, 2018
• Closed #1225 Using private docker registry cause k8s deployment failure Sep 2, 2018
• Closed #1095 node exporter failed Sep 2, 2018
• Closed #1153 `/paictl.py cluster k8s-bootup -p /cluster-configuration` randomly failed Aug 31, 2018
• Closed #1215 Job submission problem - private docker registry job image Aug 30, 2018
• Closed #1207 how to mount a directory on local machine Aug 30, 2018
• Closed #1121 quick-start is still using k8s 1.9.4 Aug 30, 2018
• Closed #1120 quick-start watchdog can't work Aug 30, 2018
• Closed #826 support Env variables in job level Aug 30, 2018
• Closed #756 Using bash script on dev-box: '/bin/sh: 1: docker: not found' Aug 30, 2018
• Closed #1147 grafana failed to start with too large configmap Aug 30, 2018
• Closed #1166 `paictl.py service delele` hangs on `Unable to retrieve pull secret` Aug 30, 2018
• Closed #1137 admin can not change another admin's VCs Aug 29, 2018
• Closed #1193 Wrong cmd executed in Job container Aug 29, 2018
• Closed #113 Kubernetes may occupy PAI's service port Aug 29, 2018
• Closed #1191 inconsistency between service deployment and service discovery Aug 29, 2018
• Closed #1178 Error when run a task Aug 29, 2018
• Closed #1190 [jenkins] Required context class hudson.FilePath is missing Aug 29, 2018
• Closed #1152 Process waits while deleting services Aug 29, 2018
• Closed #1185 What is the purpose of volume “/var/lib/docker” in node-exporter Aug 29, 2018
• Closed #827 Support master/worker co-exists Aug 28, 2018
• Closed #787 Custom config option for Docker Run Aug 28, 2018
• Closed #795 Duplicated hostname in cluster will lead to k8s install failure Aug 28, 2018
• Closed #813 Single Box System Deployment Problem:The connection to the server 10.4.20.100:8080 was refused Aug 28, 2018
• Closed #592 run job fail if cluster no gpu when skip Hadoop-AI during installation Aug 28, 2018
• Closed #670 System Deployment Aug 28, 2018
• Closed #851 Pylon service failed to start Aug 28, 2018
• Closed #401 Unified error messages in rest-server and web portal Aug 28, 2018
• Closed #269 Add a environment variable to tell user docker "I'm PAI". Aug 28, 2018
• Closed #1175 [watchdog] "python: can't open file '/watchdog.py': [Errno 2] No such file or directory" Aug 28, 2018

10 Issues created by 4 people

• Opened #1252 [portal] getting start of dashboard's doc is not the latest version Sep 3, 2018
• Opened #1248 how to remove the job "cntk-test" Sep 3, 2018
• Opened #1233 hadoop-data-node keeps restarting because: `java.net.BindException: Problem binding to [0.0.0.0:50010]` Aug 31, 2018
• Opened #1231 hangs in ./paictl.py cluster k8s-clean Aug 31, 2018
• Opened #1226 Install drivers-one-shot keeps retrying `pull image`, > x10 slower than manually `docker pull` Aug 30, 2018
• Opened #1211 about job failed Aug 30, 2018
• Opened #1200 do not login unconditionally in docker Aug 29, 2018
• Opened #1194 nodes "10.0.1.6" not found Aug 29, 2018
• Opened #1189 `paictl.py service start ...` failed, because of `Error from server: etcdserver: request timed out` Aug 28, 2018
• Opened #1162 Can we stop to redirect to the job detail page automatically after stopping a job? Aug 27, 2018

32 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• 11 new comments Open #1158 CancelRequest not implemented Aug 30, 2018
• 7 new comments Open #1081 [normalize service deployment]Changed to nodeAffinity Aug 31, 2018
• 6 new comments Open #1159 container still exist after stop job Aug 29, 2018
• 5 new comments Open #1108 [WIP]Fix auto retries when out of memory of user quota. Sep 2, 2018
• 4 new comments Open #1160 50070 port took by api-server connection, 'hadoop-name-node is not ready yet. Please wait for a moment!' Aug 29, 2018
• 4 new comments Open #627 Support kubernetes internal DNS service in k8s-deployment. Aug 30, 2018
• 3 new comments Open #1151 Container [xxx] is running beyond virtual memory limits. Aug 30, 2018
• 2 new comments Open #725 Move user data from etcd to another db Aug 29, 2018
• 2 new comments Open #1135 about:killAllOnCompletedTaskNumber has been obsoleted Aug 30, 2018
• 1 new comment Open #1114 How about rewrite the templates of rest-server with python? Aug 27, 2018
• 1 new comment Open #1134 `hadoop-run` process sleeping cause `paictl.py` hang forever Aug 28, 2018
• 1 new comment Open #834 Not able to see the previous retry from the job view Aug 28, 2018
• 1 new comment Open #729 vulnerable issue: password printed into stdout Aug 28, 2018
• 1 new comment Open #781 Failed create pod sandbox. ! Change docker default config may lead to PAI services failure. Aug 28, 2018
• 1 new comment Open #915 k8s kill pods/containers due to protection machanism Aug 28, 2018
• 1 new comment Open #1037 dev-box can be ended by docker restart Aug 31, 2018
• 1 new comment Open #1088 [Deployment] Secure kubelet public api Aug 31, 2018
• 0 new comments Open #506 limit resource usage for all PAI services. Aug 28, 2018
• 0 new comments Open #604 support user define environment Aug 28, 2018
• 0 new comments Open #456 throttling: limit the api calling rate from a single user Aug 28, 2018
• 0 new comments Open #464 User-confirmation in cleanup_services.py Aug 28, 2018
• 0 new comments Open #406 Pylon should not let user specify arbitrary addresses Aug 28, 2018
• 0 new comments Open #694 some pods' status keep ContainerCreating when deploying Aug 28, 2018
• 0 new comments Open #1018 How to use pai in internet Aug 28, 2018
• 0 new comments Open #818 env parameters are not properly substitute, for example 'PAI_USER_NAME', 'PAI_JOB_NAME' Aug 28, 2018
• 0 new comments Open #843 rest-server error Aug 28, 2018
• 0 new comments Open #284 To be compatible with centos. Or what's more, is it possible to run pai on different os? Aug 28, 2018
• 0 new comments Open #666 drivers-one-shot is not ready yet. Please wait for a moment! Aug 28, 2018
• 0 new comments Open #512 job completes successfully but shown as failed Aug 28, 2018
• 0 new comments Open #829 PAI on Azure can't work with openmind Aug 28, 2018
• 0 new comments Open #1023 [WIP]Web portal: optimize service view Aug 31, 2018
• 0 new comments Open #1150 Enable launcher ACL Sep 3, 2018