Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问一下paddlenlp有dockerfile吗 #3751

Closed
dahu1 opened this issue Nov 14, 2022 · 10 comments
Closed

请问一下paddlenlp有dockerfile吗 #3751

dahu1 opened this issue Nov 14, 2022 · 10 comments
Labels
question Further information is requested stale

Comments

@dahu1
Copy link

dahu1 commented Nov 14, 2022

请提出你的问题

没找到paddlenlp的dockerfile,可以容器使用paddlenlp吗

@dahu1 dahu1 added the question Further information is requested label Nov 14, 2022
@dahu1 dahu1 changed the title [请问一下paddlenlp有dockerfile吗]: 请问一下paddlenlp有dockerfile吗 Nov 14, 2022
@wawltor
Copy link
Collaborator

wawltor commented Nov 14, 2022

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/pipelines
这里有些镜像可以拉取

image

@dahu1
Copy link
Author

dahu1 commented Nov 14, 2022

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/pipelines 这里有些镜像可以拉取

image

如果想要自己编译镜像呢,有 dockerfile 吗?

@w5688414
Copy link
Contributor

w5688414 commented Nov 14, 2022

Hi, @dahu1 , 目前paddlenlp的镜像是拉取的官网的docker镜像编译而来,如果需要编译自己的镜像,请拉取官网的Paddle镜像做少许修改后,使用docker build打包,打包方法请参考链接https://github.com/PaddlePaddle/PaddleNLP/tree/develop/pipelines/docker

另外,我搜了一下资料,您看看能否从镜像中获取dockerfile:
https://stackoverflow.com/questions/19104847/how-to-generate-a-dockerfile-from-an-image

@dahu1
Copy link
Author

dahu1 commented Nov 14, 2022

Hi, @dahu1 , 目前 paddlenlp 的镜像是拉取的官网的 docker 镜像编译而来,如果需要编译自己的镜像,请拉取官网的 Paddle 镜像做少许修改后,使用 docker build 打包,打包方法请参考链接 https://github.com/PaddlePaddle/PaddleNLP/tree/develop/pipelines/docker

另外,我搜了一下资料,您看看能否从镜像中获取 dockerfile: https://stackoverflow.com/questions/19104847/how-to-generate-a-dockerfile-from-an-image

感谢您的细致讲解,您的两个建议都很有用!

@dahu1 dahu1 closed this as completed Nov 14, 2022
@dahu1 dahu1 reopened this Nov 14, 2022
@dahu1
Copy link
Author

dahu1 commented Nov 14, 2022

Hi, @dahu1 , 目前 paddlenlp 的镜像是拉取的官网的 docker 镜像编译而来,如果需要编译自己的镜像,请拉取官网的 Paddle 镜像做少许修改后,使用 docker build 打包,打包方法请参考链接 https://github.com/PaddlePaddle/PaddleNLP/tree/develop/pipelines/docker

另外,我搜了一下资料,您看看能否从镜像中获取 dockerfile: https://stackoverflow.com/questions/19104847/how-to-generate-a-dockerfile-from-an-image

你好,我看了下这个 pipelines/docker/Dockerfile-GPU,里面还是有from 拉取镜像:
FROM paddlepaddle/paddlenlp:pipelines-1.0-gpu-cuda10.2-cudnn7

有那种原始的dockerfile 吗?因为1.拉取这个镜像特别慢, 2.可以根据dockerfile 自行安装相关的包。

@w5688414
Copy link
Contributor

目前没有提供,paddle的国内镜像都很慢吗?https://github.com/PaddlePaddle/PaddleNLP/tree/develop/pipelines/docker#31-%E5%9F%BA%E7%A1%80%E9%95%9C%E5%83%8F

您需要gpu的docker吗?把这个镜像拉下来要多久?

nvidia-docker run --name pipelines --net host --shm-size 4g -it registry.baidubce.com/paddlepaddle/paddle:2.3.2-gpu-cuda11.2-cudnn8 /bin/bash

@dahu1
Copy link
Author

dahu1 commented Nov 14, 2022

@w5688414 好的,我用的还是Dockerfile-GPU 里的paddlepaddle/paddlenlp:pipelines-1.0-gpu-cuda10.2-cudnn7 ,拉取大概花了40多分钟。
请问这个 镜像版本号以及里面对应的内容在哪看呢?
比如 paddlepaddle/paddlenlp:pipelines-1.0-gpu-cuda10.2-cudnn7 和 registry.baidubce.com/paddlepaddle/paddle:2.3.2-gpu-cuda11.2-cudnn8
该选哪个呢。

@w5688414
Copy link
Contributor

pipelines的镜像是通过paddle镜像打tag得来的,只是加入了pipelines的依赖而已,具体内容参考paddle镜像即可,主要还是paddle官方镜像的一些内容,通过paddle镜像得到pipelines镜像的过程参考:

docker commit pipelines pipelines:1.0-gpu-cuda11.2-cudnn8
docker tag pipelines:1.0-gpu-cuda11.2-cudnn8  paddlepaddle/paddlenlp:pipelines-1.0-gpu-cuda11.2-cudnn8

https://github.com/PaddlePaddle/PaddleNLP/tree/develop/pipelines/docker#32-%E4%B8%80%E9%94%AE%E5%90%AF%E5%8A%A8%E9%95%9C%E5%83%8F

@github-actions
Copy link

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动,被标记为stale。

@github-actions github-actions bot added the stale label Jan 14, 2023
@github-actions
Copy link

This issue was closed because it has been inactive for 14 days since being marked as stale. 当前issue 被标记为stale已有14天,即将关闭。

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Jan 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested stale
Projects
None yet
Development

No branches or pull requests

3 participants