Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

use git submodules #87

Closed
t-vi opened this issue Mar 18, 2019 · 7 comments
Closed

use git submodules #87

t-vi opened this issue Mar 18, 2019 · 7 comments
Assignees

Comments

@t-vi
Copy link

t-vi commented Mar 18, 2019

Would it be possible to use git submodules for ASMJIT?
The downloading during the (PyTorch) build can be a bit hard for me when hacking PyTorch while travelling.
Thanks!

@dskhudia
Copy link
Contributor

I think so. For now, you can download asmjit once and point ASMJIT_SRC_DIR env var to the downloaded source code to avoid downloading with build. Particular git tag we use is in https://github.com/pytorch/FBGEMM/blob/master/cmake/modules/DownloadASMJIT.cmake

@dhpollack
Copy link
Contributor

@t-vi I run into this problem all the time too. I created a pull request. Perhaps you could test it out and let me know if it works for you.

@dskhudia
Copy link
Contributor

@dhpollack Thanks a lot for the pull request. Let me test its impact on Caffe2/Pytorch build.

facebook-github-bot pushed a commit that referenced this issue May 13, 2019
Summary:
I created a pull request for #87.  I also tend to do a lot of hacking without an internet connection and it is nice to have the required library offline.  I also get a cryptic error message when I build pytorch without an internet connection because these modules aren't available.
Pull Request resolved: #95

Reviewed By: jianyuh

Differential Revision: D15299133

Pulled By: dskhudia

fbshipit-source-id: 6cf9ed47482eceee5f0444a8361720e0cfe25a13
@dskhudia
Copy link
Contributor

Update: I had to revert the commit because adding submodules involves one more step so that internal tools work correctly. Will re-commit soon.

@dhpollack
Copy link
Contributor

dhpollack commented May 13, 2019

@dskhudia I also noticed a few other things that I can update before you commit this pr.

  1. I may want to use ${FBGEMM_SOURCE_DIR} instead of ${CMAKE_SOURCE_DIR}, because I'm not sure what the latter is when FBGEMM is a submodule itself.
  2. You may want to consider renaming ${ASMJIT_SRC_DIR} to ${ASMJIT_SOURCE_DIR} to make it consistent with the other variables.

Let me know if you want me to make those changes. I am not sure it matters as both work for me right now.

@dskhudia
Copy link
Contributor

  1. I will change it to FBGEMM_SOURCE_DIR
  2. I remember it being having an issue with ASMJIT's cmake file. So we should keep that.

@dskhudia
Copy link
Contributor

@t-vi and @dhpollack : It's fixed now. Once the pytorch's fbgemm submodule gets updated (should happen soon) to fbgemm's latest commit, pytorch build will not download asmjit at build time.

@dhpollack : Thanks for your PR 👍

@dskhudia dskhudia self-assigned this May 14, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants