Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue PRs changing toolchain over to jinja2 compiler syntax #162

Closed
CJ-Wright opened this issue May 30, 2018 · 11 comments
Closed

Issue PRs changing toolchain over to jinja2 compiler syntax #162

CJ-Wright opened this issue May 30, 2018 · 11 comments
Assignees

Comments

@CJ-Wright
Copy link
Member

As a prelude to #44 it may be helpful to first issue a bunch of PRs into recipes currently using the toolchain syntax to move them over to the compiler syntax. Note that this will not move them over to the new compilers, the new syntax does the same thing as toolchain under the hood (I think? @msarahan?). This is needed for the new to the new compilers.

I think the main issues here are:

  1. Flagging everything that uses toolchain (not particularly hard)
  2. Figuring out what compilers a package needs. toolchain was an omnibus system everything was under toolchain (c, c++, fortran, etc.). The new syntax is more specific and specifies the exact compiler needed. One approach could be to get the code from the tarball and inspect the extensions of all the code? I don't know how reliable that would be, but it might be a good first guess.
@djsutherland
Copy link
Contributor

Related: conda-forge/conda-smithy#781

@CJ-Wright
Copy link
Member Author

CJ-Wright commented May 30, 2018

Perfect, maybe this issue is just "have the bot crawl through all toolchain recipes and use @isuruf's awesome tool to fix everything".

@jakirkham
Copy link
Contributor

This is really a question of whether we want transient migration scripts as part of the bot. While the bot is a very cool thing that could push such changes with, wouldn't want to unnecessarily burden the bot with things needed for such scripts. Ultimately think it is up to you to make that decision.

@justcalamari justcalamari self-assigned this May 31, 2018
@justcalamari justcalamari added this to the First Evaluation milestone May 31, 2018
@scopatz
Copy link
Contributor

scopatz commented Jun 1, 2018

I think we have run into the migration issue (or "rebuild-the-world") a couple of times with conda-forge. The bot seems like a good place to put this capability and to manage these kinds of issues in the future.

@isuruf
Copy link
Member

isuruf commented Jun 3, 2018

It would be hellpful to know how many recipes need to be rebuilt. #44 (comment) gives all descendants of toolchain, but we only need those recipes with toolchain as a build dep.

@CJ-Wright
Copy link
Member Author

This is in progress, we need to get #197 in, manually fix the graph, and then restart the bot and we should be good to go.

@CJ-Wright
Copy link
Member Author

I think this is done!

@scopatz
Copy link
Contributor

scopatz commented Jun 26, 2018

I think there are still some PRs out there that have failed to build under the new syntax

@isuruf
Copy link
Member

isuruf commented Jun 26, 2018

I don't think all recipes have been PRed yet. #204

@justcalamari
Copy link
Contributor

Running

import networkx as nx
from conda_forge_tick.migrators import Compiler
g = nx.read_gpickle('graph.pkl')
c = Compiler()
count = 0
for node, attrs in g.node.items():
    if not c.filter(attrs):
        count += 1
print(count)

returns 263. So it looks like there are still 263 recipes to go.

@CJ-Wright why did you think it was done?

@CJ-Wright
Copy link
Member Author

(I closed this because we are PRing things, not because all the PRs have be done)
I have 467 left to do from the travis output.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants