Skip to content

Conversation

zentol
Copy link
Contributor

@zentol zentol commented Jun 10, 2014

new features:

  • you can now distribute whole directories (this copies all files tracked by listStatus recursively)
  • when distributing single files they can be tagged as executable (automatically checked for local files)

other changes:

  • the name/path scheme was changed to preserve the original name. all files are now stored in a job-specific folder, instead of having a job/identifier specific name.
  • the arguments passed when registering a file are abstracted away in its own data structure, making it easier to expand the DC the future. (there is no reason why one should have to change NepheleJobGraphGenerator or TaskManager for this)
  • reworded/expanded some javadocs, and made it clear that local files can only be used when they are accessible form all workers

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here, you could have also done if(content.isDir() && distPath.endsWith("/")) to save one if statement.
But you don't need to update the PR for that ;)

shortened nested ifs
removed exception swallowing
@StephanEwen
Copy link
Contributor

This is merged in f952638

@zentol zentol closed this Jun 13, 2014
@zentol zentol deleted the dist-cache-exdir branch July 11, 2014 07:42
rmetzger referenced this pull request in rmetzger/flink Jul 13, 2014
Duplicated codes in StreamSink, StreamSource, StreamTask has been
encapsulated into StreamComponentFactory. Test passed. Commented codes
may be removed if no further modification is needed.
StephanEwen referenced this pull request in StephanEwen/flink Jul 13, 2014
Duplicated codes in StreamSink, StreamSource, StreamTask has been
encapsulated into StreamComponentFactory. Test passed. Commented codes
may be removed if no further modification is needed.
StephanEwen referenced this pull request in StephanEwen/flink Jul 14, 2014
StephanEwen referenced this pull request in StephanEwen/flink Aug 18, 2014
tillrohrmann referenced this pull request in tillrohrmann/flink Jan 17, 2015
mxm added a commit to mxm/flink that referenced this pull request Feb 2, 2015
mxm added a commit to mxm/flink that referenced this pull request Feb 2, 2015
mxm added a commit to mxm/flink that referenced this pull request Feb 2, 2015
mxm added a commit to mxm/flink that referenced this pull request Feb 3, 2015
kerberos apache#2

kerberos apache#3

kerberos apache#3

kerberos apache#4

kerberos apache#5

bla

last test

blub

bla

blub

jo

ll

afaf

haha

null

jo

just testing

final?

blub

uiui

haha

jojojo
mxm added a commit to mxm/flink that referenced this pull request Feb 29, 2016
mxm added a commit to mxm/flink that referenced this pull request Feb 29, 2016
fijolekProjects added a commit to fijolekProjects/flink that referenced this pull request Jul 9, 2016
smarthi pushed a commit to smarthi/flink that referenced this pull request Jul 29, 2016
VenturaDelMonte added a commit to VenturaDelMonte/flink that referenced this pull request Sep 29, 2016
VenturaDelMonte added a commit to VenturaDelMonte/flink that referenced this pull request Oct 5, 2016
VenturaDelMonte added a commit to VenturaDelMonte/flink that referenced this pull request Nov 4, 2016
dawidwys referenced this pull request in dawidwys/flink Mar 1, 2017
dawidwys referenced this pull request in dawidwys/flink Mar 1, 2017
aditiverma pushed a commit to aditiverma/flink that referenced this pull request May 28, 2018
added circle to publish internal build
Jiayi-Liao pushed a commit to Jiayi-Liao/flink that referenced this pull request Nov 7, 2018
Watermarks相关单元测试修复
walterddr pushed a commit to walterddr/flink that referenced this pull request Apr 27, 2019
chaojianok added a commit to chaojianok/flink that referenced this pull request Jun 30, 2020
Merge from apache/flink master
XComp referenced this pull request in XComp/flink Jun 28, 2021
rkhachatryan added a commit to rkhachatryan/flink that referenced this pull request Sep 8, 2021
rkhachatryan added a commit to rkhachatryan/flink that referenced this pull request Sep 8, 2021
rkhachatryan added a commit to rkhachatryan/flink that referenced this pull request Sep 16, 2021
chengkaiyang2025 added a commit to chengkaiyang2025/flink-25705 that referenced this pull request May 2, 2022
parent 8d00622
author Chengkai Yang <yangchengkai2022@163.com> 1650023265 +0800
committer Chengkai Yang <yangchengkai2022@163.com> 1651508979 +0800

# This is a combination of 3 commits.
# This is the 1st commit message:

[FLINK-25705][docs]Translate "Metric Reporters" page of "Deployment" in to Chinese.

# This is the commit message apache#2:

[FLINK-25705][docs]Translate "Metric Reporters" page of "Deployment" in to Chinese.

# This is the commit message apache#3:

[FLINK-25705][docs]Translate "Metric Reporters" page of "Deployment" in to Chinese.

# This is the commit message apache#4:

[FLINK-25705][docs]Translate some description in the table of html file.
HuangZhenQiu pushed a commit to HuangZhenQiu/flink that referenced this pull request Sep 20, 2022
yuta-cloud pushed a commit to yuta-cloud/flink-me that referenced this pull request Apr 27, 2023
Switch to shaded guava version to ensure successful builds
cbornet added a commit to cbornet/flink that referenced this pull request Jun 6, 2023
* Fix default database in tests

* Fix default database in tests
morozov pushed a commit to morozov/flink that referenced this pull request Apr 26, 2024
* build using java 11

* ci/cd test run

* scoping run cancels to workflow
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants