Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Website]: Redirect existing docs from https://arrow.apache.org/ to https://datafusion.apache.org/ #502

Closed
wants to merge 8 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions Gemfile
Original file line number Diff line number Diff line change
Expand Up @@ -27,4 +27,5 @@ group :jekyll_plugins do
gem "jekyll-feed", "~> 0.6"
gem "jekyll-jupyter-notebook"
gem "jekyll-seo-tag"
gem 'jekyll-redirect-from'
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not really familiar with Jekyll and thus I don't know if this is the right approach or not for creating a redirect 🤔 It seems to work but has lots of repeititon

Ideally I would like to just make a table with old URLs and redirects but I couldn't figure out how to do that

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kou I think you are a Jekyll expert (at least are more knowledgable than I am) -- is this a reasonable way to implement redirects for the arrow-site? Or is there a better / preferred way?

end
32 changes: 32 additions & 0 deletions datafusion.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
---
layout: article
title: Apache DataFusion
description: Link to the Apache Arrow DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: https://datafusion.apache.org/
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Content to show if the redirect above is not followed -->

# Apache (Arrow) DataFusion
[Apache DataFusion](https://datafusion.apache.org/) was formerly a sub project
of Apache Arrow and is now a top level Apache Software Foundation Project.
Please update your links and bookmarks appropriately

29 changes: 29 additions & 0 deletions datafusion/contributor-guide/architecture.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
alamb marked this conversation as resolved.
Show resolved Hide resolved
layout: article
title: Apache DataFusion Redirect
description: Link to the Apache Arrow DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: https://datafusion.apache.org/contributor-guide/architecture.html
redirect_from: datafusion/contributor-guide/architecture.html
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Content to show if the redirect above is not followed -->

Moved to https://datafusion.apache.org/contributor-guide/architecture.html
29 changes: 29 additions & 0 deletions datafusion/contributor-guide/communication.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
layout: article
title: Apache DataFusion Redirect
description: Link to the Apache Arrow DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: https://datafusion.apache.org/contributor-guide/communication.html
redirect_from: datafusion/contributor-guide/communication.html
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Content to show if the redirect above is not followed -->

Moved to https://datafusion.apache.org/contributor-guide/communication.html
29 changes: 29 additions & 0 deletions datafusion/contributor-guide/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
layout: article
title: Apache DataFusion Redirect
description: Link to the Apache Arrow DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: https://datafusion.apache.org/contributor-guide/index.html
redirect_from: datafusion/contributor-guide/index.html
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Content to show if the redirect above is not followed -->

Moved to https://datafusion.apache.org/contributor-guide/index.html
29 changes: 29 additions & 0 deletions datafusion/contributor-guide/quarterly_roadmap.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
layout: article
title: Apache DataFusion Redirect
description: Link to the Apache Arrow DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: https://datafusion.apache.org/contributor-guide/quarterly_roadmap.html
redirect_from: datafusion/contributor-guide/quarterly_roadmap.html
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Content to show if the redirect above is not followed -->

Moved to https://datafusion.apache.org/contributor-guide/quarterly_roadmap.html
29 changes: 29 additions & 0 deletions datafusion/contributor-guide/roadmap.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
layout: article
title: Apache DataFusion Redirect
description: Link to the Apache Arrow DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: https://datafusion.apache.org/contributor-guide/roadmap.html
redirect_from: datafusion/contributor-guide/roadmap.html
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Content to show if the redirect above is not followed -->

Moved to https://datafusion.apache.org/contributor-guide/roadmap.html
29 changes: 29 additions & 0 deletions datafusion/contributor-guide/specification/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
layout: article
title: Apache DataFusion Redirect
description: Link to the Apache Arrow DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: https://datafusion.apache.org/contributor-guide/specification/index.html
redirect_from: datafusion/contributor-guide/specification/index.html
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Content to show if the redirect above is not followed -->

Moved to https://datafusion.apache.org/contributor-guide/specification/index.html
29 changes: 29 additions & 0 deletions datafusion/contributor-guide/specification/invariants.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
layout: article
title: Apache DataFusion Redirect
description: Link to the Apache Arrow DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: https://datafusion.apache.org/contributor-guide/specification/invariants.html
redirect_from: datafusion/contributor-guide/specification/invariants.html
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Content to show if the redirect above is not followed -->

Moved to https://datafusion.apache.org/contributor-guide/specification/invariants.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
---
layout: article
title: Apache DataFusion Redirect
description: Link to the Apache Arrow DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: https://datafusion.apache.org/contributor-guide/specification/output-field-name-semantic.html
redirect_from: datafusion/contributor-guide/specification/output-field-name-semantic.html
---
<!--
{% comment %}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{% endcomment %}
-->

<!-- Content to show if the redirect above is not followed -->

Moved to https://datafusion.apache.org/contributor-guide/specification/output-field-name-semantic.html
95 changes: 95 additions & 0 deletions datafusion/create.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,95 @@
# Creates redirect URLS
Copy link
Contributor Author

@alamb alamb Apr 23, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the script I used to create the content in this PR -- in case anyone is interested

import os


urls = [
"contributor-guide/index.html",
"contributor-guide/architecture.html",
"contributor-guide/quarterly_roadmap.html",
"contributor-guide/specification/index.html",
"contributor-guide/specification/invariants.html",
"contributor-guide/specification/output-field-name-semantic.html",
"contributor-guide/communication.html",
"contributor-guide/roadmap.html",
# "index.html",
"user-guide/example-usage.html",
"user-guide/dataframe.html",
"user-guide/cli/index.html",
"user-guide/cli/datasources.html",
"user-guide/cli/overview.html",
"user-guide/cli/installation.html",
"user-guide/cli/usage.html",
"user-guide/configs.html",
"user-guide/expressions.html",
"user-guide/introduction.html",
"user-guide/faq.html",
"user-guide/sql/select.html",
"user-guide/sql/scalar_functions.html",
"user-guide/sql/index.html",
"user-guide/sql/ddl.html",
"user-guide/sql/subqueries.html",
"user-guide/sql/information_schema.html",
"user-guide/sql/aggregate_functions.html",
"user-guide/sql/data_types.html",
"user-guide/sql/dml.html",
"user-guide/sql/explain.html",
"user-guide/sql/operators.html",
"user-guide/sql/sql_status.html",
"user-guide/sql/write_options.html",
"user-guide/sql/window_functions.html",
"library-user-guide/using-the-dataframe-api.html",
"library-user-guide/using-the-sql-api.html",
"library-user-guide/index.html",
"library-user-guide/profiling.html",
"library-user-guide/custom-table-providers.html",
"library-user-guide/building-logical-plans.html",
"library-user-guide/catalogs.html",
"library-user-guide/adding-udfs.html",
"library-user-guide/extending-operators.html",
"library-user-guide/working-with-exprs.html",
]

for url in urls:
print ("Processing", url)
local_file = os.path.splitext(url)[0]+'.md'
redirect_url = "https://datafusion.apache.org/{}".format(url)
print(" local_file:", local_file)
print(" redirect_url:", redirect_url)
content = """---
layout: article
title: Apache DataFusion Redirect
description: Link to the Apache DataFusion project (formerly a sub project of Apache Arrow)
redirect_to: {redirect_url}
redirect_from: datafusion/{url}
---
<!--
{{% comment %}}
Licensed to the Apache Software Foundation (ASF) under one or more
contributor license agreements. See the NOTICE file distributed with
this work for additional information regarding copyright ownership.
The ASF licenses this file to you under the Apache License, Version 2.0
(the "License"); you may not use this file except in compliance with
the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
{{% endcomment %}}
-->

<!-- Content to show if the redirect above is not followed -->

Moved to {redirect_url}
""".format(redirect_url=redirect_url, url=url)


dirname = os.path.dirname(local_file)
print(" dirname: ", dirname)
if not os.path.exists(dirname):
os.makedirs(dirname)
with open(local_file, "w") as f:
f.write(content)
Loading