creating hpc feed for new hpc.social community blog!

Signed-off-by: vsoch <vsoch@users.noreply.github.com>
vsoch · Nov 28, 2022 · bad451e · bad451e
1 parent 7e3f9db
commit bad451e
Show file tree

Hide file tree

Showing 28 changed files with 59 additions and 16 deletions.
diff --git a/_posts/2016/2016-11-27-singularity-web.md b/_posts/2016/2016-11-27-singularity-web.md
@@ -1,6 +1,7 @@
 ---
 title: "Containers for Academic Products"
 date: 2016-11-27 3:05:00
+category: hpc
 ---
 
 Why do we do research? Arguably, the products of academia are discoveries and ideas that further the human condition. We want to learn things about the world to satisfy human curiosity and need for innovation, but we also want to learn how to be happier, healthier, and generally maximize the goodness of life experience. For this reason, we give a parcel of our world's resources to people with the sole purpose of producing research in a particular domain. We might call this work the academic product. 

diff --git a/_posts/2016/2016-9-29-singularity-environments.md b/_posts/2016/2016-9-29-singularity-environments.md
@@ -1,6 +1,7 @@
 ---
 title: "Contained Environments for Software for HPC"
 date: 2016-9-29 6:41:00
+category: hpc
 ---
 
 I was recently interested in doing what most research groups do, setting up a computational environment that would contain version controlled software, and easy ways for users in a group to load it. There are several strategies you can take. Let's first talk about those.

diff --git a/_posts/2017/2017-03-19-singularity-nginx.md b/_posts/2017/2017-03-19-singularity-nginx.md
@@ -5,6 +5,7 @@ description: "This post details a simple application that plugs a folder of Sing
 date: 2017-03-19
 comments: true
 keywords: ""
+category: hpc
 ---
 
 I wanted to make a web application that understood containers. As a researcher, or a developer, I want to be able to drop my containers into a folder, and then have the application serve them without any additional work. So I made a proof of concept, <a href="http://www.github.com/vsoch/singularity-nginx" target="_blank">Singularity Nginx</a>:

diff --git a/_posts/2017/2017-04-23-multiprocess.md b/_posts/2017/2017-04-23-multiprocess.md
@@ -5,6 +5,7 @@ description: "Testing different ways to download streaming layers in Python."
 date: 2017-04-23
 comments: true
 keywords: ""
+category: hpc
 ---
 
 Has this ever happened to you? Today I woke up and wanted to know if I could download a file faster. Specifically, this would be for the <a href="https://singularityware.github.io" target="_blank">Singularity</a> back end Python API that does the simple streaming of Docker layers to the user's cache. As a cautionary note, my expertise in "parallel processing" is typically running jobs at scale in a high performance compute (HPC) cluster environment. I'm only aware of Python's <a href="">multiprocessing</a> library

diff --git a/_posts/2018/2018-03-03-deepvariant.md b/_posts/2018/2018-03-03-deepvariant.md
@@ -1,6 +1,7 @@
 ---
 title: "Google Container Registry Metadata 404"
 date: 2018-03-03 9:55:00
+category: hpc
 ---
 
 If Shrek says that happiness is just a tear drop away, I say that insight is just a 404 away. This was the content of a slack message from one of my colleagues that sent my investigatory dinosaur heart into an adventure:

diff --git a/_posts/2018/2018-03-07-deepvariant-200.md b/_posts/2018/2018-03-07-deepvariant-200.md
@@ -1,6 +1,7 @@
 ---
 title: "Google Container Registry Metadata 200"
 date: 2018-03-07 8:30:00
+category: hpc
 ---
 
 If happiness is just a tear drop away, and insight is just a 404 away, then friends are just a blog post away! I wanted to quickly follow up on a <a target="_blank" href="https://vsoch.github.io/2018/deepvariant/">post</a> from a few days ago where I <del> had trouble </del> struggled like a baby penguin to find the configuration metadata from a manifest for the Google Deep Variant container on Google Container Registry.

diff --git a/_posts/2018/2018-05-03-container-diff.md b/_posts/2018/2018-05-03-container-diff.md
@@ -2,6 +2,7 @@
 title: "Container Differences"
 date: 2018-05-03 1:32:00
 toc: false
+category: hpc
 ---
 
 An important aspect of using containers in science is reproducibility, but it's possibly not enough.

diff --git a/_posts/2018/2018-06-16-django-nginx-upload.md b/_posts/2018/2018-06-16-django-nginx-upload.md
@@ -2,6 +2,7 @@
 title: "Large Uploads with Django+Nginx Upload Module"
 date: 2018-06-16 4:24:00
 toc: false
+category: hpc
 ---
 
 Do you ever struggle with something, akin to a blueberry muffin that is slowly being squished

diff --git a/_posts/2018/2018-12-20-image-definition.md b/_posts/2018/2018-12-20-image-definition.md
@@ -2,6 +2,7 @@
 title: "The Ultimate Dockerfile Extraction"
 date: 2018-12-20 7:39:00
 toc: false
+category: hpc
 ---
 
 Before we go into details, here is what I am going to talk about in this post:

diff --git a/_posts/2019/2019-01-07-job-maker.md b/_posts/2019/2019-01-07-job-maker.md
@@ -1,7 +1,7 @@
 ---
 title: "The Job Maker Container"
 date: 2019-01-07 4:40:00
-categories: rse
+categories: [rse, hpc]
 ---
 
 Long ago, in 2017 when I was a younger dinosaur, I created the

diff --git a/_posts/2019/2019-05-12-watchme-decorators.md b/_posts/2019/2019-05-12-watchme-decorators.md
@@ -1,7 +1,7 @@
 ---
 title: "Watchme Process Monitoring"
 date: 2019-05-12 5:30:00
-categories: rse
+categories: [rse, hpc]
 ---
 
 It's always been kind of hard to measure resource usage when you are running

diff --git a/_posts/2019/2019-06-22-exploring-mongo.md b/_posts/2019/2019-06-22-exploring-mongo.md
@@ -1,6 +1,7 @@
 ---
 title: "Exploring MongoDB on HPC"
 date: 2019-06-22 10:34:00
+category: hpc
 ---
 
 This last weekend <a href="https://techcrunch.com/2019/06/16/millions-venmo-transactions-scraped/" target="_blank">it was reported</a> that over 7 million Venmo transactions

diff --git a/_posts/2019/2019-07-28-conferences.md b/_posts/2019/2019-07-28-conferences.md
@@ -1,7 +1,7 @@
 ---
 title: "Remote First Conferences"
 date: 2019-07-28 13:20:00
-categories: rse
+categories: [rse, hpc]
 ---
 
 Let's talk about conferences. When you are new as a graduate student or software engineer

diff --git a/_posts/2021/2021-03-31-national-lab-vs-academia.md b/_posts/2021/2021-03-31-national-lab-vs-academia.md
@@ -1,7 +1,7 @@
 ---
 title: "Working in a National Lab vs. Academia"
 date: 2021-03-31 11:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 Whether you are a graduate student thinking of your first job, or a veteran wondering

diff --git a/_posts/2021/2021-04-26-singularity-hub-archive.md b/_posts/2021/2021-04-26-singularity-hub-archive.md
@@ -1,7 +1,7 @@
 ---
 title: "Singularity Hub Archive"
 date: 2021-03-31 17:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 As of 5:00pm today, April 26th 2021, the Singularity Hub cloud space, including

diff --git a/_posts/2021/2021-05-03-package-popularity.md b/_posts/2021/2021-05-03-package-popularity.md
@@ -1,7 +1,7 @@
 ---
 title: "Package Popularity"
 date: 2021-05-03 17:30:00
-category: rse
+categories: [hpc, rse]
 ---
 
 I got my second vaccine today and arrived home after the end of the work day, so I decided to treat myself to a little fun and finish up a small project I started over the weekend. 

diff --git a/_posts/2021/2021-07-12-chef-autamus.md b/_posts/2021/2021-07-12-chef-autamus.md
@@ -1,7 +1,7 @@
 ---
 title: "Chef Autamus"
 date: 2021-07-12 19:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 > Chef Autamus, at your service!

diff --git a/_posts/2021/2021-09-19-uptodate.md b/_posts/2021/2021-09-19-uptodate.md
@@ -1,7 +1,7 @@
 ---
 title: "Uptodate"
 date: 2021-09-19 08:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 I recently had an itch to scratch - and that itch was writing a library in Go.

diff --git a/_posts/2022/2022-01-07-what-is-hard.md b/_posts/2022/2022-01-07-what-is-hard.md
@@ -1,6 +1,7 @@
 ---
 title: Things that are Hard
 date: 2022-01-07 12:30:00
+category: hpc
 ---
 
 I saw a funny tweet on Twitter the other night - it was someone from a large consumer company sharing

diff --git a/_posts/2022/2022-02-16-paks.md b/_posts/2022/2022-02-16-paks.md
@@ -1,7 +1,7 @@
 ---
 title: Interactive Development Containers
 date: 2022-02-15 12:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 I've recently been interested in developer workflows. Aside from being a developer, I feel

diff --git a/_posts/2022/2022-04-24-rsepedia.md b/_posts/2022/2022-04-24-rsepedia.md
@@ -1,7 +1,7 @@
 ---
 title: "The Research Software Ecosystem"
 date: 2022-04-24 12:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 We recently published <a href="https://openresearchsoftware.metajnl.com/articles/10.5334/jors.359/" target="_blank">the Research Software Encyclopedia</a> and also have added several new parsers for obtaining new data, meaning the total collection

diff --git a/_posts/2022/2022-05-07-pipelib.md b/_posts/2022/2022-05-07-pipelib.md
@@ -1,7 +1,7 @@
 ---
 title: "Pipelib: Simple Library to Parse, Filter, and Sort Things"
 date: 2022-05-07 12:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 In early April I added an "update" command to Singularity Registry HPC (<a href="https://github.com/singularityhub/singularity-hpc/pull/538" target="_blank">see the pull request here</a> and needed to start with a list of docker tags and

diff --git a/_posts/2022/2022-06-19-research-software-registries.md b/_posts/2022/2022-06-19-research-software-registries.md
@@ -1,7 +1,7 @@
 ---
 title: "Research Software Registries"
 date: 2022-06-19 12:15:00
-category: rse
+categories: [rse, hpc]
 ---
 
 This post spurred from some original thinking about <a target="_blank" href="https://rse-ops.github.io/proposals/proposals/drafts/research-software-registry/">research software registries</a>, and my recent discovery of the <a href="https://scicodes.net/" target="_blank">SciCodes Consortium</a>, which I'm excited to find (and a bit surprised I didn't earlier given my experience with research software and registries)! Since I've developed registries and been involved extensively in communities that develop standards and tooling for them, I've naturally been ruminating over ideas for several months, and hoping to find others that are motivated to think about similar things. This is the motivation of this post - to ruminate, share my thinking, and think together about ideas. You can read the content, or listen to the ideas below.

diff --git a/_posts/2022/2022-06-26-ssh-tunnels.md b/_posts/2022/2022-06-26-ssh-tunnels.md
@@ -1,7 +1,7 @@
 ---
 title: SSH Tunnels
 date: 2022-06-26 12:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 Today I want to talk about ssh tunnels. Very abstractly, we would want to use an ssh

diff --git a/_posts/2022/2022-08-04-hpc-apps.md b/_posts/2022/2022-08-04-hpc-apps.md
@@ -1,7 +1,7 @@
 ---
 title: "Tunel: Apps for HPC"
 date: 2022-08-04 12:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 A few months ago I was talking about <a href="https://vsoch.github.io/2022/ssh-tunnels/" target="_blank">ssh tunnels</a>. The reason was because I was looking for a solution to deploy apps (like a Jupyter notebook) onto HPC.

diff --git a/_posts/2022/2022-11-03-containerize-it-baby.md b/_posts/2022/2022-11-03-containerize-it-baby.md
@@ -1,7 +1,7 @@
 ---
 title: "Containerize It, Baby!"
 date: 2022-11-03 08:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 I've just submit my <a href="https://twitter.com/vsoch/status/1588215058009464832" target="_blank">entry</a> to the HPC Guru Elevator Pitch Contest for the Supercomputing 2022 conference!

diff --git a/_posts/2022/2022-11-18-converged-computing.md b/_posts/2022/2022-11-18-converged-computing.md
@@ -1,7 +1,7 @@
 ---
 title: "Converged Computing"
 date: 2022-11-18 08:30:00
-category: rse
+categories: [rse, hpc]
 ---
 
 For many years, there has been a battle between cloud and HPC. The cloud side of the equation says "micro services, cloud native!"

diff --git a/pages/hpc-feed.xml b/pages/hpc-feed.xml
@@ -0,0 +1,32 @@
+---
+layout: null
+permalink: /hpc-feed.xml
+---
+<?xml version="1.0" encoding="UTF-8"?>
+<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
+  <channel>
+    <title>{{ site.title | xml_escape }}</title>
+    <description>{{ site.description | xml_escape }}</description>
+    <link>{{ site.url }}{{ site.baseurl }}/</link>
+    <atom:link href="{{ "/hpc-feed.xml" | prepend: site.baseurl | prepend: site.url }}" rel="self" type="application/rss+xml"/>
+    <pubDate>{{ site.time | date_to_rfc822 }}</pubDate>
+    <lastBuildDate>{{ site.time | date_to_rfc822 }}</lastBuildDate>
+    <generator>Jekyll v{{ jekyll.version }}</generator>
+    {% assign sorted-posts = site.posts | where: "categories","hpc" %}
+    {% for post in sorted-posts limit:10 %}
+      <item>
+        <title>{{ post.title | xml_escape }}</title>
+        <description>{{ post.content | xml_escape }}</description>
+        <pubDate>{{ post.date | date_to_rfc822 }}</pubDate>
+        <link>{{ post.url | prepend: site.baseurl | prepend: site.url }}</link>
+        <guid isPermaLink="true">{{ post.url | prepend: site.baseurl | prepend: site.url }}</guid>
+        {% for tag in post.tags %}
+        <category>{{ tag | xml_escape }}</category>
+        {% endfor %}
+        {% for cat in post.categories %}
+        <category>{{ cat | xml_escape }}</category>
+        {% endfor %}
+      </item>
+    {% endfor %}
+  </channel>
+</rss>