Skip to content

Latest commit

 

History

History
1688 lines (798 loc) · 96.8 KB

bulletin-2022-07-22.md

File metadata and controls

1688 lines (798 loc) · 96.8 KB
Raw

Bulletin for Friday, 22 Jul 2022

7 days digest

Tech at Meta (1)

Julia Evans (1)

ongoing by Tim Bray (1)

The Ably Blog (1)

Netflix TechBlog - Medium (1)

LinkedIn Engineering (1)

frankdenneman.nl (1)

High Scalability (1)

Slack Engineering (1)

The Teleport Blog (1)

The Hacker Factor Blog (1)

Think Fast, Talk Smart: Communication Techniques (1)

Retool blog (1)

Stay SaaSy (1)

allegro.tech (1)

Blog on Tailscale (1)

Timescale Blog (1)

Eli Bendersky's website (1)

Weaveworks (1)

Computer Things (1)

The Technium (1)

Vallified (2)

Towards Data Science - Medium (2)

Microsoft Security Blog (2)

PlanetScale - Blog (2)

Daniel Lemire's blog (2)

Krebs on Security (3)

Google AI Blog (3)

Engineering at Meta (3)

The CircleCI Blog Feed - CircleCI (3)

The Cloudflare Blog (3)

Future (4)

Sentry Blog RSS (4)

Earthly Blog (4)

Metadata (4)

Blog – Hackaday (5)

Simon Willison's Weblog: Blogmarks (5)

Stack Overflow Blog (6)

The Full Feed - All of the Packet Pushers Podcasts (6)

Amazon Science Homepage (6)

Changelog Master Feed (8)

Cloud Blog (20)

Tech at Meta

https://tech.fb.com

Boz to the Future Episode 12: The Future of Meta Accounts and VR with Mark Rabkin

Welcome back for the twelfth episode of Boz to the Future, a monthly podcast from Reality Labs (RL). In today’s episode, our host, Head of RL, and Meta CTO Andrew “Boz” Bosworth is joined by Mark Rabkin, VP of RL. Getting his start at Intel and Google, Rabkin joined Meta nearly 15 years ago—and worked […] The post Boz to the Future Episode 12: The Future of Meta Accounts and VR with Mark Rabkin appeared first on Tech at Meta . (BACK TO TOP)

Julia Evans

http://jvns.ca/atom.xml

What happens when you press a key in your terminal?

I’ve been confused about what’s going on with terminals for a long time. But this past week I was using xterm.js might seem like a New Thing, but it’s really not. In the 70s, computers were expensive. So many employees at an institution would share a single computer, and each person could have their own “terminal” to that computer. For example, here’s a photo of a VT100 terminal from the 70s or 80s.js . This program is very insecure but it’s simple and great for learning. .Syscall( syscall. (BACK TO TOP)

ongoing by Tim Bray

https://www.tbray.org/ongoing/ongoing.atom

Dark Matter Fun

(BACK TO TOP)

The Ably Blog

https://ably.com/

Use Next.js and Vercel to build a link-sharing app using serverless WebSockets

This tutorial explains how to use Next.js and Vercel to build an app with shared live features provided by Ably. (BACK TO TOP)

Netflix TechBlog - Medium

https://netflixtechblog.com

Formulating ‘Out of Memory Kill’ Prediction on the Netflix App as a Machine Learning Problem

by Aryan Mehra with Farnaz Karimdady Sharifabad , Prasanna Vijayanathan , Chaïna Wade , Vishal Sharma and Mike Schassberger Aim and Purpose — Problem Statement The purpose of this article is to give insights into analyzing and predicting “out of memory” or OOM kills on the Netflix App. Unlike strong compute devices, TVs and set top boxes usually have stronger memory constraints. With large data, comes the opportunity to leverage the data for predictive and classification based analysis. (BACK TO TOP)

LinkedIn Engineering

https://engineering.linkedin.com/blog.rss.html

Measuring downstream impact on social networks by using an attribution framework

Co-authors: Qiannan Yin, Derek Koh, and Jenny Wu The network effect in social networks increases the complexity of conducting analysis, as the actions of members have the ability to impact others within the network. For instance, a member posting an article on LinkedIn could result in actions downstream where other members see the post and interact with it by means of liking, commenting, or sharing. (BACK TO TOP)

frankdenneman.nl

https://frankdenneman.nl

Training vs Inference – Memory Consumption by Neural Networks

This article dives deeper into the memory consumption of deep learning neural network architectures. What exactly happens when an input is presented to a neural network, and why do data scientists mainly struggle with out-of-memory errors? Besides Natural Language Processing (NLP), computer vision is one of the most popular applications of deep learning networks. Most […] The post Training vs Inference – Memory Consumption by Neural Networks appeared first on frankdenneman.nl . (BACK TO TOP)

High Scalability

http://highscalability.com/blog/

Sponsored Post: G-Core Labs, Close, Wynter, Pinecone, Kinsta, Bridgecrew, IP2Location, StackHawk, InterviewCamp.io, Educative, Stream, Fauna, Triplebyte

Who's Hiring?  Close is building the sales communication platform of the future and we're looking for a Site Reliability Engineer to help us accomplish that goal. Participate in research surveys, get paid ($90-$180/hr) for your feedback and comments. Super low key commitment, 10-15 mins per survey. Learn more and sign up . DevOps Engineer : At Kinsta , we set out to create the best managed hosting platform in the world. InterviewCamp.io has hours of system design content. Try out their platform. (BACK TO TOP)

Slack Engineering

https://slack.engineering

AutoTransform: Efficient Codebase Modification

Every codebase starts off small and modern. While it’s still small, the team can easily keep it up-to-date with current standards, upgrade libraries, and handle any code hygiene issues that may arise. Updating the API of a framework you built is easy when it’s only called in a handful of places. However, as the codebase […] The post AutoTransform: Efficient Codebase Modification appeared first on Slack Engineering . (BACK TO TOP)

The Teleport Blog

https://goteleport.com/blog/

Secure Amazon EKS Access with Teleport.

Learn how to secure Amazon EKS access with Teleport. (BACK TO TOP)

The Hacker Factor Blog

https://www.hackerfactor.com/blog/

In a Galaxy Far Far Away

Over the last week, FotoForensics has been absolutely inundated with hundreds of copies of the same picture: the deep field view of galaxy cluster SMACS 0723. Seriously, we received 257 copies of this picture on the first day it came out, and even more over the following days. While all are visually similar, they differ by image dimensions, compression level, metadata, cropping, coloring, etc. Some even include annotations. The original picture was 4537x4630, but this version is 720x735....40". (BACK TO TOP)

Think Fast, Talk Smart: Communication Techniques

https://www.gsb.stanford.edu/insights/think-fast-talk-smart-podcast

Cheap Talk: What Economics Has to Say About Communication

Your words — are they credible? Or are they what Paul Oyer calls “cheap talk?” According to professor of economics Paul Oyer, how our words align with our actions isn’t just a matter of communication, but a matter of economics too. Economic concepts hold in all areas of life, which Oyer’s research has explored in everything from Uber driving to online dating. “Economics is everywhere,” Oyer says. “It's an incredibly powerful lens to analyze almost anything in the real world. (BACK TO TOP)

Retool blog

https://retool.com/blog/

Hooks and state 102: the Dependency array in useEffect()

One of the more confusing aspects of the useEffect() hook is the dependency array. To understand it fully, we look at Effects in React in general, and offer a few case studies to really grasp the matter. (BACK TO TOP)

Stay SaaSy

https://staysaasy.com/

Small Performance Cues

Over many years in industry, you start to see patterns that are suspiciously correlated with lower performance. All of these cues are highly associated with low performance in my observation, but more interestingly, all of them have nothing to do with low performance directly. They’re incidental symptoms that just happen to show up when someone is struggling. You could have a small emergency. You could lose track of time. A one-on-one meeting might go long. (BACK TO TOP)

allegro.tech

https://blog.allegro.tech

How to facilitate EventStorming workshops

With this article, I would like to introduce you to EventStorming and explain to you how to get started. I am not discovering anything new, just gathering available knowledge in one place. What I will show you is a few tips on how to conduct and facilitate EventStorming workshops. Guide to Big Picture EventStorming Introducing EventStorming In 2013 Alberto Brandolini posted an article about a new workshop format for quick exploration of complex business domains.g. by initial and final events. 1. (BACK TO TOP)

Blog on Tailscale

https://tailscale.com/blog/

Putting Tailscale on the Steam Deck

Tailscale lets you connect your computers to each other so that you can use them together securely. As technology continues to advance, we’ll be carrying around more and more devices that, for convenience, we’ll call “computers.” Some of them are more limited than others, but today I want to talk about one device in particular: the Steam Deck by Valve. The Steam Deck is a handheld Linux computer that is used for playing desktop-grade PC games. Sure — this will work. You can make a folder in ~/.. (BACK TO TOP)

Timescale Blog

https://www.timescale.com/blog/

Using IoT Sensors, TimescaleDB, and Grafana to Control the Temperature of the Nuclear Fusion Experiment at the Max Planck Institute

Read how TimescaleDB and Grafana are helping ensure that the Wendelstein 7-X fusion reactor is cool enough for further experimentation by the Max Planck Institute for Plasma Physics team. (BACK TO TOP)

Eli Bendersky's website

https://eli.thegreenplace.net/

How I went about learning Rust

Rust has been on my radar for a long time now , and about a year ago I finally began allocating some time every week to learning it. In this post I'll provide details on the learning path I've followed for Rust, in the hope that this may prove useful for others. You'll note that this isn't exactly a "Learn X in 24 hours" kind of journey, as it stretches over a long time period and covers lots of different materials. YMMV. Rust in Action ( link to review ). Rust for Rustaceans ( link to review ). (BACK TO TOP)

Weaveworks

https://www.weave.works/

GitOps Days 2022 recap: major clouds and vendors offering GitOps with Flux

This blog post has been authored by Daniel Holbach and Stacey Potter. The team around GitOps Days came together back in the middle of 2020 with the mission to educate the world about the leaps that GitOps had made as a methodology and tool chain. A secondary objective of the group was to create a community for GitOps maintainers, engineers, practitioners and users and brighten everyone's day during the first wave of lockdowns. Weave GitOps is built on extending Flux. Watch the demo. (BACK TO TOP)

Computer Things

https://buttondown.email/hillelwayne

On Metafiles

A metafile is a file that represents multiple possible files. The most common type of metafile in use is the template file : < p > I passed in { number }</ p > Templates are usually filled out at runtime, so it “looks like” one file, but you can take a script that takes the template and produces a bunch of output files. That’s what makes it a metafile. I first got interested in metafiles while working on learntla ..tla IsUnique(s) == Cardinality(seen) = Len(s) * file__2...  ↩ (BACK TO TOP)

The Technium

https://kk.org/thetechnium

Weekly Links, 07/15/2022

This is an exceptionally fine example of what breeding art with AI might produce. https://t.co/lNeTFBl43w — Kevin Kelly (@kevin2kelly) July 13, 2022 Here are a couple of alternative ideas for funding science that are not done now. One way is to give all science researchers a standard flat amount and 40% more to fund other researchers. Best idea: try new ways. https://t.co/hpDi7HrQmh — Kevin Kelly (@kevin2kelly) July 12, 2022 (BACK TO TOP)

Vallified

https://www.philipotoole.com

rqlite 7.6.0 released – now with ARM builds

rqlite is a lightweight, open-source, distributed relational database written in Go, which uses SQLite as its storage engine. 7.6.0 improves access-control options, and also has official ARM and ARM64 builds for the first time. Cross compiling for ARM was relatively straightforward. Once I installed the relevant C cross-compilers, invoking the Go tool chain wasn’t too … Continue reading rqlite 7.6.0 released – now with ARM builds → The post rqlite 7.6. (BACK TO TOP)

Building Secure and Reliable Systems at Google

I recently started reading Building Secure and Reliable Systems, which was authored by various folks at Google (some of whom I know). Since my work is at the intersection of so much of this — reliable logging systems which must also be secure, it’s an interesting read. In my experience, the most challenging part about … Continue reading Building Secure and Reliable Systems at Google → The post Building Secure and Reliable Systems at Google appeared first on Vallified . (BACK TO TOP)

Towards Data Science - Medium

https://towardsdatascience.com

Intro to Sentence Analysis for Radiology Label Extraction (SARLE)

SARLE is a customizable technique for extracting structured abnormality and location labels automatically from free text radiology reports Continue reading on Towards Data Science » (BACK TO TOP)

5 Data Science Skills That Will Never Become Outdated

Trends will come and go, but data scientists will always need these skills Continue reading on Towards Data Science » (BACK TO TOP)

Microsoft Security Blog

https://www.microsoft.com/security/blog

How Microsoft Purview and Priva support the partner ecosystem

We are excited to announce the general availability of the new Microsoft Graph APIs for Microsoft Purview eDiscovery. With the new Microsoft Purview eDiscovery APIs, partners and customers can leverage automation to streamline common, repetitive workflows that require a lot of manual effort in the product experience. The post How Microsoft Purview and Priva support the partner ecosystem appeared first on Microsoft Security Blog . (BACK TO TOP)

How Microsoft Security partners are helping customers do more with less

The Microsoft Security partner opportunity grew 21 percent year-over-year, particularly in Microsoft 365 security, cloud security, compliance, and identity. Microsoft Security partners are expanding their existing offerings and creating new offerings in all these areas, packaging their unique experience, expertise, and IP for effective and efficient service delivery. The post How Microsoft Security partners are helping customers do more with less appeared first on Microsoft Security Blog . (BACK TO TOP)

PlanetScale - Blog

https://planetscale.com

Announcing Teams: An easier way to manage database administrator access

Learn how you can manage database access with Teams and Directory Sync Read the full story (BACK TO TOP)

We now display PlanetScale system status directly in your dashboard

Learn about how we built the new in-app system status using Vercel edge functions and StatusPage Read the full story (BACK TO TOP)

Daniel Lemire's blog

https://lemire.me/blog

Negative incentives in academic research

In the first half of the XXth century, there were relatively few scientists, and these scientists were generally not lavishly funded. Yet it has been convincingly argued that these scientists were massively more productive. We face a major replication crisis where important results in fields such as psychology and medicine cannot be reproduced independently. Academic … Continue reading Negative incentives in academic research (BACK TO TOP)

How quickly can you convert floats to doubles (and back)?

Many programming languages have two binary floating-point types: float (32-bit) and double (64-bit). It reflects the fact that most general-purpose processors supports both data types natively. Often we need to convert between the two types. Both ARM and x64 processors can do in one inexpensive instructions. For example, ARM systems may use the fcvt instruction. … Continue reading How quickly can you convert floats to doubles (and back)? (BACK TO TOP)

Krebs on Security

https://krebsonsecurity.com

Massive Losses Define Epidemic of ‘Pig Butchering’

U.S. state and federal investigators are being inundated with reports from people who’ve lost hundreds of thousands or millions of dollars in connection with a complex investment scam known as “pig butchering,” wherein people are lured by flirtatious strangers online into investing in cryptocurrency trading platforms that eventually seize any funds when victims try to cash out. (BACK TO TOP)

A Deep Dive Into the Residential Proxy Service ‘911’

For the past seven years, an online service known as 911 has sold access to hundreds of thousands of Microsoft Windows computers daily, allowing customers to route malicious traffic through PCs in virtually any country or city around the globe — but predominantly in the United States. The proxy service says its network is made up entirely of users who voluntarily install the proxy software. (BACK TO TOP)

Why 8kun Went Offline During the January 6 Hearings

The latest Jan. 6 committee hearing on Tuesday examined the role of conspiracy theory communities like 8kun[.]top and TheDonald[.]win in helping to organize and galvanize supporters who responded to former President Trump's invitation to "be wild" in Washington, D.C. on that chaotic day. At the same time the committee was hearing video testimony from 8kun founder Jim Watkins, 8kun and a slew of similar websites were suddenly yanked offline. (BACK TO TOP)

Google AI Blog

http://ai.googleblog.com/

Training Generalist Agents with Multi-Game Decision Transformers

Posted by Winnie Xu, Student Researcher and Kuang-Huei Lee, Software Engineer, Google Research, Brain Team Current deep reinforcement learning (RL) methods can train specialist artificial agents that excel at decision-making on various individual tasks in specific environments, such as Go or StarCraft . Our model trains an agent that can play 41 Atari games simultaneously at close-to-human performance and that can also be quickly adapted to new games via fine-tuning.g.g., negative space). (BACK TO TOP)

Simplified Transfer Learning for Chest Radiography Model Development

Posted by Akib Uddin, Product Manager and Andrew Sellergren, Software Engineer, Google Health Every year, nearly a billion chest X-ray (CXR) images are taken globally to aid in the detection and management of health conditions ranging from collapsed lungs to infectious diseases. Generally, CXRs are cheaper and more accessible than other forms of medical imaging. However, existing challenges continue to impede the optimal use of CXRs.e.g.g., one normal image and one abnormal image).e.g.g.g.g.g.g. (BACK TO TOP)

Google at ICML 2022

Posted by Cat Armato, Program Manager, University Relations Google is a leader in machine learning (ML) research with groups innovating across virtually all aspects of the field, from theory to application. We build machine learning systems to solve deep scientific and engineering challenges in areas of language, music, visual processing, algorithm development, and more. Take a look below to learn more about the Google research being presented at ICML 2022 (Google affiliations in bold ).   ↩ (BACK TO TOP)

Engineering at Meta

https://engineering.fb.com

Using Hermes’s Quicksort to run Doom: A tale of JavaScript exploitation

At Meta, our Bug Bounty program is an important element of our “defense-in-depth” approach to security. Our internal product security teams investigate every bug submission to assess its maximum potential impact so that we can always reward external researchers based on both the bug they found and our further internal research assessment of where else [...] Read More... The post Using Hermes’s Quicksort to run Doom: A tale of JavaScript exploitation appeared first on Engineering at Meta . (BACK TO TOP)

How Meta and the security industry collaborate to secure the internet

Our inaugural Bug Bulletin report [...] Read More... The post How Meta and the security industry collaborate to secure the internet appeared first on Engineering at Meta . (BACK TO TOP)

Building text animations for Instagram Stories

In August 2020, Instagram launched a set of dynamic and fun text styles followed by animations to give people more choices to express themselves on Stories and Reels. This was the first major update to Stories’ text tools since 2016, and we wanted to share how we approached some obstacles we encountered and what we [...] Read More... The post Building text animations for Instagram Stories appeared first on Engineering at Meta . (BACK TO TOP)

The CircleCI Blog Feed - CircleCI

https://circleci.com/blog/

How testing in the cloud delivers value to development teams

Testing is an integral part of the software development process and is one of the key ways development teams can better understand how applications function. Testing also prevents changes in the codebase that can affect other parts of the code, enabling you to measure the quality of the software and eliminate any errors before users can interact with it. Most development teams use unit and integration tests assess their software. You should make this measurement as often as required. (BACK TO TOP)

Automating compliance in software delivery

Software development teams face a large and growing number of obstacles: shifting design requirements, organizational blockers, tight deadlines, complicated tech stacks and software supply chains . One emerging challenge that developers and IT leaders face is the need to stay compliant with regulations and control frameworks that stipulate comprehensive data security, incident response, and monitoring and reporting requirements. (BACK TO TOP)

Edge computing vs cloud computing

By now, almost everyone is familiar with cloud computing in one form or another. Throughout the 2010s, the concept of cloud computing evolved within the software industry, then worked its way into everyday life as a universal household term. Somewhat less familiar is the concept of edge computing. The genesis of the “edge” dates to the first content delivery networks in the 1990s. Since then, the edge concept has primarily been the domain of network engineers. (BACK TO TOP)

The Cloudflare Blog

https://blog.cloudflare.com/

Using Apache Kafka to process 1 trillion inter-service messages

We learnt a lot about Kafka on the way to 1 trillion messages, and built some interesting internal tools to ease adoption that will be explored in this blog post (BACK TO TOP)

A story about AF_XDP, network namespaces and a cookie

A crash in a development version of flowtrackd (the daemon that powers our Advanced TCP Protection) highlighted the fact that libxdp (and specifically the AF_XDP part) was not Linux network namespace aware. This blogpost describes the debugging journey to find the bug, as well as a fix. (BACK TO TOP)

Working in public — our docs-as-code approach

Besides following a docs-as-code approach, at Cloudflare we handle our documentation changes in a public repository. The contributions we get from the entire Cloudflare community help us make our documentation better every day (BACK TO TOP)

Future

https://future.com

The Rise of Domain Experts in Deep Learning

Jeremy Howard is and artificial intelligence researcher and the co-founder of fast.ai, a platform for non-experts to learn artificial intelligence and machine learning. Prior to starting fast.ai, he founded multiple companies — including FastMail and Enlitic, a pioneer in applying deep learning to the medical field — and was president and chief scientist of machine-learning... Read More The post The Rise of Domain Experts in Deep Learning appeared first on Future . (BACK TO TOP)

When to Expand Your Marketplace Business, According to 14 Operators

Most of the world’s leading consumer marketplaces looked like completely different businesses at their inception. Amazon was famously an online bookseller, while Uber started as a black car service. DoorDash launched as “Palo Alto Delivery” (reflecting its narrow geographic range), while Booking.com exclusively helped travelers find hotels in the Netherlands.  This type of focused launch... (BACK TO TOP)

Info Diet: a16z Crypto’s Elena Burger

Info Diet offers a peek into the personally curated feeds and media habits of the people shaping the future. In each installment, a different builder spends two days chronicling all the content they consume in order to stay ahead of the curve. This time: Elena Burger, a deal partner on the a16z crypto team, where... Read More The post Info Diet: a16z Crypto’s Elena Burger appeared first on Future . (BACK TO TOP)

The Glittering Treasure in Your Genome’s Junk

Rick Young is a professor of biology at MIT who studies RNA that is transcribed from the part of the genome that does not code for proteins, known as non-coding DNA. This part of the genome was once referred to as ‘junk DNA,’ which gives you a sense of what many thought of its value.... Read More The post The Glittering Treasure in Your Genome’s Junk appeared first on Future . (BACK TO TOP)

Sentry Blog RSS

https://blog.sentry.io

Automate Your Boring Tasks with Ruby

If you aren’t already fed up with doing the same boring stuff over and over again, you will In the long run. Tasks which are repeated again… (BACK TO TOP)

Making a Time Zone Picker Control for .NET MAUI

In this post, Matt-Johnson Pint from the Sentry .NET team walks us through how he made a Time Zone Picker user interface control for .NET MAUI, leveraging MAUI's support for platform-specific code. (BACK TO TOP)

Logging in Python: A Developer’s Guide

Have you ever had a tough time debugging your Python code? If yes, learning how to set up logging in Python can help you streamline your… (BACK TO TOP)

JavaScript SDK “Package Size is Massive” - So we reduced it by 29%

Developers started to notice just how big our JavaScript package was and yeah, we knew. We weren’t ignoring the issues; after all, we don’t want the Sentry package to be the cause of a slowdown. But to reduce our JavaScript SDK package size effectively we had to account for shipping new capabilities, like being able to manage the health of a release and performance monitoring, while maintaining a manageable bundle size. After all, new features == bigger package - usually. (BACK TO TOP)

Earthly Blog

https://earthly.dev/blog/

DevX Podcast Interview

Vlad was a guest on a recent episode of the DevX podcast . 🔥 New #DevXPod episode has just dropped! Take a listen to another episode of the podcast with @csweichel and @paulienuh talk to @VladAIonescu about fixing the CI/CD experience. 🎙 https://t.co/7VY0g0fTbD Available wherever you get your podcasts! pic.twitter.com/QNUpQMCqxK — DevX Conf ( @devxconf ) July 12, 2022 (BACK TO TOP)

Terraform Import - Leaving Click Opps Behind

From Click Ops To GitOps Previously I built a REST API , deployed it into a container and got it all running on AWS as a Lambda. But setting this up involved just clicking around in AWS and occasionally using the AWS CLI. Today, I’m going to port that whole setup to Terraform so that its easier to manage, reproduce, and make changes to. ( These are the purported benefits of Terraform, or so my coworker Corey tells me. I’ve never used it before so I’ll be learning as I go.......22.0...22.lock.18. (BACK TO TOP)

Analyze Your Amazon Data with Python

How much have you spent on Amazon? Well, that’s a kind of interesting question to find an answer to. And it’s the type of question I like to answer using Python. With Python, Data analysis is just a 10-minute job. So in this article, we’re going to analyze your Amazon data with a few lines of code. By the end of the article, we will have: Figured out how much money we’ve spent on Amazon Found the most expensive and cheapest things we’ve ordered. We’ll need: A Python IDE and Python 3. Df.fillna . (BACK TO TOP)

Code From Anywhere: Dev Containers and Github Codespaces

We recently started using Dev Containers and Codespaces for development on our Jekyll blog here at Earthly. We have a lot of different plugins and dependencies to make things like linting, spell check, and image importing much easier. The problem is, a lot of this was originally set up on an Intel Mac. Not only did Dev Containers with Codespaces solve this issue for us, it made development in general much easier and more portable. They’re great for standardizing development across a team.json .. (BACK TO TOP)

Metadata

http://muratbuffalo.blogspot.com/

Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service (USENIX ATC 2022)

This paper, which appeared in USENIX ATC'22 last week, describes the evolution of the design and implementation of DynamoDB in response to experiences operating it since its launch in 2012. DynamoDB has massive scale. In 2021, during the 66-hour Amazon Prime Day shopping event, Amazon systems made trillions of API calls to DynamoDB, peaking at 89.2 million requests per second. DynamoDB powers Alexa, Amazon.com sites, and all Amazon fulfillment centers. First some clarification is in order.e.g. (BACK TO TOP)

High Throughput Replication with Integrated Membership Management (USENIX ATC 2022)

This paper, which appeared at USENIX ATC 2022, introduces ChainPaxos.  ChainPaxos applies ideas from chain replication to the MultiPaxos protocol. ( Here is an overview of chain replication if you are unfamiliar with it.) Since ChainPaxos is a Paxos protocol, its fault-tolerance is independent of an external coordination service. This allows for continuous execution of operations during reconfigurations, and uncoupling of the system's fault-tolerance from that of an external service. (BACK TO TOP)

OSDI2022, continued

Venue, logistics, and travel The conference was held at the Omni La Costa Resort at Carlsbad CA. Carlsbad is 30 miles from San Diego, still an easy to access place compared to earlier SOSP/OSDI venues. This didn't stop my Lyft driver to complain; he asked me why they are not holding the conference in one of the ample city venues. I told him, this is part of the tradition. The resort was nice and clean. It had splash pools, which was great for people traveling with kids.4% acceptance ratio. (BACK TO TOP)

OSDI 2022: nature is healing

This week I attended the USENIX Symposium on Operating Systems Design and Implementation (OSDI) conference , which was held at San Diego (well, at Carlsbad, CA to be more accurate). A big appeal of OSDI this year was that it was colocated with USENIX ATC . This allowed participants to attend two great conferences for the price of one registration and with one trip. Despite this allure, OSDI22 was still far from its pre-Covid glory and buzz. No CAP-like grand-conjecture from Eric this year.   (BACK TO TOP)

Blog – Hackaday

https://hackaday.com

Reverse Engineering A Phased Array System Reveals Surprising Details

The term “phased array” has been around for a long time, but in recent years we’ve heard more and more about the beam shaping that’s possible with phased array antennae. …read more (BACK TO TOP)

Simple Binary Watch Uses A PCB Body

There are many ways to tell the time, from using analog dials to 7-segment displays. Hackers tend to enjoy binary watches, if only for their association with the digital machines …read more (BACK TO TOP)

Tiny Pinball Machine Also Runs x86 Code

As arcades become more and more rare, plenty of pinball enthusiasts are moving these intricate machines to their home collections in basements, garages, and guest rooms. But if you’re not …read more (BACK TO TOP)

Don’t Miss Your Last Chance to Enter the Hack it Back Challenge

While the 2022 Hackaday Prize as a whole winds its way through a good chunk of the year, each individual challenge that makes up the competition only sticks around for …read more (BACK TO TOP)

Building a Modular Joystick For Star Citizen

Joysticks are great for gaming, but sometimes it’s hard to find one that suits your personal playstyle. [Nixie] developed the TinkerJoy to suit their own needs, while giving it a …read more (BACK TO TOP)

Simon Willison's Weblog: Blogmarks

http://simonwillison.net/

How John Wiseman tracks worldwide GPS interference

(BACK TO TOP)

Visual Studio Code: Development Process

(BACK TO TOP)

The Checkered Flag Diagram for visualizing SQL joins

(BACK TO TOP)

Soft Deletion Probably Isn't Worth It

(BACK TO TOP)

Datasette Discord community

(BACK TO TOP)

Stack Overflow Blog

https://stackoverflow.blog

Design patterns for asynchronous API communication

An event-driven architecture can reduce dependencies, increase safety, and make your application easy to scale. But designing your systems and topics is a non-trivial task The post Design patterns for asynchronous API communication appeared first on Stack Overflow Blog . (BACK TO TOP)

How APIs can take the pain out of legacy system headaches (Ep. 465)

Get developers the right tools, or provide the means to build them. The post How APIs can take the pain out of legacy system headaches (Ep. 465) appeared first on Stack Overflow Blog . (BACK TO TOP)

Code completion isn’t magic; it just feels that way (Ep. 464)

Meredydd Lyff, founder and CEO of Anvil, joins the home team to discuss code completion: what it is and how it works, from first principles to best practices. Plus: Is 90% of biology attributable to magic gremlins? The post Code completion isn’t magic; it just feels that way (Ep. 464) appeared first on Stack Overflow Blog . (BACK TO TOP)

How observability is redefining the roles of developers

Your DevOps team might already be singing the praises of their observability platforms. But developers can benefit from them, too. The post How observability is redefining the roles of developers appeared first on Stack Overflow Blog . (BACK TO TOP)

The Overflow #134: Avoiding the difficulty bomb 

Perl in 2022, the legality of Googling the illegal, and fuzz tests The post The Overflow #134: Avoiding the difficulty bomb  appeared first on Stack Overflow Blog . (BACK TO TOP)

At your next job interview, you ask the questions (Ep. 463)

The home team convenes to discuss the end of the GPU shortage, how the no-code/low-code movement is impacting developers, and why job candidates should flip the script and interview their interviewers. The post At your next job interview, you ask the questions (Ep. 463) appeared first on Stack Overflow Blog . (BACK TO TOP)

The Full Feed - All of the Packet Pushers Podcasts

https://packetpushers.net

Kubernetes Unpacked 005: Serverless Kubernetes In Azure

Since the inception of Kubernetes, the goal has been to make our lives as engineers easier. But with great power comes great responsibility---which in this case is the need to manage a bunch of control planes and worker nodes! Host Michael Levan catches up with Jason Haley, Microsoft MVP and independent consultant to talk about serverless Kubernetes with Azure Container Apps. The post Kubernetes Unpacked 005: Serverless Kubernetes In Azure appeared first on Packet Pushers . (BACK TO TOP)

Day Two Cloud 155: Terraform Stinks

Today on Day Two Cloud, we talk about why Terraform stinks. OK, maybe it doesn't stink, but just because everyone seems to love a particular tool doesn't make it right for you. We talk with Dan Moore, a developer advocate at FusionAuth, who tried to use Terraform and just couldn't get behind it. This episode is based on a presentation Dan gave at Gluecon in May 2022. The post Day Two Cloud 155: Terraform Stinks appeared first on Packet Pushers . (BACK TO TOP)

Tech Bytes: Forecasting SD-WAN Performance With WAN Insights (Sponsored)

Today on the Tech Bytes podcast we look at how to get better visibility into the WAN. Our sponsor is Cisco ThousandEyes and we’re going to discuss its latest capability, called WAN Insights, that analyzes WAN performance data to help remove SD-WAN blind spots and give network engineers a better understanding of whether their providers are delivering as promised. The post Tech Bytes: Forecasting SD-WAN Performance With WAN Insights (Sponsored) appeared first on Packet Pushers . (BACK TO TOP)

Network Break 390: New Juniper Access Switch; Intel To Hike Prices

This week's Network Break podcast discusses new switch hardware from Juniper, the underwhelming outage response by Canadian ISP Rogers, and why SASE growth is exploding. Intel is said to be raising prices across a variety of chips, a security researcher has demonstrated a replay attack that can open and start Honda vehicles, and more. The post Network Break 390: New Juniper Access Switch; Intel To Hike Prices appeared first on Packet Pushers . (BACK TO TOP)

Heavy Networking 638: Don’t Block DNS Over TCP

DNS is our subject on today's Heavy Networking. More specifically, DNS transport over TCP. We talk with John Kristoff, one of the forces behind RFC9210, which covers the operational requirements for DNS transport over TCP. This is not an esoteric document covering a tiny, nuanced DNS use case. Instead this doc will likely affect most of you listening, whether you’re a network operator or a name server operator. We talk with John about the implications of this RFC. (BACK TO TOP)

Kubernetes Unpacked 004: Pros And Cons Of Using Terraform With Kubernetes

On today's Kubernetes Unpacked podcast we explore tradeoffs that come with using Terraform to manage Kubernetes. My guest is Luke Orellana, an SRE who uses Kubernetes. He's also a HashiCorp Ambassador. We also discuss differences between managing VMs and Kubernetes, Kubernetes benefits including self-healing, and downsides such as dealing with the complexity that comes from containers and microservices. (BACK TO TOP)

Amazon Science Homepage

https://www.amazon.science/

ICML: Where causality meets machine learning

Amazon’s Dominik Janzing on the history and promise of the young field of causal machine learning. (BACK TO TOP)

"Among all sources of information, visual information may be the most interesting"

Violetta Shevchenko, an Amazon applied scientist and former intern, combines vision and language to create solutions to challenging problems. (BACK TO TOP)

New method identifies the root causes of statistical outliers

Amazon ICML paper proposes information-theoretic measurement of quantitative causal contribution. (BACK TO TOP)

74 Amazon Research Awards recipients announced

The awardees represent 51 universities in 17 countries. Recipients have access to more than 300 Amazon public datasets, and can utilize AWS AI/ML services and tools. (BACK TO TOP)

Filtering out "forbidden" documents during information retrieval

New method optimizes the twin demands of retrieving relevant content and filtering out bad content. (BACK TO TOP)

Amazon scientists Mike Hicks and René Vidal honored

Hicks wins 2022 ACM SIGPLAN Distinguished Service Award for career contributions; Vidal wins IEEE Signal Processing Magazine Best Paper Award. (BACK TO TOP)

Changelog Master Feed

https://changelog.com/master

Go for beginners ♻️ (Go Time #239)

How do beginners learn Go? This episode is meant to engage both non-Go users that listen to sister podcasts here on Changelog, or any Go-curious programmers out there, as well as encourage those that have started to learn Go and want to level up beyond the basics. On this episode we’re aiming to answer questions about how to learn Go, identify resources that are available, and where you can go to continue your learning journey. (BACK TO TOP)

Operational simplicity is a gift to you (Ship It! #62)

Gerhard’s transition to a senior engineer started 10 years ago, when he embraced the vim mindset, functional core & imperative shell, and was inspired to seek simplicity in his code & infrastructure. Most of it can be traced back to one person: Gary Bernhardt, the creator of Execute Program, Destroy all Software and the now famous Wat idea. Few stick around long enough to understand the long-term impact of their decisions on production systems. (BACK TO TOP)

DALL-E is one giant leap for raccoons! 🔭 (Practical AI #185)

In this Fully-Connected episode, Daniel and Chris explore DALL-E 2, the amazing new model from Open AI that generates incredibly detailed novel images from text captions for a wide range of concepts expressible in natural language. Along the way, they acknowledge that some folks in the larger AI community are suggesting that sophisticated models may be approaching sentience, but together they pour cold water on that notion. (BACK TO TOP)

Building the best mountain bikes in the world (Founders Talk #93)

This week Adam is taking the show off the beaten path to speak with Adam Miller, the founder and CEO of Revel Bikes. Yes that’s right, this episode features a founder of a bike brand, not a tech brand. BTW, Adam (host) is an owner of a Revel bike — he has a T1000 colorway Rascal that he’s ridden on downhill trails, all-day epics, and everything in-between. If you enjoy this episode, please us know in the comments. (BACK TO TOP)

Spicy designs, more open source opinions, privacy-focused services, the real cost of context switching & jqq (The Changelog)

Anthony Hobday has 37 ways to spice up your designs, James Bennett has opinions on open source and PyPi security, Alicia Sykes compiled some awesome security/privacy options, ContextKeeper layouts out the real price of context switching, and Nick Nisi tells us all about jqq. Bam! Bam! Bam! (BACK TO TOP)

Build tiny multi-platform apps with Tauri and web tech (The Changelog #497)

This week we’re talking with Daniel Thompson about Tauri and their journey to their recent 1.0 release. Tauri is often compared to Electron - it’s a toolkit that lets you build software for all major desktop operating systems using web technologies. It was built for the security-focused, privacy-respecting, and environmentally-conscious software engineering community. The core libraries are written in Rust and the UI layer can be written using virtually any frontend framework. (BACK TO TOP)

Deno's Fresh new web framework (JS Party #234)

Deno team member Luca Casonato joins Jerod & Feross to tell us about Fresh – a next generation web framework, built for speed, reliability, and simplicity. (BACK TO TOP)

Enabling a world where all software is reliable (Founders Talk #92)

This week Adam is joined by Robert Ross founder and CEO of FireHydrant — the glue layer between your tech stack and your teams to mitigate and resolve incidents at scale. Robert shares his journey to become a software engineer, his time at DigitalOcean, this idea of incident management as a platform and how he shifted his focus from creating courses on incident management to recognizing the value of the software he was creating for the course — what is now known as FireHydrant.” (BACK TO TOP)

Cloud Blog

https://cloud.google.com/blog/

A new Google Cloud region is coming to Mexico

Last month, Google announced a five-year, $1.2 billion USD commitment to Latin America to expand digital infrastructure, support digital skills, foster an entrepreneurial ecosystem, and help create inclusive and sustainable communities. To build on these initiatives and meet the growing demand for cloud services around the world, we are excited to announce that a new Google Cloud region is coming to Mexico. "We are very excited about the announcement of a new cloud region in Mexico. Read Article (BACK TO TOP)

Standing shoulder to shoulder - building a resilient healthcare ecosystem with Health-ISAC

Building a resilient healthcare ecosystem is not something done within a vacuum. It takes motivated organizations and people working together in a community of trust to build and defend effectively. We believe the more diverse these communities are, the more effective they can be.  Last August, Google announced its commitment to invest at least $10 billion over the next 5 years to advance cybersecurity. Google Cloud is the first and only major cloud provider to join the organization... (BACK TO TOP)

How Google Cloud SecOps can help solve these 6 key MSSP conundrums

Editor's note : This blog was originally published by Siemplify on October 6, 2021. The COVID-19 pandemic accelerated many organizations’ timelines to transition to the cloud and advance their digital transformation efforts. The potential attack surfaces for those organizations also grew as newly distributed workforces used unmanaged technologies. As a result, not all security service providers are created equal. This visibility void often extends to the customer as well.security . Read Article (BACK TO TOP)

Using Cloud Bigtable with IAM Conditions and Tags

Cloud Bigtable is a low-latency, high-throughput NoSQL database. Bigtable users store terabytes of data in their tables, and exposing the data securely is essential for Bigtable users.​ If​ you are an administrator or developer responsible for securing access to your Bigtable data, ​​you are likely util​izing​ Google Cloud security features to lock down ​the Bigtable resources and customize ​your authorization model. A principle can be a user, group or a service account.wagtailcore.rich_text. (BACK TO TOP)

The Invisible Cloud: How this Googler keeps the internet moving worldwide

Editor's note: Google Cloud runs on people like Stacey Cline. As Global Contract Management Lead in our Global Logistics Operations, she enables  the worldwide movement of global technical infrastructure - the servers, the storage, the artificial intelligence pods, and everything else that keeps Google Cloud serving enterprises and individuals 24/7.  A native of Trinidad & Tobago, she came to Google near the onset of COVID after years at IBM and BP. Sound intense? "My kids say I'm happy again. (BACK TO TOP)

The Diversity Annual Report is now a BigQuery public dataset

Since 2014, tech companies have relied on metrics to identify trouble spots, establish baselines, and measure meaningful progress in diversity, including publishing DEI data directly through diversity annual reports. However, as our understanding of DEI has evolved over time each company’s report has diverged, creating a fragmented landscape of industry-wide data. This separation is problematic as no single company’s diversity dataset can solve tech’s DEI challenges.g. hiring trends for tech vs. (BACK TO TOP)

The next generation of Dataflow: Dataflow Prime, Dataflow Go, and Dataflow ML

By the end of 2024, 75% of enterprises will shift from piloting to operationalizing artificial intelligence according to IDC, yet the growing complexity of data types, heterogeneous data stacks and programming languages make this a challenge for all data engineers. With the current economic climate, doing more with cheaper costs and higher efficiency have also become a key consideration for many organizations. We’re so excited to make Dataflow even better. Read Article (BACK TO TOP)

Streamline data management and governance with the unification of Data Catalog and Dataplex

Today, we are excited to announce that Google Cloud Data Catalog will be unified with Dataplex into a single user interface . With this unification, customers have a unified experience to search and discover their data, enrich it with relevant business information, organize it by logical data domains, and centrally govern and monitor their distributed data with built-in data intelligence and automation capabilities... Read Article (BACK TO TOP)

Google Workspace earns DOD IL4 authorization

Today, we’re proud to announce that Google Workspace has achieved the U.S. Department of Defense’s (DOD) Impact Level 4 (IL4) authorization. This is an important milestone in our ongoing commitment to serving the needs of federal, state, local, and education entities, through our recently launched Google subsidiary, Google Public Sector . The U.S. federal government has been clear about its long-standing goal of deploying multicloud solutions to help with redundancy and to drive more innovation. (BACK TO TOP)

Using Pacemaker for SAP high availability on Google Cloud - Part 1

Problem Statement Maintaining business continuity of your mission critical systems usually demands high availability (HA) solutions that will failover without human intervention. This blog will introduce some basic terminology and concepts about the RedHat and SUSE HA implementation of Pacemaker cluster software for SAP HANA and NetWeaver platforms. Pacemaker Terminology Resource The resource in Pacemaker is the service made highly available by the cluster.d/`.g.g.g. Congratulations... (BACK TO TOP)

Data security in Google Cloud

Data security is a huge part of an organization's security posture. Encryption is a core control for data security, and Google Cloud offers multiple encryption options for data at-rest, in-transit, and even in-use. Let’s shed some light on each of these.  Click to enlarge Encryption  Encryption at rest by default To help protect your data, Google encrypts data at rest , ensuring that it can only be accessed by authorized roles and services, with audited access to the encryption keys... (BACK TO TOP)

How to overcome 5 common SecOps challenges

Editor's note : This blog was originally published by Siemplify on April 12, 2022. The success of the modern security operations center, despite the infusion of automation, machine learning, and artificial intelligence, remains heavily dependent on people. This is largely due to the vast amounts of data a security operations center must ingest—a product of an ever-expanding attack surface and the borderless enterprise brought on by the rapid rise of cloud adoption . 1 in U.S.S.e... Read Article (BACK TO TOP)

Scalable Python on BigQuery using Dask and NVIDIA GPUs

BigQuery is Google Cloud’s fully managed serverless data platform that supports querying using ANSI SQL. BigQuery also has a data lake storage engine that unifies SQL queries with other open source processing frameworks such as Apache Spark, Tensorflow, and Dask. BigQuery storage provides an API layer for OSS engines to process data. This API enables mixing and matching programming in languages like Python with structured SQL in the same data platform.wagtailcore.rich_text.wagtailcore.rich_text. (BACK TO TOP)

Google Cloud Data Heroes Series: Meet Tomi, a data engineer based in Germany and creator of the ‘Not So BigQuery Newsletter’

Google Cloud Data Heroes is a series where we share stories of the everyday heroes who use our data tools to do incredible things. Like any good superhero tale, we explore our Google Cloud Data Heroes’ origin stories, how they moved from data chaos to a data-driven environment, what projects and challenges they are overcoming now, and how they give back to the community. In this role, he regularly uses BigQuery . A dream job.g. a Data Studio dashboard built on top of a BigQuery table... (BACK TO TOP)

Using Google Kubernetes Engine’s GPU sharing to search for neutrinos

Editor’s note : Today we hear from the San Diego Supercomputer Center (SDSC) and University of Wisconsin-Madison about how GPU sharing in Google Kubernetes Engines is helping them detect neutrinos at the South Pole with the gigaton-scale IceCube Neutrino Observatory. IceCube Neutrino Observatory is a detector at the South Pole designed to search for nearly massless subatomic particles called neutrinos.k.a. ray-tracing, and that code can greatly benefit from running on NVIDIA GPUs.g. 1. Fig. Fig. (BACK TO TOP)

Deploying high-throughput workloads on GKE Autopilot with the Scale-Out compute class

GKE Autopilot is a full-featured, fully managed Kubernetes platform that combines the full power of the Kubernetes API with a hands-off approach to cluster management and operations. Since launching Autopilot last year , we’ve continued to innovate, adding capabilities to meet the demands of your workloads. Autopilot compute classes are a curated set of hardware configurations on which you can deploy your workloads. And for the first time, Autopilot supports Arm workloads.google.24.1-gke.24.24. (BACK TO TOP)

What’s new with Google Cloud

Want to know the latest from Google Cloud? Find it here in one handy location. Check back regularly for our newest updates, announcements, resources, events, learning opportunities, and more.  Tip : Not sure where to find what you’re looking for on the Google Cloud blog? Start here:  Google Cloud blog 101: Full list of topics, links, and resources . Our latest codelab shows you how to more quickly process a dataset by parallelizing multiple BigQuery jobs within a workflow.  Learn More .37.37.S. (BACK TO TOP)

Flock Freight builds a more efficient, resilient and environmentally sustainable shipping supply chain on Google Cloud

Commercial trucks often travel partially empty because many shippers don’t have enough cargo to fill an entire container or trailer. Although offering available space to other shippers helps minimize carbon emissions and reduce operating costs, most trucking companies can’t efficiently schedule, track, or deliver multiple freight loads. Companies have always struggled to ship over-the-road freight efficiently. Today, thousands of shippers and trucking companies across the U.S. Read Article (BACK TO TOP)

Cloud Data Loss Prevention (Cloud DLP) Overview

Sensitive data can show up in unexpected places—for example, customers might inadvertently send you sensitive data in a customer support chat or file upload. And if you’re using data for analytics and machine learning, it’s imperative that sensitive data be handled appropriately to protect users’ privacy. That’s where Cloud DLP comes in. It helps provide visibility and classify your sensitive data across your entire organization. Redaction - Redacts a value by removing it.dev   (BACK TO TOP)

Performance considerations for loading data into BigQuery

It is not unusual for customers to load very large data sets into their enterprise data warehouse. Whether you are doing an initial data ingestion with hundreds of TB of data or incrementally loading from your systems of record, performance of bulk inserts is key to quicker insights from the data. The most common architecture for batch data loads uses Google Cloud Storage(Object storage) as the staging area for all bulk loads. We will explore loading efficiencies of compressed vs.. Read Article (BACK TO TOP)

Bulletin by Jakub Mikians