Skip to content

Commit

Permalink
init webpage
Browse files Browse the repository at this point in the history
  • Loading branch information
@Asixa
Asixa committed Jan 16, 2024
1 parent 8b490f4 commit 9f3981c
Show file tree
Hide file tree
Showing 18 changed files with 4,287 additions and 0 deletions.
2 changes: 2 additions & 0 deletions .gitignore
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.DS_store
.idea
292 changes: 292 additions & 0 deletions RFGen.html
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,292 @@
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<meta name="description"
content="Deformable Neural Radiance Fields creates free-viewpoint portraits (nerfies) from casually captured videos.">
<meta name="keywords" content="Nerfies, D-NeRF, NeRF">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>RF Genesis: Zero-Shot Generalization of mmWave Sensing through Simulation-Based Data Synthesis and Generative Diffusion Models</title>

<script async src="https://www.googletagmanager.com/gtag/js?id=UA-132051884-1"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag() {
dataLayer.push(arguments);
}
gtag('js', new Date());
gtag('config', 'UA-132051884-1');
</script>

<link href="https://fonts.googleapis.com/css?family=Google+Sans|Noto+Sans|Castoro"
rel="stylesheet">

<link rel="stylesheet" href="./static/css/bulma.min.css">
<link rel="stylesheet" href="./static/css/bulma-carousel.min.css">
<link rel="stylesheet" href="./static/css/bulma-slider.min.css">
<link rel="stylesheet" href="./static/css/fontawesome.all.min.css">
<link rel="stylesheet"
href="https://cdn.jsdelivr.net/gh/jpswalsh/academicons@1/css/academicons.min.css">
<link rel="stylesheet" href="./static/css/index.css">
<link rel="icon" href="./static/images/favicon.svg">

<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.5.1/jquery.min.js"></script>
<script defer src="./static/js/fontawesome.all.min.js"></script>
<script src="./static/js/bulma-carousel.min.js"></script>
<script src="./static/js/bulma-slider.min.js"></script>
<script src="./static/js/index.js"></script>
</head>
<body>

<nav class="navbar" role="navigation" aria-label="main navigation">
<div class="navbar-brand">
<a role="button" class="navbar-burger" aria-label="menu" aria-expanded="false">
<span aria-hidden="true"></span>
<span aria-hidden="true"></span>
<span aria-hidden="true"></span>
</a>
</div>
<div class="navbar-menu">
<div class="navbar-start" style="flex-grow: 1; justify-content: center;">
<a class="navbar-item" href="https://xingyuchen.me/">
<span class="icon">
<i class="fas fa-home"></i>
</span>
</a>

<!-- <div class="navbar-item has-dropdown is-hoverable">
<a class="navbar-link">
More Research
</a>
<div class="navbar-dropdown">
<a class="navbar-item" href="https://hypernerf.github.io">
HyperNeRF
</a>
<a class="navbar-item" href="https://nerfies.github.io">
Nerfies
</a>
<a class="navbar-item" href="https://latentfusion.github.io">
LatentFusion
</a>
<a class="navbar-item" href="https://photoshape.github.io">
PhotoShape
</a>
</div>
</div> -->
</div>

</div>
</nav>


<section class="hero">
<div class="hero-body">
<div class="container is-max-desktop">
<div class="columns is-centered">
<div class="column has-text-centered">
<h1 class="title is-1 publication-title">RF Genesis: Zero-Shot Generalization of mmWave Sensing through Simulation-Based Data Synthesis and Generative Diffusion Models</h1>
<div class="is-size-5 publication-authors">
<span class="author-block">
<a href="https://xingyuchen.me/">Xingyu Chen</a>,</span>
<span class="author-block">
<a href="http://xyzhang.ucsd.edu/">Xinyu Zhang</a></span>

</div>

<div class="is-size-5 publication-authors">
<span class="author-block">UC San Diego</span>
</div>

<div class="column has-text-centered">
<div class="publication-links">
<!-- PDF Link. -->
<span class="link-block">
<a href="../files/Xingyu.Chen_SenSys23_RFGen.pdf"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fas fa-file-pdf"></i>
</span>
<span>Paper</span>
</a>
</span>
<!-- <span class="link-block">
<a href="https://arxiv.org/abs/2011.12948"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="ai ai-arxiv"></i>
</span>
<span>arXiv</span>
</a>
</span> -->
<!-- Video Link. -->
<!-- <span class="link-block">
<a href="https://www.youtube.com/watch?v=MrKrnHhk8IA"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="fab fa-youtube"></i>
</span>
<span>Video</span>
</a>
</span> -->
<!-- Code Link. -->
<span class="link-block">
<a
class="external-link button is-normal is-rounded is-dark disabled" disabled>
<span class="icon">
<i class="fab fa-github"></i>
</span>
<span>Code (Coming Soon)</span>
</a>
</span>
<!-- Dataset Link. -->
<!-- <span class="link-block">
<a href="https://github.com/google/nerfies/releases/tag/0.1"
class="external-link button is-normal is-rounded is-dark">
<span class="icon">
<i class="far fa-images"></i>
</span>
<span>Data</span>
</a> -->
</div>

</div>
</div>
</div>
</div>
</div>
</section>

<section class="hero teaser ">
<!-- <div class="container is-max-desktop">
<div class="hero-body">
<video id="teaser" autoplay muted loop playsinline height="100%">
<source src="./static/videos/teaser.mp4"
type="video/mp4">
</video>
<h2 class="subtitle has-text-centered">
<span class="dnerf">Nerfies</span> turns selfie videos from your phone into
free-viewpoint
portraits.
</h2>
</div>
</div> -->

<div class="container is-max-desktop">
<div class="hero-body "> <img src="./RFGen/pull.png" />
<h2 class="subtitle has-text-centered">
<span ><b>RFGen</b></span> can generate diverse training data for RF
sensing applications to improve generalization, based on the
description of the target sensing application and its large
cross-modal knowledge
</h2>
</div>
</div>
<div class="column is-3 has-text-centered">

</div>
</section>





<section class="hero is-light is-small p-4">
<div class="container is-max-desktop">
<!-- Abstract. -->
<div class="columns is-centered has-text-centered">
<div class="column is-four-fifths ">
<h2 class="title is-3">Abstract</h2>
<div class="content has-text-justified">
<p>
This paper presents RF Genesis (RFGen), a novel and cost-effective method for synthesizing RF sensing data using cross-modal diffusion models,
in order to improve the generalization capability of millimeter-wave (mmWave) sensing systems.
</p>
<p>
Traditional machine learning models used in mmWave sensing struggle with limited training datasets.
Their performance degrades drastically when confronted with unseen users, environments, sensor configurations, test classes, etc.
RFGen mitigates these challenges by using a cross-modal generative framework to synthesize and expand mmWave sensing data.
We specifically propose a custom ray tracing simulator to simulate RF propagation and interaction with objects/environments.
We then leverage a set of diffusion models to generate massive 3D scenes,
and transform the visual scene representation into the corresponding mmWave sensing data,
under the direction of application-specific ''prompts''.
</p>
<p>
Our proposed approach reconciles the physics-based ray tracing with the black-box diffusion model,
leading to accurate, scalable, and explainable vision-to-RF data synthesis.
Our extensive real-world experiments highlight RFGen's effectiveness in diverse mmWave sensing applications,
enhancing their generalization to unseen test cases without laborious data collection.
</p>
</div>
</div>
</div>
<!--/ Abstract. -->

<!-- Paper video. -->
<!-- <div class="columns is-centered has-text-centered">
<div class="column is-four-fifths">
<h2 class="title is-3">Video</h2>
<div class="publication-video">
<iframe src="https://www.youtube.com/embed/MrKrnHhk8IA?rel=0&amp;showinfo=0"
frameborder="0" allow="autoplay; encrypted-media" allowfullscreen></iframe>
</div>
</div>
</div> -->
<!--/ Paper video. -->
</div>
</section>

<section class="hero is-small">
<div class="hero-body">
<div class="container">
<div class="hero-body "> <img src="./RFGen/system.png" />
</div>
</div>
</section>




<section class="section" id="BibTeX">
<div class="container is-max-desktop content">
<h2 class="title">BibTeX</h2>
<pre><code>@inproceedings{chen2023rfgenesis,
author = {Chen, Xingyu and Zhang, Xinyu},
title = {RF Genesis: Zero-Shot Generalization of mmWave Sensing through Simulation-Based Data Synthesis and Generative Diffusion Models},
booktitle = {ACM Conference on Embedded Networked Sensor Systems (SenSys ’23)},
year = {2023},
pages = {1-14},
address = {Istanbul, Turkiye},
publisher = {ACM, New York, NY, USA},
url = {https://doi.org/10.1145/3625687.3625798},
doi = {10.1145/3625687.3625798}
}</code></pre>
</div>
</section>


<footer class="footer">
<div class="container">
<div class="content has-text-centered">
<a class="icon-link"
href="../files/Xingyu.Chen_SenSys23_RFGen.pdf">
<i class="fas fa-file-pdf"></i>
</a>
<!-- <a class="icon-link" href="" class="external-link" disabled>
<i class="fab fa-github"></i>
</a> -->
</div>
<div class="columns is-centered">
<div class="column is-8">
<div class="content">
<p>
We thank the authors of <a
href="https://github.com/nerfies/nerfies.github.io">Nerfies</a> that kindly open sourced the template of this website.
</p>
</div>
</div>
</div>
</div>
</footer>

</body>
</html>
Binary file added RFGen/pull.png
View file
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added RFGen/system.png
View file
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 9f3981c

Please sign in to comment.