Skip to content

🌏 A tiny 0-dependency thread-safe Java™ lib for setting/viewing dns programmatically without touching host file, make unit/integration testing portable; and a tiny tool for setting/viewing dns of running JVM process.

License

Notifications You must be signed in to change notification settings

alibaba/java-dns-cache-manipulator

Repository files navigation

🌏 Java Dns Cache Manipulator(DCM)

Github Workflow Build Status Github Workflow Build Status Coverage Status Maintainability Java support License Maven Central GitHub release Javadocs GitHub Stars GitHub Forks GitHub issues user repos GitHub Contributors GitHub repo size gitpod: Ready to Code GitHub release download - dcm.tar.gz)

📖 English Documentation | 📖 中文文档


Java Dns Cache Manipulator(DCM) contains 2 subprojects:

  • DCM Library
    A tiny 0-dependency thread-safe lib for setting/viewing dns programmatically without touching host file, make unit/integration test portable. Support Java 8~21, support IPv6.
  • DCM Tool
    A tiny tool for setting/viewing dns of running JVM processes.

Note

Start from DCM 1.7+ upgrade to Java 8 🚀
If you need Java 6 support, use version 1.6.x Maven Central



Java Dns Cache Manipulator(DCM) Library

🔧 Features

  • Set/reset a DNS cache entry (won't lookup DNS afterwards)
    • set a single DNS record
    • or batch setting through a Properties file
  • View DNS cache entry content (positive dns cache and/or negative dns cache)
  • Remove a DNS cache entry (i.e. lookup DNS again)
  • Clear the DNS Cache (re-Lookup DNS for all domain names)
  • Set/View DNS cache time of JVM (positive dns cache and negative dns cache)

🎨 Requirement Scenario

  1. The domain name is hard-coded in some libraries, and have to modify the host file binding to do the test(e.g. unit test, integration test). Turn out:
    • Generally, developers do not have the permission to modify the host file on the continuous integration machine, which leads to the continuous integration fail.
      • In fact, because of this, the demand for this library was born. 😣 🔫
      • Unit testing requires each developer to do some host binding on the development machine, which increases configuration operations and is tedious and repetitive.
  2. Some functions require domain names instead of IPs as input parameters, such as HTTP gateways or web applications with domain name restrictions.
    • In this case, you need a domain name to connect to the IP of the test machine; Or need use a test domain name that does not exist yet, but you do not want to or can not configure the DNS.
  3. In the performance test,
    • want to skip DNS lookup through network (bypass the DNS resolution consumption), so that stress testing pays more attention to server response, and stress testing can fully reflect the performance of the core implementation code.
    • DNS cache can be set dynamically instead of inflexible ways such as modifying host files and http links.
    • A JVM process can have a set of domain name binding without affecting other JVM, be able to run stress testing with multi-scenario and multi-domain binding.
  4. When opening the SecurityManager in Java (such as a web application in the Web container Tomcat), Java's DNS will not be expired by default. If the IP bound to the domain name changes, you can reset the DNS through this library.
    • Set the running JVM DNS Cache through the DCM Tool. application need not contain DCM Library dependency (i.e. Jar).
    • Or call the method of DCM Library through the execution entry, such as remote call or jvm-ssh-groovy-shell. The application need contain DCM Library dependency (ie Jar).

👥 User Guide

Set/View DNS through the class DnsCacheManipulator.

Set directly

DnsCacheManipulator.setDnsCache("hello.com", "192.168.1.1");
// support IPv6
DnsCacheManipulator.setDnsCache("world.com", "1234:5678:0:0:0:0:0:200e");

// The above settings take effect globally, 
// and then all the domain name resolution logic in Java will be the IP set above.
// Let's use a simple method to get the IP of the domain name to demonstrate:

String ip = InetAddress.getByName("hello.com").getHostAddress();
// ip = "192.168.1.1"
String ipv6 = InetAddress.getByName("world.com").getHostAddress();
// ipv6 = "1234:5678:0:0:0:0:0:200e"


// set multiple IPs
DnsCacheManipulator.setDnsCache("hello-world.com", "192.168.2.1", "192.168.2.2");

String ipHw = InetAddress.getByName("hello-world.com").getHostAddress();
// ipHw = 192.168.2.1, read the first IP
InetAddress[] allIps = InetAddress.getAllByName("hello-world.com");
// Read the multiple IP setting


// Set the expiration time, unit is milliseconds
DnsCacheManipulator.setDnsCache(3600 * 1000, "hello-hell.com", "192.168.1.1", "192.168.1.2");

Batch configuration through the dns-cache.properties file

In testing, it is expected that the domain name binding will be written in a configuration file.

The usage is as follows:

provide the file dns-cache.properties on ClassPath:

# Configuration format:
# <host> = <ip>
hello-world.com=192.168.1.1
# Support setting multiple IPs, separated by commas
foo.com=192.168.1.2,192.168.1.3
# Support IPv6
bar.com=1234:5678:0:0:0:0:0:200e

Then complete the batch setting with the following code:

DnsCacheManipulator.loadDnsCacheConfig();

NOTE:

The default configuration file name is dns-cache.properties. and the configuration file name used can be modified through the -D option dcm.config.filename of the JVM: -Ddcm.config.filename=my-dns-cache.properties.

// or load the batch setting from the specified file name explicitly
DnsCacheManipulator.loadDnsCacheConfig("my-dns-cache.properties");

In unit testing, it is often written in the setUp method of the test class, such as:

@BeforeClass
public static void beforeClass() throws Exception {
    DnsCacheManipulator.loadDnsCacheConfig();
}

View JVM DNS cache

// Get a dns cache entry by host
DnsCacheEntry entry = DnsCacheManipulator.getDnsCache("bing.com");

// get whole dns cache info DnsCache including cache and negative cache.
DnsCache dnsCache = DnsCacheManipulator.getWholeDnsCache();

// get positive dns cache entries
//   same as DnsCacheManipulator.getWholeDnsCache().getCache()
List<DnsCacheEntry> positiveEntries = DnsCacheManipulator.getWholeDnsCache();

// get dns negative cache entries
//   same as DnsCacheManipulator.getWholeDnsCache().getNegativeCache()
List<DnsCacheEntry> positiveEntries = DnsCacheManipulator.getWholeDnsCache();

Remove a DNS cache

aka. relookup DNS later.

DnsCacheManipulator.removeDnsCache("bing.com");

Clear JVM DNS cache

DnsCacheManipulator.clearDnsCache();

Set/View the default DNS cache time of JVM

// View the cache time, in seconds. -1 means cache forever, 0 means never cache
int cachePolicy = DnsCacheManipulator.getDnsCachePolicy();
// Set the cache time
DnsCacheManipulator.setDnsCachePolicy(2);

// View the cache time of missed entries(negative entries)
DnsCacheManipulator.getDnsNegativeCachePolicy();
// Set the cache time of missed entries
DnsCacheManipulator.setDnsNegativeCachePolicy(0);

Precautions for use

JVM settings for Java 16+

With the release of Java 16 the access control of the new Jigsaw module system is starting to be enforced by the JVM. If you use DCM under Java 16+, add below Java options:

--add-opens java.base/java.net=ALL-UNNAMED
--add-opens java.base/sun.net=ALL-UNNAMED

If you use maven(e.g. running test), add below config:

<profiles>
    <profile>
        <id>add-java-open-options-for-jdk16+</id>
        <activation>
            <jdk>[16,)</jdk>
        </activation>
        <properties>
            <argLine>
                --add-opens java.base/java.net=ALL-UNNAMED
                --add-opens java.base/sun.net=ALL-UNNAMED
            </argLine>
        </properties>
    </profile>
</profiles>

Domain name case

The domain name is not case-sensitive.

The domain name may be converted to lower case uniformly before entering the JVM DNS Cache.

One of the causes is that the case of the domain name in the DNS query result will be different from the case of the entered domain name, if the entered domain name has uppercase letters.

Domain resolution cache

  • For the logic that has been resolved and saved the IP, setting the JVM DNS cache will not take effect! This can be resolved by re-creating the connection or the client.

For HttpClient:

HttpClient client = new HttpClient();
GetMethod m1 = new GetMethod("https://bing.com");
client.executeMethod(m1);
String content = m1.getResponseBodyAsString();

// Set up DNS and bind to your own machine
DnsCacheManipulator.setDnsCache("bing.com", "192.168.1.1");

// Re-execute m1, still the old result
client.executeMethod(m1);
String content = m1.getResponseBodyAsString();

// Re-create GetMethod to get the results on your own machine
GetMethod m2 = new GetMethod("https://bing.com");
client.executeMethod(m2);
content = m2.getResponseBodyAsString();

More detailed functions

See the documentation for the class DnsCacheManipulator.

🔌 Java API Docs

Java API document: http://alibaba.github.io/java-dns-cache-manipulator/apidocs

🍪 Dependency

Maven example:

<dependency>
    <groupId>com.alibaba</groupId>
    <artifactId>dns-cache-manipulator</artifactId>
    <version>1.8.3</version>
</dependency>

You can view the latest version at search.maven.org.

🗿 More Documentation

📚 Related Resources

Java Dns Cache Manipulator Tool

🔧 Features

  • Set/reset a DNS cache entry
  • View DNS cache entry content
  • Remove a DNS Cache
  • Clear DNS Cache
  • Set/View DNS cache time of JVM

👥 User Guide

Download

GitHub release download - dcm.tar.gz) download the file dcm-x.y.z.tar.gz.

After decompression, run dcm in the bin directory.

$ dcm -h
usage: Options
 -h,--help             show help
 -p,--pid <arg>        java process id to attach

Set/reset a DNS cache entry

# For the Java process whose process ID is 12345
# set the domain name foo.com IP to 1.1.1.1
$ dcm -p 12345 set foo.com 1.1.1.1
# For the Java process whose process ID is 12345
# set the domain name bar.com IP to 2.2.2.2 3.3.3.3 (multiple IPs are possible)
$ dcm -p 12345 set bar.com 2.2.2.2 3.3.3.3

View DNS cache entry content

View single entry:

# For the Java process whose process ID is 12345,
# obtain the DNS entry information of the domain name bing.com
$ dcm -p 12345 get bing.com
bing.com 220.181.57.217,180.149.132.47,123.125.114.144 2015-06-05T18:56:09.635+0800
# The output format:
#   "the domain name" "IP list (there may be multiple IPs)" "expiration time"

View all DNS cache:

$ dcm -p 12345 list
Dns cache:
    bar.com 2.2.2.2,3.3.3.3 292278994-08-17T15:12:55.807+0800
    bing.com 220.181.57.217,180.149.132.47,123.125.114.144 2015-06-05T19:00:30.514+0800
    foo.com 1.1.1.1 292278994-08-17T15:12:55.807+0800
Dns negative cache:
# Output entries containing Cache and Negative Cache.
# The entry is indented 4 spaces.
# In the above example, Negative Cache is empty.

Remove a DNS Cache

# Remove a DNS
$ dcm -p 12345 rm bing.com

Clear DNS Cache

# Clear all DNS Cache
$ dcm -p 12345 clear

Set/View DNS cache time of JVM

# View the cache time, in seconds.
# -1 means cache forever, 0 means no cache
$ dcm -p 12345 getPolicy
30
# Set cache time
$ dcm --pid 12345 setPolicy 5
# View the cache time of missed entries, in seconds.
# -1 means cache forever, 0 means no cache
$ dcm -p 12345 getNegativePolicy
10
# Set the cache time of missed entries
$ dcm -p 12345 setNegativePolicy 0

Load Cache Entries from File

$ dcm -p 12345 load /foo/bar/my-cache.properties

Manipulate cache with a command line option at JVM startup

To manipulate dns entries at jvm startup, add the following jvm-options:

# Set individual entry
java -javaagent:<path to jar>="set foo.com 1.1.1.1" --add-opens java.base/java.net=ALL-UNNAMED --add-opens java.base/sun.net=ALL-UNNAMED ...
# Load entries from file
java -javaagent:<path to jar>="load my-cache.properties" --add-opens java.base/java.net=ALL-UNNAMED --add-opens java.base/sun.net=ALL-UNNAMED ...

📚 Related information