Downloading a resource (403 forbidden)

[corrspt]

Hi,

This isn't really an issue with the api2pdf java API, but, I think you guys might be able to help.

After successfully invoking the api and receiving a response I have the following:

Api2PdfResponse pdfResponse =
          a2pClient.headlessChromeFromHtml(baos.toString("UTF-8"), false, "wps.pdf", options);
      String pdfUrl = pdfResponse.getPdf();

I want to download the file in pdfUrl but I keep getting a 403 forbidden.
I've tried, URLDecoding the value (and not decoding) the URL. I've tried using apache.commons.FileUtils.copyInputStreamToFile(); and i've tried making my own download (using URLConnection) but I always get the 403 return code.

I've printout the pdfUrl and copy it to the address bar of my browser, it works perfectly. What header/cookie am I missing in the java side to be able to download the file?

Thanks

[bootleg224]

Hey @corrspt can you provide your full code, likely a small mistake, there are now cookies or headers needed beyond the full URL we provide back.

[corrspt]

Ok, I'm closing the issue as I don't know what the problem is (but clearly something in my code as), but trying with something like this didn't work. (see working solution at the end)

private static void downloadFile(String fileURL, String saveDir) throws IOException {
    URL url = new URL(fileURL);
    HttpURLConnection httpConn = (HttpURLConnection) url.openConnection();
    int responseCode = httpConn.getResponseCode();

    // always check HTTP response code first
    if (responseCode == HttpURLConnection.HTTP_OK) {
      String fileName = "";
      String disposition = httpConn.getHeaderField("Content-Disposition");
      String contentType = httpConn.getContentType();
      int contentLength = httpConn.getContentLength();

      if (disposition != null) {
        // extracts file name from header field
        int index = disposition.indexOf("filename=");
        if (index > 0) {
          fileName = disposition.substring(index + 10, disposition.length() - 1);
        }
      } else {
        // extracts file name from URL
        fileName = fileURL.substring(fileURL.lastIndexOf("/") + 1, fileURL.length());
      }

      System.out.println("Content-Type = " + contentType);
      System.out.println("Content-Disposition = " + disposition);
      System.out.println("Content-Length = " + contentLength);
      System.out.println("fileName = " + fileName);

      // opens input stream from the HTTP connection
      InputStream inputStream = httpConn.getInputStream();
      String saveFilePath = saveDir + File.separator + fileName;

      // opens an output stream to save into file
      FileOutputStream outputStream = new FileOutputStream(saveFilePath);

      int bytesRead = -1;
      byte[] buffer = new byte[4096];
      while ((bytesRead = inputStream.read(buffer)) != -1) {
        outputStream.write(buffer, 0, bytesRead);
      }

      outputStream.close();
      inputStream.close();

      System.out.println("File downloaded");
    } else {
      System.out.println("No file to download. Server replied HTTP code: " + responseCode);
    }
    httpConn.disconnect();
  }

I tried with Apache HttpClient with something like this and it worked

import org.apache.http.HttpEntity;
import org.apache.http.client.methods.CloseableHttpResponse;
import org.apache.http.client.methods.HttpGet;
import org.apache.http.impl.client.CloseableHttpClient;
import org.apache.http.impl.client.HttpClients;


HttpGet httpGet = new HttpGet(pdfUrl);
      try (CloseableHttpClient httpclient = HttpClients.createDefault();
          CloseableHttpResponse response1 = httpclient.execute(httpGet)) {
        HttpEntity entity1 = response1.getEntity();
        // From apache-common-io
        FileUtils.copyInputStreamToFile(entity1.getContent(), output);
      }

Thanks for the quick reply 👍