More df implementations

[SinghGursimran]

More df implementations

#223

DiscardHttpStatus

import io.archivesunleashed._
import io.archivesunleashed.df._

RecordLoader.loadArchives("./src/test/resources/arc/example.arc.gz",sc)
			.all()
			.discardHttpStatusDF(Set("000"))
			.select($"url",$"crawl_date",$"HttpStatus")
			.show(10,false)

keepMimeTypes

import io.archivesunleashed._
import io.archivesunleashed.df._

RecordLoader.loadArchives("./src/test/resources/arc/example.arc.gz",sc)
			.all()
			.keepMimeTypesDF(Set("text/html"))
			.select($"mime_type_web_server")
			.show(10,false)

keepMimeTypesTika

import io.archivesunleashed._
import io.archivesunleashed.df._

RecordLoader.loadArchives("./src/test/resources/arc/example.arc.gz",sc)
			.all()
			.keepMimeTypesTikaDF(Set("image/jpeg"))
			.select($"mime_type_tika")
			.show(10,false)

[codecov]

Codecov Report

Merging #399 into master will increase coverage by 0.1%.
The diff coverage is 100%.

@@            Coverage Diff            @@
##           master     #399     +/-   ##
=========================================
+ Coverage   77.19%   77.29%   +0.1%     
=========================================
  Files          40       40             
  Lines        1495     1502      +7     
  Branches      280      281      +1     
=========================================
+ Hits         1154     1161      +7     
  Misses        218      218             
  Partials      123      123