End 2 End Process

[SbstnErhrdt]

• Have a look at the download of Zip front files (See test)
• Download (5 random files) (e.g. docdb_xml_bck_202308_001_A.zip)
• Write parser for index.xml in root directory of zip file. Have a look at https://blog.kowalczyk.info/tools/xmltogo/ to generate struct.

type DocdbPackageIndex struct {
	XMLName          xml.Name `xml:"docdb-package-index"`
	Text             string   `xml:",chardata"`
	ID               string   `xml:"id,attr"`
	DateProduced     string   `xml:"date-produced,attr"`
	DtdVersion       string   `xml:"dtd-version,attr"`
	File             string   `xml:"file,attr"`
	ProducedBy       string   `xml:"produced-by,attr"`
	VolumeID         string   `xml:"volume-id,attr"`
	DocdbPackageFile []struct {
		Text         string `xml:",chardata"`
		ID           string `xml:"id,attr"`
		Format       string `xml:"format,attr"`
		Size         string `xml:"size,attr"`
		Filename     string `xml:"filename"`
		FileLocation struct {
			Text     string `xml:",chardata"`
			Relative string `xml:"relative,attr"`
		} `xml:"file-location"`
		DocdbDocRange struct {
			Text                 string `xml:",chardata"`
			Country              string `xml:"country,attr"`
			DocdbFirstDocInRange struct {
				Text      string `xml:",chardata"`
				Country   string `xml:"country"`
				DocNumber string `xml:"doc-number"`
				Kind      string `xml:"kind"`
				Date      string `xml:"date"`
			} `xml:"docdb-first-doc-in-range"`
			DocdbLastDocInRange struct {
				Text      string `xml:",chardata"`
				Country   string `xml:"country"`
				DocNumber string `xml:"doc-number"`
				Kind      string `xml:"kind"`
				Date      string `xml:"date"`
			} `xml:"docdb-last-doc-in-range"`
		} `xml:"docdb-doc-range"`
	} `xml:"docdb-package-file"`
} 

• Parse index xml and keep amount of documents for later comparison. See Size in struct.
• Use the previous pipeline and store amount of parsed files
• Compare pipeline count with size and log potential differences
• Write a end 2 end test for the random files

[SbstnErhrdt]

done