[Bug]: Offset chunk of spark writer got wrong value and output location

[acezen]

Is there an existing issue for this?

• I have searched the existing issues

Current Behavior

• Offset chunk file's path output by spark writer is not compatible with the path get from edge info:

run mvn test -Dsuites='com.alibaba.graphar.WriterSuite test edge writer with vertex table and edge table

the offset0 output path is /tmp/edge/person_knows_person/ordered_by_source/offset/part0
but [getAdjListOffsetFilePath] method of edge info return /tmp/edge/person_knows_person/ordered_by_source/offset0
https://github.com/alibaba/GraphAr/blob/0991064e3f5a5844d453d2743bc2b03dc65fdf14/spark/src/main/scala/com/alibaba/graphar/EdgeInfo.scala#L291

• Offset value generated by spark writer is the edge count of src/dst, not the real offset.
  https://github.com/alibaba/GraphAr/blob/0991064e3f5a5844d453d2743bc2b03dc65fdf14/spark/src/main/scala/com/alibaba/graphar/writer/EdgeWriter.scala#L157-L163

Expected Behavior

• path: offset output path should compatible with edge info
• offset value should be the real offset value, not edge count.

Minimal Reproducible Example

cd spark
mvn test -Dsuites='com.alibaba.graphar.WriterSuite test edge writer with vertex table and edge table

Environment

• Operating system: MacOS
• GraphAr version:
  v0.1.0

Link to GraphAr Logs

No response

Further Information

No response

[acezen]

solved by pull request #63