Apache Parquet Java Performance Improvements

[iemejia]

This is a parent issue to track the ongoing work on performance improvements for encodings/decodings and other areas of the Java implementation. Since I am not a committer I don't have permission to create sub-issues so I am using this one as the main place to track them.

• Optimize PlainValuesReader by reading directly from ByteBuffer (12x decode speedup) #3493
  GH-3493: Optimize PlainValuesReader with direct ByteBuffer reads #3494
• Optimize PlainValuesWriter by writing directly to ByteBuffer slabs (up to 2x encode speedup) #3495
  GH-3495: Optimize PlainValuesWriter with direct ByteBuffer slab writes (~2.5x encode speedup) #3496
• Cache hashCode() for non-reused Binary instances (huge dictionary-encode speedup) #3499
  GH-3499: Cache hashCode() for non-reused Binary instances (up to 73x dictionary-encode speedup) #3500
• Optimize ByteStreamSplitValuesWriter: remove per-value allocation and batch single-byte writes #3503
  GH-3503: Optimize ByteStreamSplitValuesWriter with batched scatter writes #3504
• Optimize ByteStreamSplitValuesReader page transposition #3505
  GH-3505: Optimize ByteStreamSplitValuesReader page transposition #3506
• Optimize BinaryPlainValuesReader by reading directly from ByteBuffer #3509
  GH-3509: Optimize BinaryPlainValuesReader by reading directly from ByteBuffer #3510
• Add JMH benchmarks for encoding/decoding paths and fix parquet-benchmarks shaded jar #3511
  GH-3511: Add JMH encoding benchmarks and fix parquet-benchmarks shaded jar #3512
• Optimize dictionary writers by replacing fastutil Linked maps with OpenHashMap + ArrayList #3513
  Optimize dictionary writers by replacing fastutil Linked maps with OpenHashMap + ArrayList #3513
• Optimize DeltaByteArrayWriter and DeltaLengthByteArrayValuesWriter: remove per-value allocation and LittleEndianDataOutputStream wrapper #3516
  Optimize LittleEndianDataOutputStream.writeInt/writeShort with bulk write (resolves existing TODO) #3518
• Cleanup binary write path: avoid Binary.getBytes() copy in DeltaByteArrayWriter and remove LE wrapper from FixedLenByteArrayPlainValuesWriter #3520
  GH-3520: Cleanup binary write path (DeltaByteArrayWriter copy + FLBA LE wrapper) #3521
• Reuse intermediate buffers in RunLengthBitPackingHybridDecoder PACKED path (~22% throughput on dictionary-id decode) #3522
  GH-3522: Reuse intermediate buffers in RunLengthBitPackingHybridDecoder PACKED path (~22% throughput on dictionary-id decode) #3523

Only PRs (WARNING: The associated GH-XXXX is not correct)

• GH-3522: Optimize IntList.size() from O(slabs) to O(1) with running counter #3533
• GH-3522: Optimize delta binary packing with batch unpack32/pack32 and cached packers (+13-37% decode) #3534
• GH-3522: Add batch read APIs to ValuesReader hierarchy #3535
• GH-3522: Eliminate unnecessary page-size copies in compressed page assembly and CRC checksums #3536
• GH-3522: Reduce peak memory during row group flush by eagerly releasing column buffers #3537