-
Notifications
You must be signed in to change notification settings - Fork 27
PECOBLR-1121 JMH benchmark for Arrow parsing. #1162
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: PECOBLR-1121/arrow-patch/stack-3
Are you sure you want to change the base?
PECOBLR-1121 JMH benchmark for Arrow parsing. #1162
Conversation
A JMH benchmark for Arrow parsing of patched and unpatched Arrow Buffers and Buffer allocators.
| @Setup(Level.Trial) | ||
| public void setup() throws IOException { | ||
| // Load files into memory once before all benchmark iterations | ||
| arrowChunkBytes = loadFileToMemory(ARROW_CHUNK_PATH); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
so is the test data persisted in a local file?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Its in stack-1.
| private static final Path ARROW_CHUNK_PATH = Path.of("arrow", "chunk_1.arrow"); | ||
|
|
||
| /** Path to a LZ4 compressed arrow chunk. */ | ||
| private static final Path ARROW_CHUNK_COMPRESSED_PATH = Path.of("arrow", "chunk_1.arrow.lz4"); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
where is this file? will you add in separate PR?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Its in stack-1.
Description
A JMH benchmark for Arrow parsing of patched and unpatched Arrow Buffers and Buffer allocators.