Max-Cheng commented on issue #54373:
URL: https://github.com/apache/doris/issues/54373#issuecomment-3162598012
Hi @HappenLee,
Thanks for creating this enhancement issue! I'm very interested in this
NEON optimization work and have already started implementing it.
## Current Progress
I've completed the NEON implementation for `be/src/olap/hll.h`
(HyperLogLog algorithm).
## Implementation Plan
After analyzing the codebase, I've identified some files that currently
have AVX2 instructions but lack NEON equivalents:
### Components
1. **String Processing**
- `be/src/util/simdutf8check.h` - UTF-8 validation functions
- `be/src/util/simd/vstring_function.h` - String manipulation functions
- `be/src/vec/common/string_ref.cpp` - String search optimization
2. **File I/O**
- `be/src/vec/exec/format/file_reader/new_plain_text_line_reader.h` -
Line delimiter detection
- `be/src/vec/exec/format/file_reader/new_plain_text_line_reader.cpp`
3. **Data Structures**
- `be/src/olap/rowset/segment_v2/bitshuffle_wrapper.h` - Compression
algorithms
- `be/src/olap/rowset/segment_v2/bitshuffle_page.cpp`
I'm planning to submit incremental PRs for each component. Would you like
me to coordinate with any ongoing NEON-related work?
Looking forward to your feedback!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
