[
https://issues.apache.org/jira/browse/HADOOP-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kihwal Lee updated HADOOP-7446:
-------------------------------
Attachment: pipelined_with_todds_patch.txt
pipelined_on_todds_patch.txt
I am attaching two patches for the pipelined checksum calculation. One is the
one on top of your patch and the other includes your patch.
{{#define USE_PIPELINED}} enables it. I cross examined the crc results from
slice-by-8, hardware and hardware-pipelined. I also tried 1 to 8 bytes, less
than one chunk(block) to three. They all match.
> Implement CRC32C native code using SSE4.2 instructions
> ------------------------------------------------------
>
> Key: HADOOP-7446
> URL: https://issues.apache.org/jira/browse/HADOOP-7446
> Project: Hadoop Common
> Issue Type: Improvement
> Components: native
> Affects Versions: 0.23.0
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Fix For: 0.23.0
>
> Attachments: hadoop-7446.txt, hadoop-7446.txt, hadoop-7446.txt,
> pipelined_on_todds_patch.txt, pipelined_with_todds_patch.txt
>
>
> Once HADOOP-7445 is implemented, we can get further performance improvements
> by implementing CRC32C using the hardware support available in SSE4.2. This
> support should be dynamically enabled based on CPU feature flags, and of
> course should be ifdeffed properly so that it doesn't break the build on
> architectures/platforms where it's not available.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
