Nokia_HDPhoto

Implementation of Microsoft HD Photo Codec (JPEG XR) on Nokia’s Series 60 Platform



2008 Nokia University Relations Forum

June 12, 2008



Derek Pang, Dr. Jie Liang

Simon Fraser University School of Engineering Science



Slide 2



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Jie Liang



Outline

 Introduction • What is HD Photo? • Why HD Photo?  HD Photo on Nokia Phones  Summary



Slide 3



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Jie Liang



Introduction

 This project is about the comparison of different image compression standards  Digital images are ubiquitous:

  



 Image compression is necessary for the storage and transmission of images  JPEG is the most popular standard for image compression:





Internet Digital cameras Cell phones



Started in 1986, finalized in 1992.



Slide 4



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Jie Liang



JPEG

 Key features of JPEG:

 8x8-block Discrete Cosine Transform (DCT)  Huffman coding



 Pros:

 Low complexity

 Hardware friendly



 Cons:

 Unsatisfactory compression efficiency

 Blocking artifact at low bit rates



Slide 5



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Jie Liang



JPEG2000

 Designed to address the issues of the JPEG:





Finalized in 2000 Wavelet transform Adaptive arithmetic coding Improved efficiency Various scalabilities

http://en.wikipedia.org/wiki/JPEG_2000



 Key features:

 



 Pros:

 



 Cons:

  



 Current status:



Much higher complexity (3-4 times) http://www.jpeg.org/public/wg1n1816.pdf Limited industrial adoption, especially in hardware



Slide 6



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Jie Liang



HD Photo

 The latest image codec developed by Microsoft's Windows Media Group:

Originally known as Windows Media Photo Used by Windows Vista  Photo Gallery, thumbnail preview, …  Based on Lapped Transform instead of DCT or wavelet  Similar performance to JPEG 2000, but with much lower complexity  An attractive alternative to JPEG 2000, especially for hardware  Expected to become an international standard, JPEG-XR, by 2009

 



Slide 7



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Jie Liang



Lapped Transform

 The original lapped transform:

     



Developed by Malvar et al. in around 1985 DCT with post-processing Developed by Tran, Liang and Tu in 2001. DCT with pre-processing More flexible than the original lapped transform Adopted in HD Photo



 Time domain lapped transform:



 Lapped transform vs. Wavelet:

 



Similar coding performance Lapped transform has lower complexity



Slide 8



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Jie Liang



Our Project

 The original goals of this project:

To implement HD Photo on Nokia platform, in particular, the N82 phone  To compare the complexities and performances of HD Photo and JPEG on Nokia phones





 Thanks to Derek’s hard work, we have been able to implement the JPEG 2000 on the Nokia platform as well





This allows a fair comparison between HD Photo and JPEG 2000.



Slide 9



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Jie Liang



Outline

 Introduction • What is HD Photo? • Why HD Photo?  HD Photo on Nokia Phones (by Derek)  Summary



Slide 10



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Reference Codec





HD Photo :

  



HD Photo Device Porting Kit 1.0 from Microsoft Not Optimized for Symbian platform Written in C



 JPEG 2000:

 OpenJPEG 1.3 from http://www.openjpeg.org



A more appropriate benchmark to compare the performance with HD Photo Codec  Written in C





Slide 11



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



What we have implemented ?

 Environment

 



 Thanks to Nokia Open C initiative



S60 3rd Edition Feature Pack 2, Nokia N82 With modifications, we managed to port both codec to Nokia Series 60 Platform



 Intermixing Open C with Symbian C++, a simple GUI application is written





to demonstrate the encoding and decoding of JPEG XR  to measure and compare the performance against JPEG and JPEG2000



Slide 12



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Screenshots



Slide 13



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Result: Quality Comparison

 640x480 image, encoded at the same compression rate (3%) with a compressed file size of 27kB.



JPEG, PSNR 32.8dB



J2K, PSNR 35.4dB



JPEGXR, PSNR 36.4dB



Slide 14



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Result: Compression Comparison

 640x480 image, encoded at same quality.



JPEG

File Size



JPEG XR / JPEG2000

File size



40% smaller compared to JPEG!!



Slide 15



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Result : Quality Comparison

Compression Ratio Vs. PSNR

Image Size: 1024 x 768 Platform: Series 60 3rd Edition Target: Nokia N82

50 45 40 35



PSNR (dB)



30 25 20 15 10 5 0 0 2 4 6 8 10 12 14 16 18 20



Compression ratio (%)



JPEGXR



JPEG2000



Slide 16



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Result : Performance Comparison

Encoding Time vs. Number of Pixels

Platform: Series 60 3rd Edition Target: Nokia N82

40 35



30



Encoding Time(s)



25



20



15



10



5



0 0 100 200 300 400 Number of KP ('000 pixels) 500 600 700 800



JPEG



JPEG XR



JPEG2000



Slide 17



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Result: Performance Comparison

Decoding Time vs. Number of Pixels

Platform: Series 60 3rd Edition Target: Nokia N82

30 25



20 Decoding time (s)



15



10



5



0 0 100 200 300 400 Number of KP('000 pixels) 500 600 700 800



JPEG



JPEG XR



JPEG2000



Slide 18



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Jie Liang



Outline

 Introduction • What is HD Photo? • Why HD Photo?  HD Photo on Nokia Phones  Summary



Slide 19



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Summary

 We have implemented HD Photo and JPEG 2000 on Nokia phones

 We have verified the advantages of JPEG XR:  Better compression efficiency than JPEG  Faster encoding/decoding than J2K  Possible future work

  



Integration with Camera and Multimedia API Demonstration of progressive scaling and regional decoding Optimization of the codec



Slide 20



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



ADDITIONAL SLIDES



Slide 21



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Settings UI



Slide 22



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Result : JPEG XR vs JPEG

Encoding Time vs. Number of Pixels

Platform: Series 60 3rd Edition Target: Nokia N82

50 45 40



35

Encoding Time (s) 30 25 20 15 10 5 0 0 1 2 3 4 Number of MP 5 6 7 8



JPEG



JPEG XR



Slide 23



Implementation of Microsoft HD Photo Codec on Nokia’s Series 60 Platform



Presented by Derek Pang



Result : JPEG XR vs. JPEG

Decoding Time vs. Number of Pixels

Platform: Series 60 3rd Edition Target: Nokia N82

180 160 140 120 Decoding time (s) 100 80 60 40 20 0



0



1000



2000



3000



4000

Number of KP



5000



6000



7000



8000



JPEG



JPEG XR