All started as just another stupid idea, writing an image indexer (reinventing the wheel ). The code should do the following things:
1st run
real 30m39.178s user 0m45.561s sys 3m42.557s
2nd run with out thumbnail generation but with EXIF information
real 10m14.281s user 0m58.208s sys 0m45.969s3rd run with out thumbnail generation and with out EXIF information
real 14m40.503s user 0m1.585s sys 0m7.535s
Here I am confused, managed to find out that transaction in sqlite can cause delay, so changed the code to do everything in single transaction 4th run with out thumbnail generation and with out EXIF information
real 0m1.032s user 0m0.216s sys 0m0.134s5th run with out thumbnail generation but with EXIF information
real 3m1.191s user 1m2.525s sys 0m34.524s
6th run with everything
real 16m47.241s user 0m43.652s sys 3m21.640s
So the major bottleneck is thumbnail generation, which I am currently doing Gdk.Pixbuf , for EXIF information I am using beautiful gexiv2 from awesome yorba guys.