Friday, 06 August 2010

Books of the world, stand up and be counted! All 129,864,880 of you.

Books of the world, stand up and be counted! All 129,864,880 of you.: "
Posted by Leonid Taycher, software engineer

When you are part of a company that is trying to digitize all the books in the world, the first question you often get is: “Just how many books are out there?”

Well, it all depends on what exactly you mean by a “book.” We’re not going to count what library scientists call “works,” those elusive 'distinct intellectual or artistic creations.” It makes sense to consider all editions of “Hamlet” separately, as we would like to distinguish between -- and scan -- books containing, for example, different forewords and commentaries.

One definition of a book we find helpful inside Google when handling book metadata is a “tome,” an idealized bound volume. A tome can have millions of copies (e.g. a particular edition of “Angels and Demons” by Dan Brown) or can exist in just one or two copies (such as an obscure master’s thesis languishing in a university library). This is a convenient definition to work with, but it has drawbacks. For example, we count hardcover and paperback books produced from the same text twice, but treat several pamphlets bound together by a library as a single book.

Our definition is very close to what ISBNs (International Standard Book Numbers) are supposed to represent, so why can’t we just count those? First, ISBNs (and their SBN precursors) have been around only since the mid 1960s, and were not widely adopted until the early-to-mid seventies. They also remain a mostly western phenomenon. So most books printed earlier, and those not intended for commercial distribution or printed in other regions of the world, have never been assigned an ISBN.

The other reason we can’t rely on ISBNs alone is that ever since they became an accepted standard, they have been used in non-standard ways. They have sometimes been assigned to multiple books: we’ve seen anywhere from two to 1,500 books assigned the same ISBN. They are also often assigned to things other than books. Even though they are intended to represent “books and book-like products,” unique ISBNs have been assigned to anything from CDs to bookmarks to t-shirts.

What about other well-known identifiers, for example those assigned by Library of Congress (Library of Congress Control Numbers) or OCLC (WorldCat accession numbers)? Rather than identifying books, these identify records that describe bibliographic entities. For example the bibliographic record for Lecture Notes in Mathematics (a monographic series with thousands of volumes) is assigned a single OCLC number. This makes sense when organizing library catalogs, but does not help us to count individual volumes. This practice also causes duplication: a particular book can be assigned one number when cataloged as part of a series or a set and another when cataloged alone. The duplication is further exacerbated by the difficulty of aggregating multiple library catalogs that use different cataloging rules. For example, a single Italian edition of “Angels and Demons” has been assigned no fewer than 5 OCLC numbers.

So what does Google do? We collect metadata from many providers (more than 150 and counting) that include libraries, WorldCat, national union catalogs and commercial providers. At the moment we have close to a billion unique raw records. We then further analyze these records to reduce the level of duplication within each provider, bringing us down to close to 600 million records.

Does this mean that there are 600 million unique books in the world? Hardly. There is still a lot of duplication within a single provider (e.g. libraries holding multiple distinct copies of a book) and among providers -- for example, we have 96 records from 46 providers for “Programming Perl, 3rd Edition”. Twice every week we group all those records into “tome” clusters, taking into account nearly all attributes of each record.

When evaluating record similarity, not all attributes are created equal. For example, when two records contain the same ISBN this is a very strong (but not absolute) signal that they describe the same book, but if they contain different ISBNs, then they definitely describe different books. We trust OCLC and LCCN number similarity slightly less, both because of the inconsistencies noted above and because these numbers do not have checksums, so catalogers have a tendency to mistype them.

We put even less trust in the “free-form” attributes such as titles, author names and publisher names. For example, are “Lecture Notes in Computer Science, Volume 1234” and “Proceedings of the 4th international symposium on Logical Foundations of Computer Science” the same book? They are indeed, but there’s no way for a computer to know that from titles alone. We have to deal with these differences between cataloging practices all the time.

We tend to rely on publisher names, as they are cataloged, even less. While publishers are very protective of their names, catalogers are much less so. Consider two records for “At the Mountains of Madness and Other Tales of Terror” by H.P. Lovecraft, published in 1971. One claims that the book it describes has been published by Ballantine Books, another that the publisher is Beagle Books. Is this one book or two? This is a mystery, since Beagle Books is not a known publisher. Only looking at the actual cover of the book will clear this up. The book is published by Ballantine as part of “A Beagle Horror Collection”, which appears to have been mistakenly cataloged as a publisher name by a harried librarian. We also use publication years, volume numbers, and other information.

So after all is said and done, how many clusters does our algorithm come up with? The answer changes every time the computation is performed, as we accumulate more data and fine-tune the algorithm. The current number is around 210 million.

Is that a final number of books in the world? Not quite. We still have to exclude non-books such as microforms (8 million), audio recordings (4.5 million), videos (2 million), maps (another 2 million), t-shirts with ISBNs (about one thousand), turkey probes (1, added to a library catalog as an April Fools joke), and other items for which we receive catalog entries.

Counting only things that are printed and bound, we arrive at about 146 million. This is our best answer today. It will change as we get more data and become more adept at interpreting what we already have.

Our handling of serials is still imperfect. Serials cataloging practices vary widely across institutions. The volume descriptions are free-form and are often entered as an afterthought. For example, “volume 325, number 6”, “no. 325 sec. 6”, and “V325NO6” all describe the same bound volume. The same can be said for the vast holdings of the government documents in US libraries. At the moment we estimate that we know of 16 million bound serial and government document volumes. This number is likely to rise as our disambiguating algorithms become smarter.

After we exclude serials, we can finally count all the books in the world. There are 129,864,880 of them. At least until Sunday.


"

Evernote for Windows gets WebCam notes

Evernote for Windows gets WebCam notes: "

Today, we released an update to Evernote for Windows (version 3.5.5) This update is full of behind the scenes improvements to speed and stability. There is one notable new feature: WebCam Notes!


Download Evernote for Windows now or check for updates


WebCam Notes



If you use a webcam with your Windows computer, you may see a new note type in your Evernote toolbar: WebCam note. Clicking the WebCam note button turns on your camera and pops open a snapshot window. Once you take the snapshot, a new note is created in Evernote containing the image.



This feature is great for taking quick snapshots of business cards and wine labels. You can even turn your computer around and snap a photo of a whiteboard after your next brainstorming session. Once in Evernote, those images will be synchronized and processed so that you’ll be able to find your notes from anywhere.



Please note that there are a lot of different Windows webcams on the market. We were able to test compatibility with some, but certainly not all. If your webcam is supported, then you will see the WebCam note option. If it is not supported, then the option may not appear or may not capture the image correctly. Be sure to restart Evernote whenever you attach a new webcam to your computer.


Download Evernote for Windows now or check for updates

"

Saturday, 17 July 2010

Android 101: How to change keyboards

Android 101: How to change keyboards: "

How to change Android keyboards

Looking to change Android keyboards? Maybe you want to try Swype, or the new Swiftkey, or any one of the other great keyboards available on our fair smartphone operating system. (And a lot of new phones, like the AT&T Captivate and Droid X seen above, come with more than one keyboard installed.) After the break, we'll walk you through downloading, installing and switching to a new keyboard and, just maybe, a new way of life. (OK, probably not.)


Posted originally at Android Central

Sponsored by Android Cases and Accessories



"

Evernote for Windows update

Evernote for Windows update: "

On Wednesday, we released an update to Evernote for Windows, which included a bunch of nice improvements in addition to the new Trunk features. Here are some details on what’s new.


Download Evernote for Windows (version 3.5.5) or check for updates


Multi-tagging



In this update, we added the ability to assign multiple tags to multiple notes at once. Here’s how it works. Select the notes that you want to tag (hold down CTRL while clicking to do a multi-select) then right click and choose “Tags…” from the menu. Next, select the tags that you want to assign.


By default, Evernote first shows only tags assigned to the selected notes. This is useful if one of the selected notes is already tagged in the way that you would like to tag the others. To view all tags in your tag list, uncheck the Hide Assigned Tags checkbox. You can also create a new tag right from this window.


Improved table editing


For those that love to make tables in their Evernote notes, we’ve got a nice update. Evernote for Windows now lets you add and remove columns and rows. May not seem like a big deal, but if you’re in the habit of making tables, then this is quite nice.


Lots more



  • Improved copying and pasting content from Microsoft Office applications

  • Improved multi-monitor support

  • Improved handling of default fonts

  • Improved design of Hide Unassigned Tags

  • Numerous stability improvements


Download Evernote for Windows (version 3.5.5) or check for updates

"

Friday, 16 July 2010

The Evernote Trunk

The Evernote Trunk: "


Today is a big day for Evernote. Today is the day that Evernote becomes more useful, more powerful and more exciting for every user. Every partner. Everyone.


For the past two years, Evernote has been focused on one goal: helping the world remember everything. All of the decisions we’ve made have been in support of that vision. Along the way, we realized that to make it happen we’d need a little help from our friends, so we released the Evernote API. While we were busy expanding and improving Evernote, developers across the world were building applications that added features and functionality to our young platform, expanding into areas we never imagined. That was then.


Today, there are more than 2000 developers building hardware and software application that hook into the Evernote memory platform. Products that, thanks to Evernote, become accessible from everywhere, sync between devices and have powerful search capabilities. For developers, Evernote has become a way to gain useful functionality. For users, every integration adds layers of usefulness to their Evernote experiences.


Which brings us to the big announcement: Welcome to the Evernote Trunk.


The Evernote Trunk: Discovery and Exposure



The Trunk is a showcase of great apps and products that makes your Evernote experience more awesome.


To access it, click on the new “Trunk” icon in today’s update to Evernote for Windows and Evernote for Mac (Evernote Web later today, iPad next week). Clicking it opens a window full of amazing intergrations. Today, there are nearly 100 items listed across five categories: Mobile, Desktop & Web, Hardware, Gear, and Notebooks (this one is really cool, more on that later).


Of the nearly 100 launch items, around a third are completely new products and integrations. Importantly, new or old, every single integration is in the spotlight. Wondering which scanner works with Evernote? You should check the Trunk. Want to know which Twitter clients sends tweets into Evernote? Look in the Trunk. Which devices come pre-installed with Evernote? You know where to go. Now, every product developer gets exposed to millions of Evernote users, and millions of Evernote user see how to get more out of Evernote. Pretty great!



Fantastic new integrations


We’re excited not only by the potential of the Trunk, but also by the amazing new integrations that we’re launching today. Some represent highly-requested functionality, such as voice transcription, PDF annotation, mind mapping, sharing, contact management, and more. Here are some highlights:




  • Voice transcription: Voice2Note, pliq.me, Quicktate

    Today we’re launching with three great voice transcription services. Let’s focus on the Voice2Note integration by Dial2Do. Once you link your Evernote and Voice2Note accounts, Voice2Note will automatically go through your Evernote account, find any voice notes, transcribe them, then insert the transcribed text into the original note. They also have a phone number that you can call, and your voice recording will be transcribed and added to your Evernote account. Voice2Note has a free and paid version.


  • PDF annotation: PDFpen (Mac), Nitro PDF Reader (Windows)

    Evernote now has PDF annotation. PDFpen by SmileOnMyMac and Nitro PDF Reader allow you to annotate your PDF and then send them into Evernote for safekeeping. This is particularly great for signing and saving digital contracts.


  • Mind mapping: Zeptopad Planner Note

    Create mind maps on your iPad using this incredibly intuitive application, then save it all into Evernote


  • So much more: Read It Later, Lil’grams, ScanBizCards, Receipts, and many more.


Unexpected connections


What makes the Evernote memory platform so interesting is the way that it connects seemingly unrelated products and applications. Now, a notable Twitter message sent to Evernote from Seesmic can be pulled into SAP StreamWork to help with a group project. Or, a child’s scribble sent to Evernote from EverPaint can be instantly shared with family and friends on Lil’grams. Or, a photo of a wine label snapped by an Eye-Fi Card-equipped camera can help generate a meaningful reminder in reQall. All of these connections would have been unlikely, but now with Evernote they’re seamless. Explore the Trunk to find ways to use applications together in ways you never thought possible.


Exclusive Notebook partners



And now for something completely different…With the Trunk, Evernote becomes a powerful content distribution platform. In the run-up to the launch we worked closely with some of our favorite blogs and publications to launch the new Notebooks category. In this section, you will find exclusive content created for Evernote by Make Magazine, Cool Hunting, California Home and Design, and BlackBook. We also have a great collection of puzzles and games from Puzzazz.com and dozens of Evernote Tips.


Importing Notebooks in your account


The Trunk allows users to select the branded Notebooks that they like, and have the notebooks imported directly into their Evernote accounts. Like adding a new book to your shelf, once you choose a notebook from one of our partners, it will instantly appear in your account. But that’s only the beginning. If for example, you choose the Make:Projects Home and Garden notebook, Evernote will add a notebook full of great do-it-yourself projects into your account. In Evernote that notebook is more than a piece of static content, it’s a starting point for all of the other DIY projects you come across. The same is true for the Cool Hunting Travel Notebook. The editors of Cool Hunting have collected lots of useful travel tips into the notebook, and that same notebook is also where you can place your own travel ideas and related research. What makes these branded Notebooks so intriguing is that all of the content represents the jumping off point for your creativity and exploration.


Much more to come


You will be hearing a lot more about the Evernote Trunk in the next weeks and months. First, we’ll be adding it to more Evernote platforms. Later this year, we’ll be adding in-Trunk purchasing and other revenue opportunities for products and Notebooks. But most importantly, we will be constantly adding new integrations and new notebooks to the Trunk. Make sure to check back often. In fact, it should become the first place you look when you’re thinking about getting something new. With so many great products, why invest your time and money in something that doesn’t hook into Evernote?


Join the Trunk


If you’re interested in having your product or Notebook listed in the Trunk, then send us a request here.

"

Wednesday, 14 July 2010

Picasa Web Albums goes on a Picnik

Picasa Web Albums goes on a Picnik: "Posted by Thomas Kang and Steve Leroux, Software Engineers for
Picasa Web and Picnik


A few months back we welcomed Picnik, the powerful online photo editor, into the Google family and today we’re happy to share the first of more exciting things to come.

Picnik’s rich editing tools are now integrated into Picasa Web Albums allowing you to experience them without ever having to leave your account. As long as you’re using Picasa in one of the Picnik supported languages, just click ‘edit’ from the edit drop down menu or from the new handy Picnik icon.



Then, Picnik away by applying an effect, adding a sticker, or exploring your own creative path with advanced tools. When you are done editing your photo, save back to your album by either replacing the existing image or making a new copy.



Sometimes 1+1 really does equal more than 2.
Happy Picniking (from right inside of Picasa Web Albums).


"

Monday, 12 July 2010

App Inventor in Action


A 60 second video showing an app being made with App inventor for Android.

Thursday, 08 July 2010

YouTube Mobile Gets a Kick Start

YouTube Mobile Gets a Kick Start: "(Cross-posted with the YouTube Blog)

It’s well known that the mobile internet is huge and growing fast; what’s surprising is exactly how fast. According to a recent report, within 5 years more users will connect to the internet via mobile devices than desktop PCs. YouTube consumption on mobile devices has also grown considerably -- playbacks were up 160% in 2009 over the previous year. And we’re excited to announce that YouTube Mobile now receives more than 100 million video playbacks a day. This is roughly the number of daily playbacks that YouTube.com was streaming when we joined forces with Google in 2006.

We launched YouTube on mobile devices in 2007 with about 1,000 videos available on the mobile site (m.youtube.com). While this suddenly opened up the possibility to access videos on the go, our site, mobile browsers and the hardware had limitations that prevented the mobile experience from keeping up with YouTube on the desktop. Today, more than ever, we know that you want to be able to find and access your favorite videos wherever you are. That’s why we’ve been working hard to roll out an updated version of the mobile site.

Here's what's new about the new mobile site:
  • It's really fast.
  • The new user interface incorporates larger, more touch friendly elements, making it easier to access videos on the go.
  • It incorporates the features and functionality you’ve come to expect from the .com site, like search query suggestions, the options to create playlists,the ability to designate “favorite,” “like,” or “unlike” videos directly from your device.
  • As we make improvements to Youtube.com, you’ll see them quickly follow on our mobile site, unlike native apps which are not updated as frequently.
As the world continues to go mobile, we think this is a great improvement for users who want a more consistent YouTube across many devices, no matter where they are. We're launching in English only today, but will be rolling it out in other languages in the coming months. You can access the latest YouTube mobile site from your iPhone or Android browser. To learn more, visit m.youtube.com to check out the latest improvements and take a minute to watch this demo video:



Posted by Andrey Doronichev, Product Manager recently watched 'Insane street football'


"

Friday, 02 July 2010

Tips & Tricks: Using Images in Google documents

Tips & Tricks: Using Images in Google documents: "As anyone working on a term paper, project plan, or party invitation will tell you, there’s a lot of truth in the old saying, “a picture is worth a thousand words.” With the new Google Documents editor, you can easily find and insert the perfect image into a document and it will behave exactly as you’d like it.

To get started, select Image from the Insert menu. In Google documents, you can import images from your computer or from a URL. But sometimes you don’t have the image you want to use on hand. Whether it’s a map of the Roman Empire or a photo of a golden retriever, you can now insert an image directly from Google Image Search.


You can add any .gif, .jpg, .png, .bmp image file, up to 2 MB in size.

Wrapping it up
It can be important for images in your document to interact in certain ways with your text. Maybe you want your term paper’s sentences to wrap around a country’s flag? Or perhaps you want images to embellish the lines of your restaurant’s menu?

In the new version of documents, we’ve added a new setting for images -- Inline or Fixed. An Inline image will behave like text -- as you add or subtract words and lines, the image will move around the page, just as words within a certain paragraph do.


Meanwhile, a Fixed image will stay anchored to a specific paragraph, and your words will wrap around it.


You can drag and drop the image around your document if the Fixed position is selected. Or, for an Inline image, you can copy and paste it as you would move around the text within your document.

Resizing images
To resize an image within your document, you can click on it, and a resize box will appear. You can maintain the aspect ratio of the image by dragging from the corner of the rectangular resize window. If maintaining that ratio isn’t important, you can click one of the boxes on any side of the image and drag until you’ve resized the image to your liking.


These advanced image options are available only for documents created in the new version of Google Documents. Let us know what you think in our help forum.

Posted by: Michael Thomas, Software Engineer


"

Wednesday, 30 June 2010

New Search Operators in your Documents List

New Search Operators in your Documents List: "Have you ever tried looking for a document or spreadsheet from a particular time or from a certain person about a specific topic? Let’s say you’re a rocket scientist and you’re looking for the presentation about “Prototype rockets with lasers” that your manager sent you last year.

Normally, you’d just search for [rockets lasers prototypes]. But, lets face it, you’re a rocket scientist so you get lots of matching results; just about every document you have is about rockets or lasers.

You could narrow the search in the advanced search menu or you can use Search Operators and refine the search directly in the search box:
  • Quotes for exact phrase matching. Example: [ 'match this phrase exactly' ]
  • OR to allow either one of several words. Example: [ 'rockets' OR 'shuttles' ]
  • Items without a certain word: [ rocket -man ] will return docs that mention rocket, but not rocket man.
  • Items you shared with, or had shared with you: [ from:ted@rocketsnlasers.com ] or [ to:ted@rocketsnlasers.com ]
  • Starred or Hidden items: [ is:starred ] or [ is:hidden ]
And we recently added a some new search operators:
  • Type of doc: [ type:{document, spreadsheet, presentation} ]
  • Items edited before (or after) a certain day: [ before:YYYY-MM-DD, after:YYYY-MM-DD ]
  • Items owned by Ted: [ owner:ted@rocketsnlasers.com ]
  • Items with “rocket” in the title: [ title:rocket ]; [ subject:rocket ] does the same thing
Now you, the rocket scientist, should be able to easily find your boss’ presentation by searching for [ rocket laser prototypes from:overhead@rocketsnlasers.com before:2010-01-01 type:presentation ].

Posted by: Vivek Haldar, Software Engineer


"

Sunday, 27 June 2010

Leftist Protesters on Violent Rampage Through Streets of Toronto

Sundown - Lyrics, by Gordon Lightfoot

Sundown
Gordon Lightfoot

I can see her lyin' back in her faded dress
In a room where ya do what ya don't confess
Sundown ya better take care
If I find you bin creepin' 'round my back stairs
Sundown ya better take care
If I find you bin creepin' 'round my back stairs

She's bin lookin' like a queen in a sailor's dream
And she don't always say what she really means
Sometimes I think it's a shame
When I get feelin' better when I'm feelin' no pain
Sometimes I think it's a shame
When I get feelin' better when I'm feelin' no pain

I can picture every move that a man could make
Getting lost in her lovin' is your first mistake
Sundown ya better take care
If I find you bin creepin' 'round my back stairs
Sometimes I think it's a sin
When I feel like I'm winnin' when I'm losin again

I can see her lookin' fast in her faded jeans
She's a hard lovin' woman, got me feelin' mean
Sometimes I think it's a shame
When I get feelin' better when I'm feelin' no pain
Sundown ya better take care
If I find you bin creepin' 'round my back stairs
Sundown ya better take care
If I find you bin creepin' 'round my back stairs
Sometimes I think it's a sin
When I feel like I'm winnin' when I'm losin' again

Sundown - by Elwood

Wednesday, 23 June 2010

Google Maps for Android Helps You Find the Right Place, Catch a Train, and Add Latitude Friends

Google Maps for Android Helps You Find the Right Place, Catch a Train, and Add Latitude Friends: "Hot off the presses, Google Maps for Android version 4.3 has added a couple new features to help you quickly choose the right place to grab dinner, catch the next train, and find friends to add in Latitude.

Have you ever had to make a split decision for dinner plans while on the go? Now, you can see a snapshot of what people are saying about places right on search result pages. Instead of poring through full reviews, you can start by looking at what the most frequently mentioned aspects about a place are, such as food, service, atmosphere, or anything else people keep mentioning. Just like on Place Pages for your computer, the color-coded bar gives an overview of how positively people are talking about any individual aspect. Tap one to see more details like the actual review snippets. Whether you’re looking for top-notch service or a vibrant ambiance, you can now pick just the right place to go.



You’ll also find a new addition to public transit station pages: upcoming schedules. Select any transit station icon directly from the map and open its page by tapping the window. You’ll find a handy list of the next departure times for any subways, trains, or buses that are leaving from that station where transit info is available.



In Google Latitude, we wanted to make it even easier for you to find friends and family with whom you’d like to share your location. Right at the bottom of your Latitude friend list, you’ll be able to quickly start sharing your location with long lost friends, loved ones, and others from your Google Contacts. Add any suggested friends by tapping the + icon and sending them a sharing request. Tap the x and they’ll be dropped from your suggested friends list. Don’t worry -- you can always add them later by choosing “Add friends” from the Latitude menu.



Get the latest version of Maps by searching for Google Maps in Android Market from Android 1.6+ phones. If you’re reading this on your phone, just tap here. Version 4.3 is available in all the countries and languages where Maps is currently available.

Visit our Help Center to learn more, ask questions in our Help Forum, or give us suggestions and vote on other people’s on the Mobile Product Ideas page.

Posted by Andrew Oplinger, Software Engineer, Google Mobile Team


"

Optical character recognition (OCR) in Google Docs

Optical character recognition (OCR) in Google Docs: "A couple of months ago, my co-worker, Mike, showed up at my desk with a pile of paper, each of the yellowed sheets densely covered with an ancient-looking typewriter font. His wife had recently discovered parts of her family chronicles in the attic, typed up by her grandmother many years ago! Now he was wondering if there was a way for her to continue writing the chronicles in Google Docs.

The papers sat on my desk for a while, but recently, I returned them to Mike with a smile, cheerfully telling him that what started as my 20% project is now ready for everyone to use -- Google Docs now officially supports importing scanned documents. What we launched as an experimental feature for the Documents List Data API last year is now available on the upload page: check the “Convert text from PDF or image files to Google Docs documents”, upload your scanned images (JPEG, GIF, PNG) or PDFs, and Google Docs will extract text and formatting from the scans for you to edit away.


For the technically curious: we’re using Optical Character Recognition (OCR) that our friends from Google Books helped us set up. OCR works best with high-resolution images, and not all formatting may be preserved. The original images will be included in the new document to make it easier for you to correct mistakes. Supported languages include English, French, Italian, German and Spanish, with more languages and character sets on their way. We’re looking forward to get feedback from you while we keep improving the feature over the next months.

And Mike’s scanned family chronicles have even been extended by an additional chapter in Google Docs: his wife recently had a baby boy named James!

Posted by: Jaron Schaeffer, Software Engineer, Google Docs


"