Friday, October 28, 2011

One Million Healthy Children

Last Thursday, IBM Research announced a collaborative research effort with Georgia Tech that aims to improve pediatric healthcare from a payment and policy level. The project, called One Million Healthy Children, will apply advanced modeling and analytics to thousands children's healthcare records to better understand the inefficiencies that make up today's model, which encourages fee for service, rather than prevention and precise diagnoses. By examining factors far beyond the realm of medicine - the region's literary make-up, transportation hubs and access, healthy food stores and socioeconomic status of families - IBM and Georgia Tech hope to provide doctors, policymakers and patients a better idea of how to approach disease. The team will first look at diabetes, which accounts for over $174B in costs in the U.S. per year. 


The modeling technology used in this initiative was born out of IBM Research - Almaden, by a services research team led by Paul Maglio. The Smarter Planet Platform for the Analysis and Simulation of Health is a tool that uses a plug-and-play type of format to insert factors making up a population's health - the systems of systems so to say. IBM researcher on the project, Cheryl Kieliszewski tells us a little more about the project:

We are thrilled to partner with Georgia Tech on the One Million Healthy Children project.  Together, we aim to tackle a difficult, multi-dimensional problem in health – kids experiencing preventable chronic non-communicable diseases, such as obesity and diabetes, at ever younger ages, and which will have a major influence on overall health and well being throughout their lifespan.  To do this, we will explore a number of ways to create and use complex composite models to examine what-if scenarios to improve children's health.  

The partnership brings together Bill Rouse and his team at Georgia Tech, which has expertise in complex adaptive systems, in particular within healthcare modeling, and our team, which has expertise in composite model assembly. On the one hand, it provides the team an opportunity to help understand a difficult societal challenge – keeping our kids healthy – and on the other, it forces the team to confront technical issues, such as how to semi-automatically couple models from different domains, and also social and process issues to support complex decision making. We’re very excited about the potential of this project and for continued work with the Georgia Tech team.


IBM Press Release
"What Is or What If" - IBM Research news blog guest post by Professor William Rouse, Georgia Institute of Technology's Tennenbaum Institute Executive Director, co-chair of the National Academies Healthy America Initiative and member of the National Academy of Engineering
eWeek
HealthITNews
Information Week

Friday, October 21, 2011

We won an Emmy!

Earlier today it was announced that IBM was presented a unique award. Together with FOX, an IBM Research project born out of Almaden won an Engineering Emmy award for Innovation from the Academy of Television Arts and Sciences. According to the Academy, by improving the ability of media companies to capture, manage and exploit content in digital form, IBM and Fox have fundamentally changed the way that audio and video content is managed and stored.

The Linear Tape File System (LTFS), invented by IBM's lauded Research Division, enabled major improvements in digital workflow and dramatic reductions in the costs associated with capturing, storing and repurposing media content while providing dramatic improvements in transfer rates, storage density, automated workflow, meta-data capture and content availability.  Combining digital broadcast and IT standards in a broadcast environment, the LTFS has enabled real-time content recording and high-speed recovery of content to be a broadly-supported, multi-industry solution.


Michael Richmond, Brian Biskeborn, David Pease, Arnon Amir (Almaden Research), and Shinobu Fujihara (Yamato) at the 2010 NAB show where LTFS was announced and released.
In a blog post earlier this year, IBMer Tony Pearson, Master Inventor and Senior Managing Consultant for the IBM System Storage product line, wrote:

"With the capabilities of LTFS, IBM has introduced an entirely new role for tape, as an attractive high capacity, easy to use, low cost and shareable storage media. LTFS can make tape usable in a fashion like removable external disk, a giant alternative to floppy diskettes, DVD-RW and USB memory sticks with directory tree access and file-level drag-and-drop capability. LTFS can allow the for passing of information around from one system or employee to another. And as for high video storage capacity, a 1.5TB LTO-5 cartridge can hold about 50 hours of XDCAM HD video!"

Lead researcher on the project David Pease is a long time storage research expert at the Almaden lab in San Jose, CA. Pioneering many of the tape and disk storage technologies out of IBM Research over the last decade, David recalls a significant factor in deciding to pursue this project the way he did. "We really needed to make the first version open source," David said. "The idea of a file system that was cross-platform and interoperable was key; we wanted people to have an interface they were familiar with, similar to disk with file folders, drag and drop and double-click, but we also wanted to make sure it wasn't tied to only Windows or only Unix. The real future for acceptance for just about any kind of storage technology is interoperability and that people aren't tied to a platform."

David and his team developed LTFS from concept to fruition in just less than 3 years. An impressive feat in the research world, he shares some thoughts about winning an Emmy for his work:


First, I am truly stunned.  This recognition is more than we ever expected so early in the project, and hopefully it reflects the importance of what we've done.  When we started this work, we said that our goal was to change the tape industry and the Media and Entertainment business; it seems that we are well on the way to realizing these goals.

I have to point out that an idea and project like this are never the work of an individual.  From Ed Childers and the other tape experts in Tucson, to the folks at Almaden who encouraged me to get involved with tape (again), to the team of great researchers and developers who worked on this in my group, to the tape specialists in the Yamato Lab who joined my team or worked to support it, I have to say that we couldn't have gotten here without the efforts of each of you.  Thank you all for making this possible!

Fun fact: This past February, David Pease completed a 41-day motorcyle ride from San Jose, CA to Panama City, Panama with 3 companions on different stages of the trip. You can read about his travels through California, Northern, Central and Southeast Mexico, Guatemala, Honduras, Nicaragua, Costa Rica and finally Panama at his blog here.


*****UPDATE Monday, October 31*****

Here's a picture of David with the Emmy. You can see more pictures of the team from the Awards Ceremony here.



Friday, October 7, 2011

IBM Research - Almaden in Councilwoman Nancy Pyle's Newsletter


In 2005, Nancy began her first term on the San Jose City Council as the representative for District 10. A retired teacher of over 25 years and a former Community College Board Trustee, Nancy represents approximately 100,000 residents from Almaden Valley and Blossom Valley.

As District 10's City Councilmember, Nancy takes an innovative approach to solving today's challenges through creativity and collaboration. She has focused city government on the basics, maintaining our streets and parks, keeping our neighborhoods safe, investing resources in youth and senior programs and making city government more accountable.


Councilmember Pyle is the Chair of the Neighborhood Services and Education Committee and a member of the Airport Competitiveness Committee. She serves as the Council liaison to the Parks and Recreation Commission and the Disability Advisory Commission. Councilmember Pyle also serves on the Santa Clara County Emergency Preparedness Council.

 
Nancy Pyle is a graduate of LeMoyne College in Syracuse, New York, where she majored in French (she’s fluent!), and earned a Masters Degree in Educational Administration from the US International University in San Diego. In 1960, Nancy moved to San Jose with her family where she served as a teacher, Community Relations Manager, and Legislative Analyst for San Jose Unified School District. 

Monday, October 3, 2011

Best Paper Award for "An Optimal Algorithm for the Distinct Elements Problem"

Last month, the winners of IBM's 2010 Pat Goldberg Memorial Best Paper competition in computer science, electrical engineering and math were announced. IBM Research - Almaden computer scientist David Woodruff co-authored one of the winning papers, titled "An Optimal Algorithm for the Distinct Elements Problem" with Daniel M. Kane (Harvard University) and Jelani Nelson (MIT) for PODS 2010 (ACM Symposium on Principles of Database Systems).

The Professional Interest Communities at IBM Research (PICs) reviewed a total of close to 120 papers submitted by IBM Research authors and nominated 34 for best paper consideration. A worldwide Research team reviewed the nominated papers and selected four outstanding papers as the award winners.

All of the submitted papers represent IBM Researchers advancing our field and are indicative of our commitment to long-term, exploratory work that can change the way we look at the world.

Below, David explains a bit about his paper, what it might mean for the advancement of mathematical discovery and what it's like working for IBM.

Estimating the number of distinct attributes is a fundamental practical and theoretical problem in database applications dating back to the 1970s. It arises in trying to optimize a query sequence, where keeping the number of distinct elements small at intermediate stages in the sequence ensures the overall running time is low. It is also useful for comparing two data sets, e.g., how many new items did we get by putting the two datasets together? 

The techniques in this paper will be useful for improving the memory and time complexity of a number of fundamental problems in the data stream literature, related to estimating the number of distinct elements, such as estimating rarity, similarity, union sizes of databases, etc. 

They can also be used for estimating the number of distinct elements in the distributed model, sliding window model, and time-decayed model. In the distributed model, there are multiple servers, each holding a database, and we want to estimate the number of distinct elements in the union of the databases with as few communication and computational overhead as possible. In the sliding-window model, which could for instance be used on a router monitoring distinct source-destination traffic passing through it, it may be that we are only interested in the recent traffic, or we may at least want to give more weight to recent traffic. These variations correspond to the sliding-window and time-decayed models. 

My work closes a long-standing problem in the area of data streams. IBM Research has made a sustained effort to design data stream and sub-linear algorithms for a wide variety of problems, e.g., those in graph theory, machine learning, network traffic analysis, numerical linear algebra, and statistics. This work significantly bolsters that effort. 

I’m very grateful for the amazing amount of freedom and that I’ve been given at IBM, and have been able to use this to highly optimize my time and productivity. Interacting with interesting colleagues is one of the most exciting aspects of my job. It’s really enjoyable and a great learning experience.  

Research interests: data stream algorithms, communication complexity, numerical linear algebra, graph algorithms, coding theory, and cryptography 

Inspirational figures: The super theory group at IBM Research - Almaden 

When I'm not working, I'm: home remodeling, playing basketball, practicing chinese, traveling 

Favorite travel spots: Banff, Canada. Hangzhou, China. Venice, Italy. 

David Woodruff is a Research Staff Member in IBM Research - Almaden's Principles and Methodologies Group. He received a B.S. in computer sceince, B.S. in mathematics, M.Eng in computer science and Ph.D in computer science, each from MIT. David also contributes to IBM's cognitive computing initiative, SyNAPSE. 

Monday, September 26, 2011

IBM Research - Almaden Centennial Colloquia "Planet Scale Analytics"

Over 150 eminent leaders in the area of big data and massive scale analytics came together on Tuesday, September 20th for the IBM Research - Almaden Centennial Colloquia to discuss "Planet Scale Analytics." A truly collaborative event, speakers like Gus Hunt, Chief Technology Officer, CIA, Peter Breunig, GM Technology & Strategy, Chevron Corporation and Arvind Krishna, GM Information Management, IBM, convened to discuss the emerging - and explosive - wave of massive scale structured and unstructured data and the rise of analytics for actionable insight.

Leading executives from Juniper Networks, Coca-Cola, Genetench, Yahoo!, Agilent Technologies and Intuit were among attendees who came together to discuss data challenges from a business perspective, and were intrigued to learn about the findings and potential solutions presented in the technical sessions. The academic and research communities were naturally anxious to hear customer concerns and needs. Todd Myers, Chief Scientist for the National Geospatial Intelligence Agency attended to learn about emerging technologies designed to tackle analytics for massive data sets and commented, "IBM does a very good job of convening great speakers and thought leaders."

The three V's of big data - and the fourth

Arvind Krishna opened the morning, describing big data from the perspectives of the 451 group, IDC and IBM - all very similar by definition - large, complex and dynamic. Krishna shared IBM's spin on the big data definition by 3 v's: volume - data at rest, velocity - data in motion and variety - data in many forms. A fourth 'v', Arvind added, is veracity - data in doubt, used to describe 'contradictory data,' or noisy data - ultimately, unstructured data that experts are not sure how to deal with.

In a much anticipated technical discussion about analytics solutions, Shiv Vaithyanathan, IBM Research senior manager in Intelligent Information Systems, again mentioned these 4 v's in his talk titled "Entity, Relationship and 360-degree View of customers." "Veracity is turning noisy data like jargon and acronyms, even wishful thinking and sarcasm into trustworthy insights," Vaithyanathan said. "We're dealing with social media data from hundreds of sources - 10,000 messages per second from over 100 million active users per source - that needs to be combined and correlated to make near real-time decisions."

Using IBM's System T and SQL language, Shiv and the database experts at Almaden have built a 360 degree customer profile built on more than 2,000 rules, analyzing an average of half a terabyte of data on any given day. Vaithyanathan explained the advantages of the analytics tool throughout his talk and via demonstration. System T uses less than 10% of the cores to keep up with Twitter's daily feed with no drop in quality due to its linear scalability; a sharp decline in core usage from both state-of-the-art statistical systems and state-of-the-art open source rule-based systems that require the thousands of cores that System T does not.

Big data challenges in cities and across industries
Through a series of discussions on industry applications such as "21st Century Water Data: Needs and Availability" presented by Peter Gleick of the Pacific Institute and "Big Data in Finance: Quantitative, Qualitative and Relationship Information," by David Leinweber of Leinweber & Co., several challenges proving the need for deep analytical capabilities were shared. "We're entering a world where anyone can be a data source and upload some publicly interesting piece of data," Gleick remarked. "We can share information to an open source database, where you can add search capabilities." Adding to the notion of the changing face of data analytics, Leinweber commented, "Dealing with this is uncomfortable. We need to expect errors and strange innovations." He closed semi-jokingly with a quote by Ogden Nash: "Progress may have been all right once, but it's gone on far too long."

Chevron's Breunig presenting some noteworthy statistics from the oil and energy area: the alarming rate of data transfer and storage that Chevron is faced with daily. At 20PB day, doubling every 2 years with a declining signal to noise ratio, there's not only a dynamic cluster of data that needs to be wrangled, but a challenge in ways to apply that data to equally dynamic dimensions. "In the oil business, subsurface modeling has many uses, and its users have different needs," Breunig said. "This is a big data integration challenge."

Alexandre Bayen of UC Berkeley suggests that like traffic data, water and earthquake data needs to be online, sharing an interesting thought about traffic analytics: monitoring 2% of traffic in real time is sufficient to predict travel time. Additionally, Bayen proposes that tracking one year of yellow cab data in San Francisco can plot a map of the city with relative accuracy. In putting multiple sources of crowdsourced data, public feeds, texts and videos online, analytics can be applied in very similar ways, as long as they have the same basic properties: 1) a mathematical model, very important for physical phenomena, 2) data, 3) inverse modeling and data simulation resulting in estimates and eventually decisions.

Data privacy and sharing

A close collaborator with IBM, Fran Maier of TRUSTe usually has a hard time describing her job: internet privacy. She explained in a panel on privacy that her company works with companies to ensure that their policies and practices are standard and meet whatever promise they make with the consumer. "It's not easy," Fran said, "because privacy, unlike security doesn't have a 'bad guy'. The important elements are transparency and accountability." The cycle of delivering trust in privacy to internet consumers to allow for more interaction and sharing is important - without it, companies are unable to collect and use data sets.

Harriet Pearson, IBM's chief privacy officer, also shared some views on thought leadership from a large corporation perspective. "Companies like Facebook are experimenting in public and seeing where the norms might be," she explained. "One approach by some of the new entrants in the Silicon Valley is to push the envelope, then retract; push, then retract. Alternately, organizations set norms from the outset, or enlist the help of organizations like trustE. Policy making has not accelerated that much. It puts a premium on those who can function in environments of uncertainty and have the confidence to strive forward."

Next steps

Many of the comments shared throughout the day confirmed positive impressions of IBM's data analytics capabilities and the proximal and technical opportunities to impact the local "hotbed" of massive data streams. Others appreciated the opportunity to hear how other companies make use of technologies and models to analyze complicated situations. Al Leung, vice president and partner for acquisitions & logistics at IBM, expressed the advantages of bringing his clients to this forum to learn new techniques and explore some of IBM's offerings in a more personalized format. The conversation of massive scale analytics at IBM Research will continue locally and from a company-wide perspective, focusing on developing plans to expand collaboration efforts.

Soundbites from the event:



Tuesday, August 23, 2011

IBM's cognitive computing chips make waves

Last week, IBM unveiled the first ever cognitive computing chips - designed to learn without set programming, the chips emulate the brain's ability for perception, action, reaction and sensation, and have demonstrated the ability to recognize handwritten numbers and provide its best answer for what it "sees" on the screen. The chips have also learned how to play the game Pong, in which it "watches" the ball, predicts the trajectory, and moves the paddle to block the ball with amazing accuracy.

You can read all about the SyNAPSE project at ibm.com/synapse and catch up on the 10 ten things to know about the SyNAPSE project on the IBM Research news blog. Selected press clips follow, as well as a video highlight reel.



New York Times: I.B.M. Announces Brainy Computer Chip
Associated Press: IBM Pursues Chips That Behave Like Brains
The Wall Street Journal: IBM Announces Move Toward ‘Cognitive’ Computing
Bloomberg Businessweek: IBM Chip ‘Senses’ Events to React Like Brain
AFP: IBM unveils computer chips that mimic human brain
NBC: IBM's New Chips Act Like Your Brain
BBC: IBM produces first 'brain chips'
CNET: IBM says new chip mimics the human brain
GigaOm: For our sensor heavy future, IBM cooks up a new silicon brain
MIT Tech Review: IBM's New Chips Compute More Like We Do
Gizmodo: IBM's Processors Will Think Like Brains
Engadget: IBM's cognitive computing chip functions like a human brain, heralds our demise
Venturebeat: IBM produces first working chips modeled on the human brain


"Fascinating? No doubt. It's initiatives like these that demonstrate just how different IBM is from Hewlett-Packard and other peers, especially now that CEO Leo Apotheker is cutting consumer-facing operations to focus on big-ticket sales. Reverse-engineering brainpower would have to seem like a frivolous enterprise."
- Motley Fool

Tuesday, August 9, 2011

IBM CEO visits IBM Research - Almaden


Researchers at Almaden were thrilled to attend a townhall event with IBM Chairman and CEO Sam Palmisano on Thursday, August 4. In his first speaking engagement (to employees) at Almaden, he gave an overview of IBM's first half, and the audience of over 350 enjoyed his casual and personable presentation style, complete with a few friendly jokes.




Following the townhall, Mr. Palmisano presented a Centennial Lecture at the Computer History Museum in Mountain View, CA. Analyst Rob Enderle, in an article about the event, said:

"I attended a truly brilliant speech last night. It is now one of those that I’ll likely take with me to the grave...[IBM CEO Sam Palmisano] spoke about what it takes to make it through 100 years and I’ll remember both what he said and, more importantly, what he did, which is give IBMers hope."

(Read the rest of Rob's article here: What IBM and Sam Palmisano Could Teach Apple, Microsoft and President Obama on itbusinessedge.com)

Addtional coverage:

Harvard Business Review
IBM at 100: How to Outlast Depression, War, and Competition

EE Times
IBM CEO: How to live to be 100

eWeek
IBM CEO Palmisano Reflects on Company's 100 Years

Forbes
IBM's Palmisano: How You Get To Be a 100 Year-Old Company

Watch Mr. Palmisano's lecture at the Computer History Museum: What Changes and What Endures below: