Daily links for 06/12/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 06/03/2013

  • “While Microsoft apologists focus on Windows continuing to be the dominant desktop operating system, they keep missing the two elephants in the room: Windows 8 continues to fall behind Microsoft’s previous top operating system failure, Vista, and Windows is no longer the dominant end-user operating system.”

    tags: windows

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 06/02/2013

  • “His project, called the 2045 Initiative, for the year he hopes it is completed, envisions the mass production of lifelike, low-cost avatars that can be uploaded with the contents of a human brain, complete with all the particulars of consciousness and personality.”

    tags: avatar ai

  • “The open-source blogging platform and content management system (CMS), WordPress is ten years old now. A success story in its own right, WordPress has gone from being a simple blogging platform to an extremely helpful tool for building websites and enabling communication across the web, in the past decade.”

    tags: wordpress

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Monthly disclaimer

The postings on this site are my own and don’t necessarily represent my employer’s positions, strategies or opinions, especially if they are about the guitar, fishing, gardening, carpentry, porch building, and musical tastes.

Blog entries before 2010 are in my Archived Blog.

Posted in Website | Tagged | Comments Off

Daily links for 05/31/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Workforce analytics announcement

Today my team at IBM Research, in collaboration with our software colleagues, announced that we’ll be offering to customers new analytics capabilities in the areas of employee retention and workforce sentiment. The main details are the press release and an entry I published over on the IBM Smarter Planet Blog.

Comments on the Smarter Planet Blog, please.

Posted in Analytics | Tagged , , | Comments Off

Daily links for 05/27/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 05/26/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Partially rebuilding the kitchen porch

The porch in 2006Very long time readers may recall that in 2006 I built a new wooden porch off our kitchen door to replace some small concrete steps. It was a fun project, though it took longer than I expected. The structure of the porch is made of pressure treated wood, while the outer wood is plain and untreated other than being painted. Therein lay the problem, in one particular area.

If you look at the photo on the right, you see that the hand rails slant down and join to the bottom posts on the side of the posts. It looks nice. It also collects snow, ice, rain, and debris.

A couple of years ago I noticed that rot had begun to set into the top of the post on the left, and probably a bit on the right. Today I finally got around to repairing it. This is what the porch looks like mid-reconstruction:

Partial deconstruction of the kitchen porch

Most of the wood on the up-step side of the left post was rotten. I was hoping to save some of the outer wood since I had routed decorative fluting into the sides, but the rot wrapped around on the bottom. So I made the decision to just rip it all out. The porch on the right did indeed have some rot, but I can repair that without complete replacement.

The handrail will also need to be replaced since the bottom end has too much rot:

Partial deconstruction of the kitchen porch

I’m leaving it there for the moment until I put replacement on. I’ll need to unscrew all the spindles from the top and then screw the new rail onto them. I’ll use the old handrail as the pattern for the new.

My immediate plan is to let the pressure treated inner post dry out while I purchase some good quality treated 1x6s and a 1×4 for the outer post and the new hand rail. I’ll cut them roughly to size and let them dry out as well. This is necessary before I cut them to final size, angle the corners, and cut the new fluting. Then everything goes back together again.

When that is complete, I’ll cut some triangular pieces of wood and put them at the bottom of the handrails so that the rain and snow is diverted off to the sides. I’m hoping this is enough to save the post on the right from further damage.

Posted in Home | Tagged , | Comments Off

Daily links for 05/14/2013

  • “For many writers considering self-publishing, cost is the first question and concern. The range authors spend to self-publish varies dramatically. You can choose to self-publish completely free doing everything yourself, or you can spend thousands upon thousands of dollars paying for printing, marketing and other services. The trick is find the happy medium of buying what you need and doing what you can on your own.”

    tags: book publishing cost

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 05/11/2013

  • “Java programming for Apple’s iOS devices is not only possible but it’s getting easier all the time. Steve Hannah surveys the recent evolution of the Java iOS landscape, then introduces five open source Java iOS tools. Find out how Avian, Codename One, J2ObjC, RoboVM, and XMLVM resolve the challenges of Java iOS native client development for developers who are ready to go mobile. “

    tags: java ios mobile

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 05/08/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Some questions to ask yourself if you want to be a data scientist

Last October, the Harvard Business Review published an article called “Data Scientist: The Sexiest Job of the 21st Century.” I could virtually hear the rejoicing in the work hallways of analysts, mathematicians, statisticians, and computer scientists everywhere. At last, recognition!

While it is debatable in this case if the job really is sexy or even hip and will make you either, there’s really no question that the rise of analytics and big data are making these skills increasingly in demand. Is this the right job for you?

A good place to start to understand what is needed to be a data scientist is at the INFORMS Analytics Certification website. It costs money to get this, but the program information gives you an idea of the kinds of questions on the test, the sorts of case studies with which you should be comfortable, and the books and websites you can use for further learning.

In a more informal way, let me here ask some questions you should answer about yourself and your knowledge to see if this is a career or job you might consider. I’ve included a few technical questions to encourage you to learn more about some of the disciplines involved.

  • Do you suffer from math anxiety? Does solving equations, working with matrices, or making sense of table or graphs scare you? If so, this probably is not the field for you.
  • Are you comfortable with statistics? Could you in your spare time over the next month do what would equate to a first, solid, mathematically sound statistics course? Would you get an A for your efforts? You’ll need statistics to understand the data and to give yourself sanity checks about the conclusions you are drawing.
  • Is Microsoft Excel or OpenOffice Calc your favorite tool in your office productivity suite? Doing real analytics and big data often goes well beyond what you can do in a spreadsheet, but if this kind of software terrifies you, data science might not be a good match.
  • Do you know how services like Netflix choose what movies you would like to watch? Make an educated guess and then go learn some of the techniques. I won’t give you a reference, go explore what you find on the net.
  • Do you understand the differences between descriptive, diagnostic, predictive, and prescriptive analytics? Where does optimization fall among these?
  • Do you like saying the word “stochastic”? Do you know what it means?
  • Who was Andrey Markov and what was his obsession with chains?
  • What criteria and analysis would you use to predict who will win the next World Series, Super Bowl, or World Cup?
  • Under what situations would you use Hadoop, Hive, HBase, Pig, SPSS, R, or CPLEX?
  • How would you go about constructing your personal profile from all the public data about you on the web? This could be from yourself (e.g., your Twitter feed) or produced by others. Include your gender, your approximate age and income, the town in which you live, the high school to which you went, your hobbies, the name of your significant other, the number of children you have, your favorite color, your favorite sport, your best friend’s name, and the color of your hair. Does this scare you?
  • When can Twitter add to your insight about marketing campaigns and when does it just add unnecessary noise?

This is by no means an exhaustive list, but if these topics intrigue you, you have or are willing to get the technical background, and you know who Nate Silver is, you just might have a career in data science.

 

 

Posted in Analytics | Tagged , , | Comments Off

Math and Analytics at IBM Research: 50+ Years

Soon after I arrived back in IBM Research last July after 13 years away in the Software Group and Corporate, I was shown a 2003 edition of the IBM Journal of Research and Development that was dedicated to the Mathematical Sciences group at 40. From that, I and others assumed that this year, 2013, was the 50th anniversary of the department.

Herman Goldstine at IBM Research

I set about lining up volunteers to organize the anniversary events for the year and sent an email to our 300 worldwide members of what is now called the Business Analytics and Mathematical Sciences strategy area. Not long afterwards, I received a note from Alan Hoffman, a former director of the department, saying that he was pretty sure that the department had been around since 1958 or 59. So our 50th Anniversary became the 50+ Anniversary. Evidently mathematicians know the theory of arithmetic but don’t always practice it correctly

The first director of the department was Herman Goldstine who joined after working on the ENIAC computer and a stint at the Institute for Advanced Study in Princeton. Goldstine is pictured in the first photo on the right at a reception at the T.J. Watson Research Center in the early 1960s. Goldstine died in 2004, but all other directors of the department are still alive.

Directors of the Mathematical Sciences Department at IBM Research

We decided that the first event of the year celebrating the (more than) half century of the department would be a reunion of the directors for a morning of panel discussions. This took place this last Wednesday, May 1, 2013.

Reunion of the directors of the Math Sciences Department at IBM Research

Photo credit: Mary Beth Miller

I started the day by giving a glimpse of what the department looks like today: the above-mentioned 300 Ph.D.s, software engineers, postdocs, and other staff distributed over the areas of optimization, analytics, visual analytics, and social business in 10 of IBM’s 12 global labs.

I then introduced our panel pictured in the photo above. From left to right we have me, Brenda Dietrich, Bill Pulleyblank, Shmuel Winograd, Roy Adler (a mathematician who was in the department during the tenures of all the other directors except me), Alan Hoffman, Dick Toupin, Hirsh Cohen, and Ralph Gomory.

Ralph Gomory, Benoit Mandelbrot, and other IBM researchers pondering a math problem

My goal for the discussion was to go back and look at some of the history and culture of the math department over the last five decades. I was hoping we would hear anecdotes and stories of what life was like, the challenges they faced, and the major successes and disappointments.

Other than a few questions I had prepared, I wasn’t sure where our conversation would go. The many researchers who joined us in the auditorium at the T. J. Watson Research Center in Yorktown Heights, NY, or via the video feed going out to the other worldwide labs would have a chance to ask questions near the end of the morning.

I’m not going to go over every question and answer but rather give you the gist of what we spoke about.

  • Ralph Gomory reminded us that the department was started in a much different time, during the Cold War. The problems they were trying to solve using the hardware and the software of the day were often related highly confidential. However, every era of the department has had its own focus, burning problems to be solved, and operational environment.
  • Hirsh Cohen got his inspiration for the mathematics he did by solving practical problems such as those related to the large mainframe-connected printers. Many people feel that mathematics shouldn’t stray too far from the concrete, but it is not that simple. This isn’t just applied mathematics, it is a way of looking for inspiration that may express itself in more theoretical ways. The panelists mentioned more than once that the original posers of business or engineering problems might not recognize the mathematics that was developed in response. (I think there is nothing wrong with theoretical mathematics with no direct connection to the physical world, but there are some areas of mathematical pursuit that I think are just silly and of marginal pure or applied interest.)
  • In response to my question about balancing business needs with the desire to advance basic science, Shmuel Winograd told me I had asked the wrong question: it was about the integration of business with basic science, not a partitioning of time or resources between them. This very much sets the tone of how you manage such a science organization in a commercial company. The successful integration of these concerns may also be why IBM Research is pretty much the sole survivor of the industrial research labs from the 1950s and 1960s.
  • There was general consensus that it is difficult to get a researcher to do science in an area that he or she fundamentally does not want to work. This was redirected to the audience members who were reminded to understand what they loved to do and then find a way to do it. (This sounded like a bit of a management challenge to me, and I suspect I’ll hear about it again.)
  • Time gives a great perspective on the quality and significance of scientific work that is just not obvious while you are the middle of it. This is one of the reasons why retrospectives such as this can be so satisfying.

Discussing the future of BAMS

Photo credit: Mary Beth Miller

After the first panel and coffee break, we came back and I started the session looking at the future of the department instead of the history. We have an internal department social network community in IBM Connections and I started by summarizing some of the suggestions people came up with about what we’ll be doing in the department in five, ten, and twenty years.

Sustainability, robotic applications of cognitive computing, and mathematical algorithms for quantum computing were all suggested. Note that his was all fun speculation, not strategy development!

Eleni Pratsini, Director of Optimization Research, and Chid Apte, Director of Analytics Research, then each discussed technical topics that could be future areas for scientific research as well as having significant business use.

After the final Q&A session, we got everyone on stage for a group photo.

BAMS group photo

Photo credit: Steve Hamm

One thing that struck me when we were doing the research through the archives was how much more of a record we have of the first decade of the department than we do of the 40+ years afterwards. In those early days, each department did a typed report of its activities which was then sent to management and archived.

With the increasing use of email and, much later, digital photos, we just don’t have easy if any access to what happened month by month. As part of this 50+ Anniversary, I’m going to organize an effort to do a better job of finding and cataloging the documents, photos, and video of the department.

This should make it easier for future celebrations of the department’s history. I suspect I’m not going to make it to the 100th anniversary, but I just might get to the 75th. For the record for those who come after me, that will be in 2034.

Posted in Analytics | Tagged , , | 2 Comments

Daily links for 05/01/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | 2 Comments

Monthly disclaimer

The postings on this site are my own and don’t necessarily represent my employer’s positions, strategies or opinions, especially if they are about the guitar, fishing, gardening, carpentry, porch building, and musical tastes.

Blog entries before 2010 are in my Archived Blog.

Posted in Website | Tagged | Comments Off

Daily links for 04/28/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 04/27/2013

  • “This page contains sample equations represented by MathML markup. The page has been configured to always use HTML-CSS mode with web fonts to display the equations, which produces uniform layout and typesetting across browsers.”

    tags: mathml JavaScript

  • tags: mathml

  • “MathML is the XML standard for encoding mathematics. Originally intended as a means of incorporating mathematics in web pages, MathML has grown to become a general format for the exchange and communication of mathematics in a wide variety of math and science applications.”

    tags: mathml

  • “Recently we reported that Chrome has added support for MathML, a good method for representing maths on the web. Now a comment on a discussion about enabling MathML in Chromium, the open source web browser project from which Google Chrome draws its source code, has announced that this feature will be turned off, for now.”

    tags: mathml

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 04/24/2013

  • “All of this comes as big Web players are taking a hard look at their database investments. The buzz around the “NoSQL” database movement has begun to see a backlash. Late last year, Google announced its own efforts to shift back toward SQL database technology with its Spanner distributed SQL database research. And many read-heavy websites (such as Ars, for instance) have moved back to MySQL and other open-source SQL databases after dalliances with NoSQL.”

    tags: mysql mariadb

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 04/23/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 04/02/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Monthly disclaimer

The postings on this site are my own and don’t necessarily represent my employer’s positions, strategies or opinions, especially if they are about the guitar, fishing, gardening, carpentry, porch building, and musical tastes.

Blog entries before 2010 are in my Archived Blog.

Posted in Website | Tagged | Comments Off

Daily links for 03/26/2013

  • “Looking for an immersive platform for your company, non-profit, educational institution, or government agency? Start with the following list of vendors, all of which have a successful history of serving enterprise customers.”

    tags: 3d opensim

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 03/21/2013

  • “The Python Software Foundation (PSF) announced it has reached a settlement with POBox Hosting Ltd. of the United Kingdom over the latter’s trademark application for the term “Python” in connection with cloud hosting and its application for a figurative trademark in Europe incorporating the word “Python.” While the PSF owns the trademark for Python within the United States, it did not have an equivalent filing within the European Union.”

    tags: python software

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 03/09/2013

  • “A few years ago, I went looking for Python parsing tools. I spent a long time researching the various options. When I was done, I had a cheat sheet on the different alternatives. This is that cheat sheet, cleaned up a bit. It is very spotty. If you have updates to the information here, let me know. Because this is a compilation of factoids freely available on the web, it is in the public domain.”

    tags: parser python parsing library

  • ““What we’ll find is a reinvention of some very traditional processes in companies and a rethinking of how HR gets done,” she says. “It’ll be underpinned by a fact base that will inform where the highest value is to be added.””

    tags: talent

  • “So far, Samsung, taking a page from Apple’s marketing manual, has remained tight-lipped on its plans for the Galaxy S4. But just about everyone agrees that the product will be one that consumers and business users will to take a close look at.”

    tags: samsung galaxy mobile

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 03/08/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Simple introduction to analytics

This came up today in a discussion today, so I thought it would be useful to clarify some terminology related to analytics. Reporting and dashboards are not predictive analytics.

More generally,

  • Descriptive analytics is where you describe what is or has already happened, usually by processing a lot of data (which could be big). To show this, you use reporting or a dashboard that gives you tables, summaries, and graphics that make it easy to understand the situation and offers some insights that might not be obvious. The data might be last quarter’s sales information, movie theatre attendance, or e-book purchase preferences broken down by demographics, for example.
  • Predictive analytics uses techniques like simulation, statistics, and machine learning to extrapolate from past data or behavior to predict what might happen. Variations might be introduced so that you can get an idea of future results if you increase your sales force by 10%, decrease your price by 5%, or increase your manufacturing capacity, for example.
  • Prescriptive analytics often uses serious mathematical optimization techniques, simulation, and algorithms to help you understand how you should reach your goals. How many planes with given capacities, with crews based in specific locations, should be used on a given set of routes to accomodate so many passengers, all while minimizing fuel use and maximizing profits, for example.

By the way, be careful what you call analytics. If you compute the average sales attained by your staff last month this is probably just statistics and not deserving of the title “analytics.” I might be even less charitable and say it is just arithmetic.

Posted in Analytics | Comments Off

Daily links for 03/07/2013

  • “Companies are not created equal when it comes to social media maturity. In its latest research, Altimeter Group’s Charlene Li and Brian Solis uncovered a distinct gap between organizations that execute social media strategies and those that are truly a “social business.” On one side, there are businesses (specifically, departments) that are actively investing in social media without being tied to business goals. On the other side are organizations that are deeply integrating social media and social methodologies throughout the company to drive real business impact.”

    tags: social business

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Social Media and the Professional: Enterprise Social Media

In this series I’m looking at my experiences using social media as a business professional. In this entry I examine the rules and policies I personally use regarding enterprise social media.

In the introduction to this series of blog entries, I asked several questions regarding my use of particular social media services, and how I manage the intersection of my personal and professional lives in them.

Here I’m going to look specifically at enterprise social media. That is, services that allow you to blog, post status updates, comment on the status of others, all inside your company’s or organization’s firewall. I’ll assume that what is posted is seen only by people in your organization, not by the general public.

I think use of multiple social networks only has value if you do different things on each of them. If one service targets a specific audience, use it with those people in mind. If you are more or less throwing the same material at all of them, I think you are spamming people, hoping it will lead to some sort of positive outcome for yourself. Therefore, if you post blog entries externally, there is no need to repost internally, but perhaps a link will do.

Enterprise social media is tricky because what you post could be seen by your bosses, your colleagues, and your employees, not to mention HR. You want to keep it relevant to your work life but you do need to be aware of the politics and sensitivities involved.

Do not use internal enterprise social media to state how brilliant you think management and their status updates are and how much their postings have changed your outlook on life, the way you’ll raise your children, or the very essence of your being. It’s fine to just click “Like.”

Be constructive, don’t use use enterprise social media to build a mutual admiration society. Ask questions, get a better understanding of the details of how the business is run and why decisions were made, and improve upon the suggestions of others. Don’t ever say in a response posting “What is more important …” but rather say “What is also important …”.

Share what you have learned about making products or service engagements better. Pass along dos and don’ts about working with clients. Don’t ever criticize a client as individuals or a company in your postings. Think about how new technologies like mobile and analytics can help you serve customers better and share your thoughts with your colleagues.

Be interesting. Be a person.

The social media service I use inside IBM is Connections.

Here are answers to the standard questions I’ve used in all these postings.

Who will I follow?

I follow (or connect with) people I know and have worked with directly. IBM has over 400,000 employees. If I connected with everyone, I could never find anything of value in the stream of status updates.

Who will I try to get to follow me? Who will I block?

I’ve suggested to my current employees that I would be honored if they connected with me, but it is completely optional. If anyone expresses uneasiness that “the boss” is watching what they post, I won’t follow them. No one is blocked (I’m not even sure I could if I wanted to).

How much will I say in my profile about myself?

Much of my work contact information is pulled up automatically. I’ve added a few other items, plus links to my external social networking activities. I certainly don’t list my personal hobbies in my inside-IBM profile, though I don’t think that is out of bounds in general. Since I cover my personal social networking elsewhere, I don’t redundantly add things in my internal profile.

What kinds of status updates will I post? How often will I post?

Though many people blog internally, I don’t. When I first started blogging in 2004 I had a WebSphere blog, then a developerWorks blog, an internal blog, and then one WordPress personal blog and one WordPress business blog. It didn’t take me long to decide I needed just one, and that is what you are reading here.

If I had something to say about open source, standards, Linux, WebSphere, or mobile, I would not have a special inside-IBM version and a different outside-IBM one. For one thing, this helped me keep the messages straight! Since I spoke publicly quite a bit, I needed to make sure that I did not say things internally in print that might inadvertently get repeated externally.

I do use Connections Communities now to share very specific internal information with named groups of people, such as the worldwide Business Analytics and Mathematical Sciences community. This is quite useful.

In terms of status, I post questions, some simple statements about IBM activities in which I’m engaged, and occasionally some critiques of features of processes or software.

While it’s fine to inject the occasional comment about non-work matters, I do not recommend that you use a lot of bandwidth in your company’s social networking service discussing American Idol or the World Cup. Take it elsewhere, perhaps to Facebook.

When will I share content posted by others?

Sometimes if I think it is really important or answers a question someone posts.

How political, if at all, will I be in my postings?

Zero, nada, zip.

How much will I disclose about my personal details and activities in my postings?

See above.

On what sorts of posts by others will I comment?

Anything I see where I might add something useful to the conversation.

What’s my policy about linking to family, friends, or co-workers?

I’ll link to co-workers to share what they’ve said or to note them as experts on a particular subject.


Blog entries in this series:

Posted in Social Media | Tagged , | Comments Off

Daily links for 03/05/2013

IBM, OpenStack, and the cloud

Scientific computing

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

IBM, standards, and the cloud

I just figured out that I’ve been involved with standards for almost one-third of my life, since the mid-1990s. During that time, I’ve been employed by IBM but I’ve also worked collaboratively with other people in the IT industry on standards efforts in groups like the W3C and OASIS. I think that collectively we’ve helped move the industry from “proprietary and locked-in” toward “open and interoperable.” That’s a good thing.

With that prolog, I’m pleased to help announce that, moving forward, IBM will base all its cloud services and software on an open cloud architecture. To kick this off, IBM will deliver a new private cloud offering based on the OpenStack open source software. (More marketing sort of stuff is available in the press release)

I don’t think I need to convince you how important the cloud is. Together with the other three elements of the Big Four — Mobile, Social, Big Data/Analytics — the cloud is the foundation on which many new apps and applications are being built.

Let’s say I get this brilliant idea for a new mobile app and I’m going to start a new company. Since I’m just starting out and I don’t have my own datacenter, I look for a cloud provider to host my server code and allow me to scale. Scalability is important because I plan to be very successful.

Do I choose a provider that will lock me into a proprietary cloud operating environment forever, or do I look for one that has a standards-based strategy that will give me the freedom to move to another provider if I choose to do so.

Why might I want to switch? It’s usually for economic or quality of service reasons. That is, I can get more for my money elsewhere, or the other provider is faster, more reliable, or more secure. If you are locked into a proprietary cloud architecture, changing to an alternative host can both be hard and expensive.

That’s why this decision by IBM is a good one, in my not necessarily impartial opinion. Starting with the private cloud makes sense because it allows you to work within your own firewall. As more and more OpenStack-based providers become available, you’ll be able to extend your open architecture from your environment out into hosted environments (and back again).

Here are a few links to some older blog entries where I discuss standards and open source:

Posted in Standards | Tagged , , | Comments Off

Social Media and the Professional: LinkedIn

In this series I’m looking at my experiences using social media as a business professional. In this entry I examine the rules and policies I personally use regarding LinkedIn.

In the introduction to this series of blog entries, I asked several questions regarding my use of particular social media services, and how I manage the intersection of my personal and professional lives in them. Here I’m going to look specifically at LinkedIn. This is the way I use the service and may or may not be how you do or should use it yourself.

Initial true confession: I don’t actively use LinkedIn as I much as I think I should. I only use the free service, not a paid premium one. I’m including this entry for completeness and as a way to motivate myself to do more with it.

I think use of multiple social networks only has value if you do different things on each of them. If one service targets a specific audience, use it with those people in mind. If you are more or less throwing the same material at all of them, I think you are spamming people, hoping it will lead to some sort of positive outcome for yourself.

So discretion and care is needed, and I need to use LinkedIn more and better.

Who will I follow?

Of all the social networking services, I’m least restrictive in who I “friend” on LinkedIn.

That is, if someone offers to connect with me and it doesn’t look like spam or some other random approach, I will usually accept the connection.  I do try to connect with people who are current or former colleagues at IBM, and colleagues or clients with whom I’ve worked closely or hope to do so.

There is a non-trivial overlap in whom I friend in Facebook and whom I connect with on LinkedIn, but only if I wish to follow or engage with them in both the personal and business sides of their lives.

Who will I try to get to follow me? Who will I block?

Answered above regarding following, since it is a two way street. I don’t believe there is a way to block people, but I do ignore spam or questionable invitations.

How much will I say in my profile about myself?

My entire business resume.

What kinds of status updates will I post? How often will I post?

I don’t really post directly on LinkedIn yet, but rather have tweets and links to my blog entries posted there. This is too passive, I know.

When will I share content posted by others?

Very rarely, so far.

How political, if at all, will I be in my postings?

Not at all, unless something sneaks in via a tweet being reposted on LinkedIn.

How much will I disclose about my personal details and activities in my postings?

Only what is on my public resume, which is also online.

On what sorts of posts by others will I comment?

Rarely, but I plan to do more. I do actively recommend people if I have personal knowledge of their abilities. I use the simple form rather than writing out comments. If someone needs a longer recommendation from me or wishes to use me as a reference for a job, they should contact me directly. However, I’m happy to say that someone is proficient in C++ or SOA, for example.

What’s my policy about linking to family, friends, or co-workers?

I don’t.


Blog entries in this series:

Posted in Social Media | Tagged | Comments Off

Monthly disclaimer

The postings on this site are my own and don’t necessarily represent my employer’s positions, strategies or opinions, especially if they are about the guitar, fishing, gardening, carpentry, porch building, and musical tastes.

Blog entries before 2010 are in my Archived Blog.

Posted in Website | Tagged | Comments Off

Daily links for 02/26/2013

  • “Oracle no doubt got the bang for the big bucks it paid for MySQL via its Sun acquisition. But the original developers of MySQL won’t let it die and as developers and customers begin to defect to their increasingly popular MySQL Fork — MariaDB — is it time for Oracle to hand the code over to Apache or an open source savvy organization?”

    tags: mysql oracle apache

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 02/21/2013

  • “The company is announcing a major initiative into mobile, involving software, services and partnerships with other large vendors. I.B.M. plans to deploy consultants to give companies mobile shopping strategies, write mobile apps, crunch mobile data, and manage a company’s own mobile assets securely.”

    tags: mobile ibm

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

IBM broadcast from Mobile World Congress 2013

Last year I had the pleasure of speaking at the Mobile World Congress in Barcelona about IBM’s mobile strategy after we acquired Worklight. This year, IBM will broadcast a 30 minute show featuring news, discussions with industry analysts and customers, and more.

To register for the broadcast, visit “Live from Mobile World Congress:  Put your Business in Motion.”

Here’s a blurb from the registration page:

Mobile World Congress is the industry’s largest event and the best place to learn about the latest in mobile technologies, and how to build a true mobile strategy. If you’re not able to attend in person, IBM will bring the event to you on February 28 at 12:00pm EST with behind-the-scenes highlights from the show in a 30-minute broadcast featuring mobile experts with a look at some of the new mobile strategies and technologies available today.

Please join us for “Live from Mobile World Congress: Put your Business in Motion” to get insights from industry experts, and to explore lessons learned from business leaders who have built true mobile enterprises. The high-definition broadcast is available on PCs, tablets and smartphones, and will include a brief Q&A.

Posted in Mobile | Comments Off

Daily links for 02/20/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 02/17/2013

  • “As far as New Year’s resolutions go, hardly anything does one’s mental, spiritual, and creative health more good than resolving to read more and write better. Today’s reading list addresses these parallel aspirations. And since the number of books written about reading and writing likely far exceeds the reading capacity of a single human lifetime, this omnibus couldn’t be—shouldn’t be—an exhaustive list. It is, instead, a collection of timeless texts bound to radically improve your relationship with the written word, from whichever side of the equation you approach it.”

    tags: writing reading list books

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 02/15/2013

  • “Norwegian browser developer Opera has announced that it is going to end the use of its own rendering engine, Presto. Over the course of 2013 the company will switch its browser products to use WebKit, the rendering engine used in Apple’s Safari and Google’s Chrome. Specifically, Opera says that it will base future software on Chromium, Google’s open source project that contains most, but not all, of the code used in Chrome.”

    tags: opera webkit chromium

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 02/13/2013

  • “From tracking the illegal trading of hazardous substances and uncovering evidence of the trade in endangered big cats including tigers in Asia, data analytics is increasingly being used to fight environmental crime. Much like organized crime, environmental crime can be localized or global. Left unchecked, it can threaten biodiversity and species’ survival on a global level.”

    tags: analytics big_data

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 02/12/2013

  • “Anyone who reads eBooks is aware that a number of content vendors are using proprietary platforms in an effort to lock you into their content libraries: most obviously, Amazon, with its Kindle line, Barnes & Noble with its Nook devices, and Apple with its iPads and iPhones. But there are many non-content vendors that would love to sell you an eReader as well, such as Kobo, and Pocketbook, not to mention the smartphone vendors that would be happy to have you use their devices as eReaders, too. “

    tags: epub ebook

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 02/08/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Tagged , | Comments Off

Daily links for 02/07/2013

  • “DARPA (the U.S. Defense Advanced Research Projects Agency) has awarded $3 million to software provider Continuum Analytics to help fund the development of Python’s data processing and visualization capabilities for big data jobs. The money will go toward developing new techniques for data analysis and for visually portraying large, multi-dimensional data sets. The work aims to extend beyond the capabilities offered by the NumPy and SciPy Python libraries, which are widely used by programmers for mathematical and scientific calculations, respectively.”

    tags: python big-data analytics

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Tagged | Comments Off

Social Media and the Professional: Facebook

In this series I’m looking at my experiences using social media as a business professional. In this entry I examine the rules and policies I personally use regarding Facebook.

In the introduction to this series of blog entries, I asked several questions regarding my use of particular social media services, and how I manage the intersection of my personal and professional lives in them. Here I’m going to look specifically at Facebook. This is the way I use the service and may or may not be how you do or should use it yourself.

Google+ is similar to Facebook in many ways, and I do have an account. I don’t use it actively, however, so I’ve excluded it from this multi-part discussion.

Who will I follow?

Of all the social networking services, I’m most restrictive in who I “friend” on Facebook. With almost no exceptions, the people I friend are my relatives, friends, people with whom I’ve worked, and others that I’ve met and care about following the twists and turns of their lives.

I don’t offer to friend people who work for me, but will consider it if they friend me. I don’t friend people for whom I work.

Since I’m more willing to have political discussions on Facebook, I may not friend someone who I know only peripherally yet will argue vociferously with me.

I very much enjoy having a Facebook friend who I may not know very well in real life, but who puts up funny or thought-provoking material.

This is obvious, but Facebook is a great way of staying touch with friends, acquaintances, and colleagues when we are separated by miles, years, and live events. That said, I’m not friends with everyone from high school who is also on Facebook, for example.

Who will I try to get to follow me? Who will I block?

New people show up on Facebook all the time. As I see them, I may friend them.  I may look for new people to add by looking at the lists of friends of friends.

I do not try to friend people I meet in business customer meetings. I use LinkedIn for that.

I used to have some people for whom I worked on my friends list, but I blocked my content from them. Eventually I decided that is was easier to just unfriend them. I don’t think my bosses need to see my Facebook content and when I add it.

In some cases I do block people from seeing my content, but this is usually in times of high social stress such as elections, school shootings, and civil liberties events.

How much will I say in my profile about myself?

I have basic contact information on Facebook but not my home address. Otherwise, I use the living room analogy: if you and I are speaking in my living room, you’ll see photos of my wife and kids, pet my cats, and we may decide to do an activity together.

I’m happy to give you my phone numbers or my email addresses. We can also chat about college and where we’ve worked. I don’t expect you to wander around the house, look in the closets and dressers, and go through my personal papers.

In a similar way, I share that sort of profile information with the people I trust to be my friends on Facebook.

What kinds of status updates will I post? How often will I post?

Yes, I post cat photos, but not all the time.

Gideon and BeatnikI would estimate that perhaps only 20% of what I post on Facebook relates to what I would call business or professional content. Generally, my content is related to who I am, not what I do for a living. I lead the math department at IBM Research, but I am a mathematician, so I’ll post some math-related items because I find them interesting and hope my friends might as well.

Since IBM is a large company and has hundreds of thousands of customers, I have to be careful about what I say about a business, even if I am a consumer of their products or services. It’s not uncommon for me to think something like “after I retire, I’m going to say what I really think of so-and-so’s labor practices.” This does not completely eliminate my posting or sharing content that expresses negative sentiments about a company, but it moderates my thinking about it.

Conversely, if I had a great consumer experience, I happy to tell my friends about it.

I probably average 1 to 3 Facebook updates a day. When I started using Twitter I did 5 to 10 updates daily there, but that number has fallen off.

When will I share content posted by others?

Most of the content I share comes from Facebook pages I “like,” such as that from the New York Times. If a friend puts up a link or a great image, I may share that. I don’t use Facebook as the collection point for work-related links to articles, but rather use the Daily Links category on my blog for that (example).

How political, if at all, will I be in my postings?

I’m most political on Facebook, but less so than my wife. I do a lot more “likes” of political postings by others with which I agree than direct posting.

How much will I disclose about my personal details and activities in my postings?

This is related to the profile question and response above, along with the living room analogy.

As I said about Twitter, I don’t tell my friends every place I go. I may tell friends where I was last week, however. I try to avoid the “I’m not home, so come rob my house” posting syndrome.

Another element of posting about travel is that it may tip people off to why I am on the road and who I’m going to meet. Here’s a little quiz. If I tell you I am visiting the following cities, which companies or government organizations am I likely to be visiting: Brussels; Redmond, Washington; Redwood Shores, California; Walldorf, Germany. (The IBM equivalent would be Armonk, New York.)

On what sorts of posts by others will I comment?

I have rules about this, I just wish I followed them more often. My children would prefer I did not add comments to their Facebook postings or activities. Adding a “Congratulations!” comment is almost always ok, as is a “Hope you feel better!” one.

With some friends, we seem to have developed a particular style of brief chatting that mimic what we would say if we lived or worked closer together.

The dumbest thing I ever do and I simply must stop is to respond to a comment on a friend’s posting, where the comment comes from someone I do not know. If it’s a simple agreement, that’s fine. If it’s to argue a political point, that’s going to cause me angst.

There are a lot of trolls out there, and I have to avoid feeding them.

I really wish Facebook would allow me to not see comments from specific people that I wish to block. I don’t follow these people and I don’t want to see anything they write.

What’s my policy about linking to family, friends, or co-workers?

If someone asks me not to link to them, I won’t. It’s mostly my children who have said this. I typically do not link to someone unless they have commented on a posting of mine. If I want to draw their attention to something, I’ll send them a personal message.


Blog entries in this series:

Posted in Social Media | Tagged | Comments Off

Photo: Just resting her eyes

20130204-202905.jpg

Posted in Photos | Comments Off

Social Media and the Professional: Twitter

In this series I’m looking at my experiences using social media as a business professional. In this entry I examine the rules and policies I personally use regarding Twitter.

In the introduction to this series of blog entries, I asked several questions regarding my use of particular social media services, and how I manage the intersection of my personal and professional lives in them. Here I’m going to look specifically at Twitter. This is the way I use the service and may or may not be how you do or should use it yourself.

I do not have separate Twitter accounts for work and my personal life. If you go to my Twitter account, you’re likely to see several aspects of my personality. I think that’s important: if I had a work-only blog it might sound like a marketing channel.

Who will I follow?

If I follow more than about 400 people or Twitter accounts, I find it hard to separate out what is important from what is not. That is, the noise dominates the signal.

Every month or two I go through the accounts I follow and drop those that seem to hibernating or otherwise unused. I’m happy to follow someone to see if I find they are posting interesting or informative stuff, but if they are not, I’ll drop them to make room for somebody new. I’m happy to revisit that decision, and do add people back sometimes.

If someone posts too often, I may drop them because they are dominating my feed.

If someone is using Twitter mainly for self-promotion, I usually drop them for several weeks. I’ll check back in to see what they are then talking about and decide to follow them or continue to stay away.

Who will I try to get to follow me? Who will I block?

This is hit or miss. I may follow someone in the hope they will follow me, but my feelings won’t be hurt if they don’t. I could probably be more deliberate in what I say and how I say it to gain more followers, but that seems odd. Controversy always increases  the number of followers, but I need to be careful about not misrepresenting my opinions as those of my employer’s.

I block obvious spam accounts or ones that are obscene or hateful. I wouldn’t want these people talking to me in my living room, and so I don’t want them to be involved in any way in my Twitter conversations.

How much will I say in my profile about myself?

Just enough. There’s a fair amount of information about me that is pretty public at this point. My résumé is online, I’m male, you can probably guess my age with a bit of research, and it would be hard to miss that I now work for IBM. So I include enough for people to decide if they have found the right Bob Sutor, but not much more.

What kinds of status updates will I post? How often will I post?

All my blog entries have their titles and links automatically posted on Twitter. (I’ve used various WordPress plugins for this, and I recently switched to JetPack.)

I’ll post or retweet IBM announcements if they are about areas in which I now or formerly worked, if I see them. I don’t go out of my way to do this, but several of my work colleagues are very good at bringing these to my attention. If I think the topic is cool or innovative, I’ll say something.

I’ll post or retweet news items or articles if they are interesting, in the hope that if you bother to follow me, you might think them valuable as well. (If not, I know you’ll ignore them.)

I’ll say something when an idea pops into my head that I decide is funny, clever, intelligent, or profound. For such an item, however, I try to wait several minutes so that I don’t also decide that it is silly, obvious, dumb, or inane. I’ve deleted tweets that fall into the later categories if I later regret putting them up. I know they won’t really be gone, but they’ll be a bit harder to find.

When I first started using Twitter I had all my tweets posted also to Facebook. My wife (and through her, her friends) thought this was just too much. So I don’t do that anymore.

I don’t seem to hesitate tweeting about television shows I don’t like. I’ve occasionally gotten some customer service problems resolved via tweets.

When will I share content posted by others?

In Twitter-speak, this is mostly retweeting. I usually do these in batches. I might have 5 or 10 minutes here or there to scan my Twitter stream and I’ll retweet the good stuff I see.

How political, if at all, will I be in my postings?

Slightly. I try not to overdo it, though opinions probably vary about that. I’ll do more before elections that will make my US political party affiliation pretty clear. Other than that, I tend to retweet some items I’ve seen that pertain to social issues.

It’s really easy to go too far in this area. Know your company’s or organization’s policies about this.

How much will I disclose about my personal details and activities in my postings?

This is related to the profile question and response above. You don’t need to know where I am most of the time, but if it is public knowledge that I am speaking at a conference, I’ll say where I am, for example.

I don’t tell you every place I go. I’m not the mayor of anything. I may tell you where I was last week, however.

In my blog I talk about hobbies such as sailing, carpentry, and fishing. I may tweet or retweet items about that sort of thing.

On what sorts of posts by others will I comment?

I may comment on something tweeted or retweeted by someone I know. My biggest regrets about using Twitter have been stepping into conversations I really was not and should not been a part of. So I try to bite my tongue, but I fail sometimes.

I’ll tweet or retweet/comment to congratulate someone on a baby, a job, or a project. If I think I have something intelligent to add, I’ll do it. If not, I’ll just let it pass.

I try to run, not walk, from flame wars. Per the above, I may stop following people engaged in them.

What’s my policy about linking to family, friends, or co-workers?

If someone asks me not to link to them, I won’t. Nor will I disclose personal information about them. I try to ask permission before linking to anyone, especially if that person works for me. (Might not be a bad idea if I work for them either …)


Blog entries in this series:

Posted in Social Media | Tagged | Comments Off

Daily links for 02/04/2013

  • “In this article, we explain in detail how city leaders can configure automated sentiment analysis for social media sites for the topics of interest to them by using the recently released Sentiment Analysis dashboard, a part of the IBM Intelligent Operations Center. The dashboard uses IBM Cognos Consumer Insight as its underlying analysis engine. However, much of the advice in this article is equally applicable for any automated sentiment analysis tool.”

    tags: sentiment city

  • “The extra cash nets buyers a 14-inch screen and a Intel x86 chipset rather than an ARM chip inside the Samsung or Acer. All three models have 2GB of RAM. The Intel 1.1GHz Intel Celeron 847 CPU chipset inside the HP likely runs slightly better than the ARM chip. But this is a Chromebook. You run Chrome on a Chromebook. Not Photoshop. The Samsung Chromebook correctly mashes a sleek casing with a computing platform in an affordable package. The HP does not.”

    tags: chromebook hp

  • “Getting Linux to boot and install on PCs locked down with Windows 8′s UEFI (Unified Extensible Firmware Interface) Secure Boot continues to be annoying at best and downright impossible in some cases. Still, slowly, ever so slowly, progress is being made.”

    tags: linux windows

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Tagged , , | Comments Off

Social Media and the Professional: Introduction

Many people use social media services such as Twitter and Facebook extensively in their personal lives. It can be hard, however, to figure out where to draw the line between what you say there about your friends and your activities, and what you discuss concerning your work, or professional life.

In this and several follow-up blog entries, I’m going to discuss my personal rules for how I use these tools, as well as those that are more business oriented such as LinkedIn. I’m also going to talk about social media inside the enterprise and how you might approach that. An example of a product that provides social media for inside the firewall is IBM Connections.

I work for IBM, but I want to provide an important disclaimer right up front: The content on this site is my own and does not necessarily represent my employer’s positions, strategies or opinions. So what I say here is not IBM’s official position on anything.

In the same vein, how I use social media might be very different from the way you do it, and obviously that’s just fine. My purpose is to provide insight based on several years worth of experience. My rules are based on how I work and how I separate out various concerns. I say some things in some environments that I would never say in others.

I’ve learned several years ago that I handle having multiple accounts of the same kind very well. I tend to ignore all but one of them. Thus I mix everything I want to say into a single Twitter account, for example. That means you get all of me, or at least what I decide to share. It also tempers how much I might say on certain topics. I believe social media needs to show enough of who you are so that people can stay interested, or at least curious.

If your organization has guidelines for your use of social media, you must know and abide by them, and they may extend to your use of the services on your personal time. For IBM employees, the Business Conduct Guidelines spells out a lot of this.

When you use any of these services, you have some similar decisions to make:

  • Who will I follow?
  • Who will I try to get to follow me? Who will I block?
  • How much will I say in my profile about myself?
  • What kinds of status updates will I post? How often will I post?
  • When will I share content posted by others?
  • How political, if at all, will I be in my postings?
  • How much will I disclose about my personal details and activities in my postings?
  • On what sorts of posts by others will I comment?
  • What’s my policy about linking to family, friends, or co-workers?

In the next few entries I’ll consider how I use Twitter, Facebook, LinkedIn, and an enterprise social media service. I’ll look at each of the questions above, and also discuss anything specific to the type of the service. In all cases, I’ll focus on how I use the services as a business professional, and where I let my personal and work lives intersect.


Blog entries in this series: (links will become active as the entries are published)

Posted in Social Media | Tagged , , | 2 Comments

Conference: Gartner Business Intelligence & Analytics Summit

This conference is included in my list of Upcoming Events and Conferences.

“The Gartner BI & Analytics Summit is the premier business analytics event providing must-have insights, frameworks and best practices for maximizing the business impact of information management and business analytics programs.

The summit offers a new agenda structure that examines four major focus areas covering hot topics in BI platforms, analytics, visualization, social media, cloud, big data, data integration and quality, and data warehousing.”

Posted in Travel | Tagged , , , | Comments Off

Daily links for 02/02/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Tagged | Comments Off

Conference: SIGGRAPH 2013

This conference is included in my list of Upcoming Events and Conferences.

“Now in its 40th year, the SIGGRAPH conference is the premier international event on computer graphics and interactive techniques. SIGGRAPH 2013 is expected to draw more than 20,000 professionals from five continents to Anaheim, California.”

Posted in Travel | Tagged , | Comments Off

Conference: IEEE VIS 2013

This conference is included in my list of Upcoming Events and Conferences.

IEEE VIS 2013 is the premier forum for advances in scientific and information visualization. The event-packed week brings together researchers and practitioners from academia, government, and industry to explore their shared interests in tools, techniques, and technology.”

Posted in Travel | Tagged , | Comments Off

Monthly disclaimer

The postings on this site are my own and don’t necessarily represent my employer’s positions, strategies or opinions, especially if they are about the guitar, fishing, gardening, carpentry, porch building, and musical tastes.

Blog entries before 2010 are in my Archived Blog.

Posted in Website | Tagged | Comments Off

Daily links for 01/31/2013

  • “Visual analytics is the science of combining interactive visual interfaces and information visualization techniques with automatic algorithms to support analytical reasoning through human-computer interaction. People use visual analytics tools and techniques to synthesize information and derive insight from massive, dynamic, ambiguous, and often conflicting data, and to communicate their findings effectively for decision-making.”

    tags: analytics provenance

  • “Well, BlackBerry’s Hail Mary pass, its bet-the-farm phone, is finally here. It’s the BlackBerry Z10, and guess what? It’s lovely, fast and efficient, bristling with fresh, useful ideas.”

    tags: blackberry mobile

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Tagged , | Comments Off

Conference: 2013 INFORMS Conference on Business Analytics & Operations Research

This conference is included in my list of Upcoming Events and Conferences.

INFORMS Conference on Business Analytics and Operations Research shows how to “Apply Science to the Art of Business.” It features presentations on real-world applications of analytic solutions, presented by industry and university leaders.

Highlights include the Franz Edelman Competition for excellence in applied analytics and O.R. and Advanced Analytics, methodology and software tutorials, case studies in applying analytics, a premier job fair for professionals, and facilitated networking sesions.”

Posted in Travel | Tagged , | Comments Off

Daily links for 01/29/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Conference: ISSAC 2013

This conference is included in my list of Upcoming Events and Conferences.

“The International Symposium on Symbolic and Algebraic Computation is the premier conference for research in symbolic computation and computer algebra. ISSAC 2013 is the 38th meeting in the series. The conference traditionally presents a range of invited speakers, tutorials, poster sessions and software demonstrations with a centre-piece of contributed research papers.

ISSAC 2013 will be held June 26-29, 2013 at Northeastern University, Boston, Massachusetts, USA.”

Posted in Travel | Tagged , | Comments Off

Daily links for 01/26/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 01/23/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Symbolic computation in the small: Math on mobile

What are the main considerations when designing a math system or library that can do symbolic computation on mobile devices?

I’ve written several times about math apps on mobile devices but, inspired by a blog post by Ismael Ghalimi, I want to comment a bit about how one might do symbolic computation on a small, probably mobile device.

What do I mean by symbolic computation? Some examples will probably make it clear. Unlike in a spreadsheet where you are concerned primarily with manipulating floating point numbers and text (e.g., 3.4 + 2.1 = 5.5), in symbolic computation you can also compute with expressions involving variables.

So in such a system you could compute that (x + 1)2 = x2 + 2x + 1 and the derivative of the result is 2x + 2. You can easily manipulate arbitrarily large integers and fractions of such numbers. There’s probably some capability for manipulating expressions involving trigonometric and other functions. You can both express sin2(z) + cos2(z) and the system will simplify it to 1. So you can manipulate and compute with basic expressions but also use structures like lists and mathematical vectors and matrices. With these you can then do linear algebra along with single and multivariable calculus.

I’ve oversimplified here and not mentioned all capabilities of such systems, but you should have an idea of how symbolic computation differs from what you can do in a spreadsheet. The two most successful commercial systems are Mathematica and Maple. Wolfram Research also provides Wolfram Alpha which allows you to use many of the computational capabilities of Mathematica via the web and on mobile devices.

Though Maple and Mathematica share similar functionality and have very sophisticated computational and graphical features, they are implemented very differently under the covers. I was involved with creating the Axiom system at IBM Research in the 1980s and 1990s, and it was built radically differently from the other two. In particular, it was ultimately built on Lisp which provided both bignum (large integers) and garbage college for the storage used. Yet another approach is that employed by the open source Sage application which collects together various implementations under one tent.

Since you have different ways of building such systems and representing the computational objects in them, what are the considerations for using symbolic capabilities on a mobile device?

  • Space: (x + 1)2 expands to just three terms, but the expression (x + 1)200000 expands to 200,001 terms, which will take up quite a bit of space, probably well more than 1Mb. So small things can get big quickly once you start computing with them.
  • Time: Expanding the above polynomial can be done in a few seconds, but factoring it could take many minutes or hours, depending on your heuristics and algorithms. What will your mobile user be doing while he or she waits for an answer? Similarly, taking the derivative of an expression is relatively straightforward, though simplification can be time consuming. Integration can take considerably more time, if you can do it at all.
  • Formatting: These days users expect beautiful output. So while sin(x2 + 2x + 1) looks fine, older style output like sin(x^2 + 2*x + 1) is just ugly. If you are just computing with a symbolic expression as part of a larger action, you may never need to show fancily formatted math expressions. By the way, once you get very large expressions that need to span multiple lines or large two-dimensional ones, formatting becomes much harder. See TeX and LaTeX to learn about how to handle the complexity in its most general form. In practice, you’ll do something simpler.
  • Client vs. Server: How much work is done on the device versus on a big server somewhere? You can compute faster on the server, but what’s the delay in communicating back and forth with it and sending data? What do you do if you have no or limited bandwidth? Personally, I think a hybrid scheme where some things are done locally and others can be offloaded to a server probably makes the most sense, but it does complicate processing.
  • Library: Do you want this code to be wrapped up in a library that can be linked to multiple apps? If so, you need to design your interfaces very carefully. If the library will be used by different parts of the same app, make sure it is thread safe, so you don’t mess up one computation that’s going on when you request another.
  • Portability: If you could use languages like Python, Lisp, or Scheme, you would get bignums and memory management for free. If you use C++, you’ll have to do those things yourself, perhaps by using open source libraries to help you. On iOS devices, it’s perfectly fine to use Objective-C for the interface components and C++ for your computational back-end. You could also use that C++ code on an Android or Windows 8 Mobile device. I suppose you could use a subset of a Lisp interpreter written in C++ and then build your math code on top of that.
  • Legal: Apple has very specific rules about when you can download a script and run it on your iOS device. If you plan to download a file that contains a list of computations to be executed, make sure you are not running afoul of Apple’s terms and conditions.
  • Extensibility: The big systems are all designed so users can add more capabilities to them. Depending on the system, the new things might run just as fast as what is built in, or somewhat slower if the expressions are interpreted. For mobile, I think this is mostly a core developer question: How do I construct the libraries at the center of the system so that I can easily add new mathematical objects with which to compute? The basic objects are probably integers, rational numbers, floating point numbers, polynomials, rational functions, general expressions that can include trig functions and integrals, lists, vectors, and matrices. How might you later add partial differential equations? I think you need a design that allows you to build new objects, register them in the system, and then compute with them as if they were there all along. This is more computer science than math, but you’ll quickly see the value in being able to extend the system.
Posted in Mathematics | 5 Comments

Daily links for 01/10/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

New year, newish job

As of the end of December, I’ve been with IBM for 30 years. That seems like a lot, but I think you just sort of wake up one day and discover that time has gone by, you’ve been working, your career has been advancing, your kids are no longer little, and so forth. It’s not dissimilar to that strange feeling when you graduate from college and you realize that the experience you prepared for over 18 years is now over. Life is like that.

At the end of last July, I moved to my current position in IBM Research as head of the Business Analytics and Mathematical Sciences group. That’s the “newish” job in the the title; I have not moved to a completely new position in the last few days. Nevertheless, I’m not quite six months in this role, so I still feel somewhat new, though less so every day. After six months, the honeymoon (if there really was one) will be completely over. I’m very happy to be back. I’m tempted to say that this is the best job I’ve ever had.

It was a bit strange coming back to Research. I was here from 1984 to 1999 with three years out in the middle to finish up my Ph.D. program, though I was still an IBM employee during that period. I’m based at the Watson Research Center in Yorktown Heights, NY, though the Research division is really global, with 12 labs around the world. There are folks under my aegis in Switzerland, Israel, Japan, China, India, Singapore, and other countries.

The strangeness I initially felt was the immediate familiarity and perhaps deja vu: I know the layout of the building, I know where the cafeteria is,and  I know that the restrooms are in the stairwells toward the front of the building. I still get confused at times between the top and the middle floors since they look quite a bit alike. I do manage to always make it back to my office, and I just pretend that I meant to walk down aisle 31 on the wrong floor.

Even with that acceptance of what has remained the same, much else has changed. When I left in 1999, Research had nowhere near the global presence I described above. The department I lead, now called Business Analytics and Mathematical Sciences, was then just Mathematical Sciences, or, more simply Math Sciences. Analytics, though an overused and hence fuzzy term, was simply not as well known thirteen years ago.

The work I did with others on symbolic computation and semantically rich scientific publishing is no longer done in the department. We still do a tremendous amount of optimization work and algorithms, though there is much more applied probability and machine learning than there was then. We do more work directly with clients now, so we can balance the theory work with solving real problems with real datasets for customers in almost every industry you can think of.

These are some of my initial impressions of what it means to me to be back in Research for Round 2. I’ll share more as I get further into this role.

Posted in Analytics | Comments Off

Daily links for 01/08/2013

  • “In an unusual response to provisions in a new European copyright law, scheduled to take effect by 2014, Sony Music has released a compilation of early Bob Dylan recordings that is bound to become one of his most collectible albums. “The 50th Anniversary Collection,” which carries a subtitle — “The Copyright Extension Collection, Vol. 1” — that explains its purpose, was rushed to only a handful of record shops in Germany, France, Sweden and Britain just after Christmas.”

    tags: dylan sony copyright

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Analytics: Interacting systems make things tricky

Every year around holiday times, millions of people take to the roads, the skies, and the rails to visit friends and families. Sometimes everything works perfectly: the traffic isn’t too heavy, there are no accidents, schedules are met, lines are short, and the weather cooperates. In my experience, that tends to be more the exception than the rule.

If you think about our transportation systems, there are plenty of places where things can go wrong. One traffic accident on the main road to the airport can disrupt the lives of hundreds, if not thousands, of people. Why is this? What can we do about it?

When I was a teenager growing up north of New York City, I took a summer course at the Polytechnic Institute of New York in Brooklyn. This was a special class for high school science geeks (a label I wear proudly now, though maybe not so much then), that looked at simulation of traffic. For example, suppose you have a traffic light at the intersection of two streets. Your task is to determine how long the light should be red or green in each direction so that traffic moves most smoothly. That is, you would like maintain a reasonable volume of traffic flowing each way, while allowing it to move quickly and safely enough. How complicated could that be?

There are several unknowns and decisions to be made before you can start to get to an answer. How many cars approach the intersection from each direction during some fixed period of time, say, per minute? How does this vary during the day? For how long are drivers willing to wait patiently for the light to go from red to green? How many cars would you like to move through the intersection during each green light?

I didn’t say much about the intersection or the traffic light. What if one road is a one way street and the other is not? Do you want to have one or more right turn arrows? How long should those be green? If this is an existing intersection, do you have the history of accidents (quantitative) and traveler complaints (qualitative)?

By the way, will people be crossing the roads? How many do you need to account for and how long will the “walk lights” permit the crossings?

This is just one intersection! During my summer class all those years ago, we did not look at so many variations. With actual cars and drivers, you must.

With some patience, some research, and some measurement of existing conditions, you can use any one of several simulation software programs to help you model the situation, adjust the various parameters, and come up with a reasonable set of timings.

Unless you live in a town with one traffic light, things get more complicated quickly. Imagine a sequence of traffic lights as you travel down a road. I suspect you’ve heard or even said the phrase “I hit every red light on my way to work today.” That happens then the traffic is not in sync with the lights because of a change in volume (more cars), speed (perhaps an accident), or bad design (light timings that work at Noon may not be optimal for 8 AM).

If you have a light at the bottom of an exit ramp from a highway, you could have traffic backing up unsafely onto the highway if not enough traffic can get off the ramp and onto the local street fast enough. What we have here is the interaction of complex systems, and these can be very hard to model and optimize. That said, we can’t just ignore hard problems, because real people have to move through real cities every day and every hour.

Part of the work we do in the Business Analytics and Mathematical Sciences group at IBM Research tackles just such big, complex, intertwined, and sometimes just downright messy problems. We use analytics and statistics to describe what is currently going on and predict what will happen if changes are made. We use the mathematics and algorithms of optimization together with simulation to produce more optimal configurations and test our hypotheses.

If I think again about that simple intersection above, I will need to consider carefully what I’m really trying to optimize. It might be volume and speed as I said above, or it could be pollution or gasoline usage reduction. Ask the right questions and carefully determine what you are really looking to improve first, then let modern analytics and optimization techniques help you understand what steps you need to take to get to that more optimal state.

Posted in Analytics | Comments Off

Daily links for 01/07/2013

  • “But we may not realize that the way we perceive flavors and the characteristics of a “good” meal are fundamentally chemical and neural. In five years, computers will be able to construct never-before-heard-of recipes to delight palates – even those with health or dietary constraints – using foods’ molecular structure.”

    tags: ibm research taste

  • “Other approaches to online courses are emerging as well. Universities nationwide are increasing their online offerings, hoping to attract students around the world. New ventures like Udemy help individual professors put their courses online. Harvard and the Massachusetts Institute of Technology have each provided $30 million to create edX. Another Stanford spinoff, Udacity, has attracted more than a million students to its menu of massive open online courses, or MOOCs, along with $15 million in financing.

    All of this could well add up to the future of higher education — if anyone can figure out how to make money.”

    tags: muuc education online

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 01/04/2013

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 01/03/2013

  • “There can be no doubt that one of the hottest startups of the last couple of years has been social sat-nav smartphone app Waze. Not surprising in an era when – largely due to Apple initially dumping Google Maps in iOS 6 – everyone woke up, as if from some slumber, about the importance of decent mobile maps. Something many had taken for granted was thrown into sharp relief, especially when it became clear that even the mighty Apple was capable of royally screwing up its own maps product. So it comes as almost no surprise to us that there are rumours flying around that Apple is sniffing around Waze with a view to a possible acquisition. After all, Waze is already a data partner for Apple’s Maps app and was the only app to gain meaningful marketshare after the Apple Maps fail.”

    tags: apple maps waze mobile

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Monthly disclaimer

The postings on this site are my own and don’t necessarily represent my employer’s positions, strategies or opinions, especially if they are about the guitar, fishing, gardening, carpentry, porch building, and musical tastes.

Blog entries before 2010 are in my Archived Blog.

Posted in Website | Tagged | Comments Off

Daily links for 12/29/2012

  • “While on his death bed, the brilliant Indian mathematician Srinivasa Ramanujan cryptically wrote down functions he said came to him in dreams, with a hunch about how they behaved. Now 100 years later, researchers say they’ve proved he was right.”

    tags: ramanujan mathematics

  • “If you want to experiment with Linux without dual booting and potentially impacting your main operating system, the best way to do so is with virtualization. Virtualization allows you to run Linux directly atop your primary OS, whether it’s Mac OS X or Windows, in a separate virtual machine, with practically no potential for error. It’s completely free and fairly easy to set up, we’ll walk you through the entire process.”

    tags: virtualbox linux ubuntu

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 12/23/2012

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 12/20/2012

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 12/08/2012

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 12/06/2012

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 12/05/2012

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off

Daily links for 12/04/2012

Posted from Diigo. The rest of my favorite links are here.

Posted in Daily Links | Comments Off