, , ,

Big challenges with data and Big Data

Just about everyone is talking about Big Data, and I’m not only saying that because I’m conference chair for Big Data TechCon, coming up in April in Boston.

Take Microsoft, for example. On Feb. 13, the company released survey results that talked about their big customers’ biggest data challenges, and how those relate to Big Data.

In its “Big Data Trends: 2013” study, Microsoft talked to 282 U.S. IT decision-makers who are responsible for business intelligence, and presumably, other data-related issues. To quote some findings from Microsoft’s summary of that study:

• 32% expect the amount of data they store to double in the next two to three years.

• 62% of respondents currently store at least 100 TB of data. 

• Respondents reported an average of 38% of their current data as unstructured.

• 89% already have a dedicated budget for a Big Data solution.

• 51% of companies surveyed are in the middle stages of planning a big data solution

• 13% have fully deployed a Big Data solution.

• 72% have begun the planning process but have not  yet tested or deployed a solution; of those currently planning, 76% expect to have a solution implemented in less than one year.

• 62% said developing near-real-time predictive analytics or data-mining capabilities during the next 24 months is extremely important.

• 58% rated expanding data storage infrastructure and resources as extremely important.

• 53% rated increased amounts of unstructured data to analyze as extremely important.

• Respondents expect an average of 37% growth in data during the next two to three years.

I can’t help but be delighted by the final bullet point from Microsoft’s study. “Most respondents (54 percent) listed industry conferences as one of the two most strategic and reliable sources of information on big data.”

Hope to see you at Big Data TechCon.

, , , ,

From Apple to Microsoft to Tesla, rumors abound

teslaIf there’s no news… well, let’s make some up. That’s my thought upon reading all the stories about Apple’s forthcoming iWatch – a product that, as far as anyone knows, doesn’t exist.

That hasn’t stopped everyone from Forbes to CNN to the New York Times from jumping in with breathless analysis of the rumor.

Turn the page.

More breathless analysis focused on why Microsoft’s stores and retail partners didn’t have enough stock of the Surface Pro tablet. Was this intentional, some wondered, part of a scheme to make the device appear more popular?

My friend John P. Mello Jr. had solid analysis in his article for PC World, “Microsoft Surface Pro sell-out flap: Is the tablet really that popular?”

I think the real reason is that Microsoft isn’t very good at sales estimation or manufacturing logistics. Companies like Apple and HP have dominated, in large part, because of their master of the supply chain. Despite its success with the Xbox consoles, Microsoft is a hardware newbie. I think the inventory shortfall was a screw-up, but an honest one.

After all, when Apple or Samsung run out of hot items, nobody says “It’s a trick.”

Can’t leave the conversation about rumors without mentioning the kerfuffle with the New York Times’s story, “Stalled Out on Tesla’s Electric Highway.” In short: Times columnist John M. Broder claims that the Tesla Model S electric car doesn’t live up to its claimed 265-mile estimated range. Tesla founder Elon Musk tweeted “NYTimes article about Tesla range in cold is fake.”

Everyone loves a good twitter-fight. Dozens of pundits, and gazillions of clicks, are keeping this story in the news.

, , , ,

The complications of cloud adoption

Cloud computing is seductive. Incredibly so. Reduced capital costs. No more power and cooling of a server closet or data center. High-speed Internet backbones. Outsourced disaster recovery. Advanced edge caching. Deployments are lightning fast, with capacity ramp-ups only a mouse-click away – making the cloud a panacea for Big Data applications.

Cloud computing is scary. Vendors come and vendors go. Failures happen, and they are out of your control. Software is updated, sometimes with your knowledge, sometimes not. You have to take their word for security. And the costs aren’t always lower.

An interesting new study from KPMG, “The Cloud Takes Shape,” digs into the expectations of cloud deployment – and the realities.

According to the study, cloud migration was generally a success. It showed that 33% of senior executives using the cloud said that the implementation, transition and integration costs were too high; 30% cited challenges with data loss and privacy risks; 30% were worried about the loss of control. Also, 26% were worried about the lack of visibility into future demand and associated costs, 26% fretted about the lack of interoperability standards between cloud providers; and 21% were challenged by the risk of intellectual property theft.

There’s a lot more depth in the study, and I encourage you to download and browse through it. (Given that KPMG is a big financial and tax consulting firm, there’s a lot in the report about the tax challenges and opportunities in cloud computing.)

The study concludes,

Our survey finds that the majority of organizations around the world have already begun to adopt some form of cloud (or ‘as-a-service’) technology within their enterprise, and all signs indicate that this is just the beginning; respondents expect to move more business processes to the cloud in the next 18 months, gain more budget for cloud implementation and spend less time building and defending the cloud business case to their leadership. Clearly, the business is becoming more comfortable with the benefits and associated risks that cloud brings.

With experience comes insight. It is not surprising, therefore, that the top cloud-related challenges facing business and IT leaders has evolved from concerns about security and performance capability to instead focus on some of the ‘nuts and bolts’ of cloud implementation. Tactical challenges such as higher than expected implementation costs, integration challenges and loss of control now loom large on the cloud business agenda, demonstrating that – as organizations expand their usage and gain more experience in the cloud – focus tends to turn towards implementation, operational and governance challenges.

,

You can’t analyze what you don’t capture

Big Data can sometimes mean Big Obstacles. And often those obstacles are simply that the Big Data isn’t there.

That’s what more than 1400 CIOs told Robert Half Technology, a staffing agency. According to the study, whose data was released in January, only 23% of CIOs said their companies collected customer data about demographics or buying habits. Of those that did collect this type of data, 53% of the CIOs said they had insufficient staff to access or analyze that data.

Ouch. 

The report was part of Robert Half Technology’s 2013 Salary Guide. There is a page about Big Data, which says,

When you consider that more than 2.7 billion likes and comments are generated on Facebook every day — and that 15 out of 17 U.S. business sectors have more data stored per company than the U.S. Library of Congress — it’s easy to understand why companies are seeking technology professionals who can crack the big data “code.”

Until recently, information collected and stored by companies was a mishmash waiting to be synthesized. This was because most companies didn’t have an effective way to aggregate it.

Now, more powerful and cost-effective computing solutions are allowing companies of all sizes to extract the value of their data quickly and efficiently. And when companies have the ability to tap a gold mine of knowledge locked in data warehouses, or quickly uncover relevant patterns in data coming from dynamic sources such as the Web, it helps them create more personalized online experiences for customers, develop highly targeted marketing campaigns, optimize business processes and more.

,

Menorah, sukkah, and nu, grandchildren

This is one of a series of articles I wrote for the monthly Bulletin of Peninsula Temple Sholom in Burlingame, Calif.

Sandy Silverstein is a mensch. That’s what I thought, upon meeting him via Skype in early January 2012, and in person in Westport, Connecticut, later that month. Sandy oozes professionalism, competency, and yiddishkeit, which are vital characteristics of a synagogue executive director. Sandy is also spiritual, and frequently reminds me that our decisions should always be based on Jewish values rooted in Jewish text, including the Torah and Talmud.

Sandy and his wife, Meryl, moved to our community at the end of June, and he began working at PTS on July 1. Collaborating with Sandy on a near-daily basis is one of the joys of my term as congregational president.

While Sandy has met and talked to many PTS congregants, seven months isn’t close to enough time to meet everyone. To jump-start that process, let’s find out what makes Sandy tick.

Alan: Sandy, please tell us about your family — Meryl, the boys, pets… and of course, grandchildren.

Sandy: Meryl and I have been married for 37 years. We are living in San Mateo, where Meryl is now an active volunteer at the local high school as well as at PTS. We are the parents of two wonderful sons, Stephen and Howard.

Stephen is Assistant Professor in Spanish at Baylor university in Waco, Texas, and he is engaged to Alla Aksel, who is completing her Ph.D. in electrical engineering. Alla works for Northrop Grumman, a defense contractor. The wedding will be this summer!

Howard is married to Jess. They both work for the State of New York, and make their home near Albany. They are the parents of our two adorable grandchildren, miles (almost 3 years old) and Skylar (8 months old).

Our home would not be complete without our Irish Setter, Scarlette. She is a “rescue.” All of our dogs have been rescues. meryl used to foster dogs waiting for adoption.

Alan: You are a native of St. Paul, Minnesota, who spent many years living in New England. As you settle into the Bay Area, what has surprised you about life Out West?

Sandy: When I arrived for my first day of work last July, I was firmly admonished, “Sandy, we don’t wear ties!” I learned quickly that what is considered dress-down on the East Coast is business casual on the Peninsula.

Alan: Other than our Family Shabbat dinners and Judaica Shop, where are your favorite places to hang out, shop, and eat?

Sandy: We are still exploring the Peninsula and the Bay Area. We do not hesitate going into the City with our out-of-town visitors, though the traffic is always a challenge. We have found a few favorite restaurants, like on Laurel Ave. in San Carlos, but are always up to trying new things.

We even went to Livermore for wine tasting!

Alan: When you visited our Temple for the first time, what impressed you most?

Sandy: I could not get over the beauty of the Sanctuary. Truly stunning.

Alan: You brought us a new sukkah and installed the new outdoor chanukiyah above the school entrance. Tell us about those beautiful additions.

Sandy: I bring a fresh set of eyes to look at past practices, to see what new things I can bring to my work and to the congregation. The opportunity to showcase our holidays to everyone who comes to our Temple is one of the reasons we built a new sukkah and installed the beautiful 9-foot chanukiyah on top of the school.

A congregant overheard a preschooler exclaiming to her mother in the parking lot, “Look — there are three more nights to Chanukah!?” The child had counted the unlit candles remaining. Perfect.

My background allows me to suggest such innovations. Stay tuned. There are more to come!

Alan: When you brag to your friends Back East about your new spiritual home, what do you talk about?

Sandy: You can guess — the weather! Also that PTS only does a single bar/bat mitzvah on a Saturday morning, instead of doubling them up.

Alan: As we move into the spring, what’s on top of your PTS to-do list?

Sandy: The biggest item is the annual operating budget. The budget is an expression of both our vision and values. Working with lay leaders and senior staff to create the budget is a major undertaking each year — but well worth the time and effort. The result is a wonderful year of well-attended programs, holidays, worship, learning, and community.

Alan: You like to get to know members and their families. What’s the best way for them to meet you?

Sandy: I hope people will come by and see me in the office. Free coffee, free conversation — what could be better?