Predictive algorithms are no better at telling the future than a crystal ball

  • Written by Uri Gal, Associate Professor in Business Information Systems, University of Sydney
Predictive algorithms are no better at telling the future than a crystal ball

An increasing number of businesses invest in advanced technologies that can help them forecast the future of their workforce and gain a competitive advantage.

Many analysts and professional practitioners believe that, with enough data, algorithms embedded in People Analytics (PA) applications can predict all aspects of employee behavior: from productivity, to engagement, to interactions and emotional states.

Read more: Digital public: looking at what algorithms actually do

Predictive analytics powered by algorithms are designed to help managers make decisions that favourably impact the bottom line. The global market for this technology is expected to grow from US$3.9 billion in 2016 to US$14.9 billion by 2023.

Despite the promise, predictive algorithms are as mythical as the crystal ball of ancient times.

Predictive models are based on flawed reasoning

One of the fundamental flaws of predictive algorithms is their reliance on “inductive reasoning”. This is when we draw conclusions based on our knowledge of a small sample, and assume that those conclusions apply across the board.

For example, a manager might observe that all of her employees with an MBA are highly motivated. She therefore concludes that all workers with an MBA are highly motivated.

This conclusion is flawed because it assumes that past patterns will remain consistent. This assumption itself can only be true because of our experience to date, which confirms this consistency. In other words, inductive reasoning can only be inductively justified: it works because it has worked before. Therefore, there is no logical reason to assume that the next person our company hires who has an MBA degree will be highly motivated.

Read more: How marketers use algorithms to (try to) read your mind

Assumptions like these can be coded into hiring algorithms, which, in this case, would assign a weighting to all job applicants with an MBA degree. But when inductive reasoning is baked into the code of hiring applications, it can lead to unfounded decisions, adversely impact on the bottom-line, and even discriminate against certain groups of people.

For example, a tool used in some parts of the United States to assess whether a person arrested for a crime would re-offend was found to unfairly discriminate against African Americans.

They lead to self-fulfilling prophecies

Another flaw in the predictions thrown up by algorithmic analysis is their propensity to create self-fulfilling prophecies. Acting on algorithmic predictions, managers can create the conditions that ultimately realise those very predictions.

For example, a company may use an algorithm to predict the performance of its recently-hired salespeople. Such an algorithm might draw on data from standardised tests completed during their onboarding process, reviews from previous employers, and demographics. This analysis can then be used to rank new salespeople and justify the allocation of more training resources to those believed to have greater performance potential.

This is likely to produce the very results that the initial analysis predicted. The higher-ranked recruits will perform better than those ranked lower on the list because they have been given superior training opportunities.

Read more: What businesses can learn from sports about using algorithms

Calculating probabilities of future events is meaningless

Some practitioners recognise the flaws in the predictive capability of algorithmic systems, but they still see value in generating models that indicate probability.

Rather than predicting the occurrence of future events or states, probabilistic models can indicate the degree of certainty that events or situations might occur in the future.

However, here too it pays to be a little sceptical. When a model calculates that an event is likely to happen it does so as a percentage of 100% certainty. Any probabilistic prediction is only possible in relation to the possibility of complete certainty. But since complete certainty is impossible to predict, probabilistic models are of no real significance either.

Algorithms don’t ‘predict’, they ‘extrapolate’

So if they cannot predict organisational events with complete or even probable certainty, what can predictive algorithms do?

To answer this, we must understand how they work. Once developed and inscribed with their base code, predictive algorithms need to be “trained” to hone their predictive power. This is done by feeding them with past organisational data. They then search for trends in the data and extrapolate rules that can be applied to future data.

For example, workforce planning algorithms can identify employees who are likely to resign. They do this by analysing the personality and behavioural patterns of employees who have resigned in the past and cross-referencing the results with the profiles of existing employees to identify those with the highest matching scores. With each round of application, the algorithm is continually adjusted to correct ever-decreasing prediction errors.

Read more: Why marking essays by algorithm risks rewarding the writing of 'bullshit'

However, the term “prediction error” is misleading because these algorithms do not predict, but rather extrapolate. All that predictive algorithms can ever do is guess at what is going to happen based on what has already happened. The leap required to make actual predictions is not a matter of computing power, but rather of bending the laws of physics.

Predictive models can’t anticipate change

Because they are extrapolative, predictive models are rather good at identifying regularities, continuity and routine. However, the human brain is also designed to identify stable patterns. Competent managers should be well aware of their organisation’s operations, and capable of envisioning steady patterns over time.

What managers find difficult to predict is change. Unfortunately, predictive models are also poor predictors of change. The more radical change is – different from existing patterns – the more poorly predicted it will be.

To manage effectively and develop their knowledge of current and likely organisational events, managers need to learn to build and trust their instinctual awareness of emerging processes rather than rely on algorithmic promises that cannot be realised. The key to effective decision-making is not algorithmic calculations but intuition.

Authors: Uri Gal, Associate Professor in Business Information Systems, University of Sydney

Read more http://theconversation.com/predictive-algorithms-are-no-better-at-telling-the-future-than-a-crystal-ball-91329

Australia Today

Strengthening ties between Australia and the USA

Malcolm Turnbull

The alliance between Australia and the United States has been broadened and deepened by my visit to Washington D.C.   In a reflection of the ongoing importance of the relationship, I held a successful meeting with President Donald J. Trump in the Oval Office at the White House.   Our fourth me...

Read more

Cochlear Implant Day this Sunday

Scott Tucker

 GIVING THE GIFT OF SOUND TO INDONESIANS     Minister for Trade and Industry, Niall Blair this week met with cochlear implant recip...

Read more

Nick Xenophon announces energy co-op to lower SA power bills

Erin Clare

An exciting plan to lower power prices using the co-operative model of community electricity trusts has been announced by SA BEST leader Nick Xenophon.   “The co-operative model has an internationally proven track record for delivering services,” said Business Council of Cooperatives and Mutuals...

Read more

Jodie & Soda rallied the community to make Alex the 'best firefighter ever'

Tina Liptai

  Adelaide has a new pint-size hero after Mix 102.3's Jodie & Soda rallied the community to make Alex the 'best firefighter ever'     ...

Read more

Barnaby Joyce: the story of an unlikely rise and a self-inflicted fall

Michelle Grattan, Professorial Fellow, University of Canberra

Joyce's departure to the backbench obviously brings immediate relief for the government and the Nationals. What it will mean beyond that is more difficult to predict.AAP/Marlon DaltonIn the end, the tough man crumpled. For a fortnight Barnaby Joyce had resembled someone out in the snow who’d b...

Read more

Top 10 Deadliest Building Fires in Australia

Geordie Killen

A few months from now, we're going to celebrate Fire Prevention Week and one of the best ways to understand the dangers of fire is to remember worst fire incidents in Australia. By reading the harrowing stories of these fire disasters, people will be more aware of how dangerous fires can be. It wi...

Read more

Arming teachers will only make US school shootings worse

Rick Sarre, Adjunct Professor of Law and Criminal Justice, University of South Australia

US President Donald Trump talks to high school students about safety on campus following the shooting deaths of 17 people at a Florida school.Reuters/Jonathan ErnstOn February 14, in Parkland, Florida, 17 teachers and students were shot dead at their school by an estranged student armed with a high-...

Read more

Holidays & Travel

Places That Will Make You Want to Visit Indonesia This Year

Royalty, culture and history coalesce in Yogyakarta     Seasoned travellers wanting more than boutique shopping, hip bars and cutting edge restaurants are invited to try a new Indonesian island or include one...

STA Travel: MASSIVE THREE DAY NEW ZEALAND SALE

NEW ZEALAND FLASH SALE!!!!    For the next THREE DAYS ONLY, STA Travel is having massive flight and Campervan hire sales for New Zealand!!    Fly one way for $129, and RETURN FOR $275!! Campervans start from $47 a day!    If...

MANTRA HOTELS LAUNCHES BIGGEST EVER GLOBAL SALE

Mantra Hotels is set to launch its biggest ever Global Sale with massive savings on more than 130 Mantra, Peppers, BreakFree and Art Series Hotels, booked between 13 - 21...

Bangkok's Winter Festival "Love and Warmth at Winter's End"

His Majesty King Maha Vajiralongkorn Bodindradebayavarangkun has graciously initiated the organisation of a winter festival under the theme 'Un Ai Rak Khlai Khwam Nao' (Love and Warmth at Winter's End)...

Give Your Valentine a Villa in Mykonos

Need a Last-Minute Valentine’s Day Gift?  For $66 Give Your Valentine a Villa in MykonosThis Valentine’s Day, if you are still debating on a meaningful gift for your loved one...

The Nam Hai Launches AntiGravityYoga and Unveils New Serenity Structure

Hoi An, Vietnam – Four Seasons Resort The Nam Hai, Hoi An is elevating its wellbeing offering with a new yoga pavilion and introduction of AntiGravity® Yoga, a dynamic 'flying' yoga...

Rydges South Bank rolls out the MAGIC CARPET to welcome Aladdin to Brisbane!

Rydges South Bank is rolling out their very own magic carpet to welcome the blockbuster stage show Disney’s Aladdin – The Musical to Brisbane, announcing an exclusive stay, taste and...

New cellar doors across Tasmania

New Cellar Door at Clover Hill Drawing inspiration from the form of a clover leaf, the new Clover Hill cellar door ( sits on the edge of the valley...

Club Med helps Aussies hack their holidays

This month, Club Med is helping Australians make the most of their annual leave and save more on the holidays of their dreams, by offering their best price all year...

Fashion & Beauty

The Most Stylish Women of All Time and How to Be Like Them

The mark of style is uniqueness. It’s not just in following the trends; it’s in being creative enough to set new ones in place. It’s about natural allure that draws...

Australian size-inclusive activewear label Active Truth

Mums and daughters #twinning in new activewear range that encourages healthy body image in women and girls Mums and daughters #twinning in new activewear range that encourages healthy body image im...

Bras N Things Heat Up The Night campaign

Inspired by hot summer nights and dazzling neon city lights, Bras N Things’ new Heat Up The Night campaign showcases stunning fashion lingerie, decadent embroidered lace and bold caging details.   Featuring...

Fashion Moment Holiday: Restyle Your Wardrobe and Enjoy Exclusive Shopping Privileges at Four Seasons

Adjacent to the prestigious IFC mall, Four Seasons Hotel Hong Kong has always been the venue of choice for the glam and glitterati to flaunt their fashion statements. Housing five...

Staying Fashionable on the Beach this Summer

Whether you’re travelling alone, with your partner for the first time or on a relaxing trip with your whole family or friend group, looking great while you’re on the beach...

Santamaria Shirt Makers

Traditional shirt-making for the modern era How the second generation of a traditional shirt maker is transforming the family business for the digital age From Madrid to London and now the world...

HEALTH

Cinzia Cozzolinos shares her 7 Day Feb-Fast Detox

Nutritionist and Founder of Nutrition Darling and Smoothie Bombs shares her 7 Day Feb-Fast Detox.  Cinzia Cozzolinos Tips are below and her 7 Day Plant Based Eating Plan is...

Malcolm Turnbull - Ground-breaking flu vaccines to protect millions of Aussies

The Turnbull Government will provide two new ground-breaking flu vaccines to over three million Australians aged 65 years and over - free of charge. This is a direct response to last...

Alcovit

Here we go a "new hangover cure", sure thing whatever.   Alcovit Australia states from the start it is NOT a Hangover Cure, it is NOT something that allows you to drink...

"Career mums" vs "home makers"

Mums today are adjusted into many different scenarios; whether you have a stay at home business, working only a couple of days a week whilst your children are with carers...

Seasonal health retreat in a box

A seasonal reminder to slow down can help manage anxiety and stress in Australian women. It’s back to work and back to the daily grind. Well-being expert, Holistic Nutritionist and Personal...

Surviving A Divorce

Breakups are tough at the best of times. When you’ve been married for some time, have a family, and find that your relationship has broken down beyond repair, the process...

LIFE STYLE

Get green with your gardening needs

Do you consider yourself a particularly green-fingered gardener who has a real love and passion for flowers and other shrubbery? If your answer to this questions is yes, then you...

5 Most Common Household Emergencies and How to Fix Them

If you have a large and old house, there’s a pretty big chance that there are going to be some emergencies every now and then. It’s important to maintain the...

How to Life Plan with Your Children’s Future in Mind

For most people, a big part of their life plan involves kids. Children are one of life’s great joys, but also one of life’s great financial burdens. The good news...

8 Easy Tips for Keeping Your Home Healthy and Clean

Although we see our homes as our safe havens, they aren’t actually as safe as we may think. In fact, there are probably numerous hidden toxins and allergens that we...

Cleaning Tips for Your Living Space in Australia

We all know that cleaning our home is extremely important; however, it seems that not all Aussies take this seriously and make some crucial mistakes when it comes to the...

Sydney Bayside Home Retreat for any family

Amid the leafy based greenery of The Sydney Suburb Putney resides a timeless new feature home setting to the modern 2018 family unit. The conjunction of bayside living, ambiance, tranquility...

FOOD & DINING

Tips for Drinking Wine around the World

Compromises are for relationships, not wine. – Sir Robert Scott Caywood Do you know how eating food from all over the world is in fact a unique way of traveling around...

Introducing Champagne lovers to, Emperor, Australia’s home of Champagne

Every bottle of Champagne ordered from Emperor is beautifully packaged in custom Emperor gift boxes or wrapping paper. Emperor houses the most extensive collection of champagne in Australia.   Kyla says:...

Hot Stuff: the strategically engineered reusable coffee cup combating Australia¹s landfill epidemic

As Australia’s caffeine addiction continues to soar, environmentalists warn that disposable coffee cups are fast on their way to becoming a major pollution hazard. According to the ABC (2016), coffee cups...

Get saucy this Valentine's Day with Lillie's Q

Whether you’re spending Valentine’s Day with a special partner or celebrating love with your friends, why not treat them (and yourself) to something a little different this year. Get your taste...

Winter Food and Wellness a Winning Combination for Aussies Travelling to Japan

Increased flight options, striking natural scenery, fascinating culture, world-famous onsens and delicious food: there are many reasons why the Australian love affair with Japan seems to be a never ending...

Move over avocado toast. This millennial has created healthy bake mixes

Back to work and school healthy snacks made with real ingredients. 29 year old Genevieve Le Hunt grabbed a gap in the baking mix market. Genevieve created Bake Mixes, organic, vegan...