AI-enable Personalized Predictions for Every Dane: A Scientific Breakthrough in Life Prediction Technologies

Wednesday - December 27 2023, 19:33 UTC - 11 months ago

A new AI model trained on the personal data of every person in Denmark can predict life events such as mortality as well as personality traits accurately, outperforming the current state-of-the-art technologies by 11%. Tech companies are already leveraging similar technologies to track and influence people's behavior. Society needs to be mindful of the implications and consequences that such predictive technologies may bring about.

The possibility of mapping out someone’s entire life in advance is both exciting and scary. A new artificial intelligence trained on the personal data of every person in Denmark can do just that.

Today’s deep learning-based AI systems are prediction machines. They work by ingesting vast amounts of data and using it to pick out statistical patterns that can be used to make informed guesses about previously unseen data.

Despite the uncannily fluent linguistic capabilities of AI chatbots, they operate in much the same way. They learn from huge amounts of text data and then attempt to predict what word comes next in a string of text.

What allowed the breakthrough in capabilities that we’ve seen in the last few years was a new deep learning architecture, known as a transformer, that can train on far more data than previous algorithms. It turns out that when you can train models on almost the entirety of the internet, their predictions become very sophisticated.

Now researchers have shown that they can use the same kind of techniques to train a model on a huge database of health, social, and economic information collected by the Danish government. The resulting AI was able to make highly accurate predictions about people’s lives, including how likely they are to die in a given time window and their personality traits.

"The model opens up important positive and negative perspectives to discuss and address politically," Sune Lehmann from the Technical University of Denmark, who led the study, said in a statement. "Similar technologies for predicting life events and human behavior are already used today inside tech companies that, for example, track our behavior on social networks, profile us extremely accurately, and use these profiles to predict our behavior and influence us." .

The dataset the researchers used spans from 2008 to 2020 and includes all six million Danes. It features information on their income, job, social benefits, visits to healthcare providers, and disease diagnoses, among other things.

Getting the data into a format a transformer can understand took some work though. They restructured all the information in the database into what they call "life sequences," with all the events associated with each individual organized in chronological order. This makes it possible to do next-event prediction in much the same way an AI chatbot does next-word prediction.

When trained on large numbers of these life sequences, the model can start to pick out patterns that connect disparate events in someone’s life and help it make predictions about the future. The researchers trained their model on the life sequences of people aged 25 to 70 between the years of 2008 and 2016 and then used it to make predictions about the next four years.

When they asked it to guess the likelihood of someone dying in that period, it outperformed the current state-of-the-art by 11 percent. They also got the model to make predictions about how people scored on a personality test, and the results outperformed models specifically trained for that task.

While the performance on those two tasks is impressive, in a paper descrbing their research, the researchers caution that society needs to think carefully about how to use this kind of technology.