SI Agent News
DevelopingPolicy

EU expands oversight of AI in workplace management

New regulations aim to protect workers from opaque automated decisions in hiring, firing, and daily task monitoring.

Papercut shadow box: picture for the story 'EU expands oversight of AI in workplace management'
AI-made papercut shadow box for this story. No real people or products are shown.
EUR 2.5 millionFine for lack of transparency in rider scoring

The short version

Why it matters

This marks a shift toward regulating the 'managerial prerogative,' potentially limiting how companies use data to discipline or organize staff. For workers, it provides a legal basis to challenge opaque decisions regarding pay, scheduling, and job security.

A multi-layered regulatory framework

The European Union is establishing a comprehensive set of rules to govern how artificial intelligence influences the employment relationship. This approach combines existing data protection laws with new, specific regulations designed to address the rise of automated management. These instruments aim to balance the employer's right to use technology with the fundamental rights of the workforce.

The General Data Protection Regulation (GDPR), active since 2018, serves as the foundation for these protections. It restricts how employers process personal data and grants individuals the right not to be subject to automated decisions that have 'significant' effects. While the GDPR provides a general framework, it is being bolstered by two new pieces of legislation adopted in 2024.

The Artificial Intelligence Regulation (AI Act) and the Platform Work Directive (PFD) add specific layers of oversight. The AI Act follows a product safety model, where compliance is checked before a system reaches the market. Together, these rules seek to manage the transition of digital technologies from the gig economy into the traditional labor market.

Defining high-risk AI in the workplace

The AI Act categorizes AI uses based on their level of risk to human health, safety, or fundamental rights. Systems used to carry out general employer functions are typically classified as high-risk. This classification triggers strict requirements for the companies providing these systems, including mandates for risk management, data quality, and cybersecurity.

One of the primary challenges in regulating these tools is their inherent opacity. It is often difficult to understand exactly why a specific input from an algorithm leads to a particular output. This lack of clarity creates a power imbalance, as employees may not know what data points—such as delivery speeds or the tone of a customer service call—are being used to judge their performance.

To combat this, the AI Act requires that high-risk systems be capable of being effectively overseen by natural persons. This means companies must provide appropriate human-machine interface tools. Employers must also inform workers and their representatives when they are subject to such systems, ensuring that the technology does not operate in a vacuum.

Rights to explanation and human review

The Platform Work Directive goes even further by establishing specific rights for workers whose tasks are supported by automated systems. These include the right to an explanation, the right to a human review, and the right to rectification. These protections are specifically designed to prevent 'algo-firing,' where a worker is dismissed by a robot without a clear reason.

The Court of Justice of the European Union (CJEU) has already begun to shape how these rules are interpreted. In a 2023 ruling, the court found that a decision is considered automated if a human has no qualitative impact on the outcome. This means that if a human merely 'rubber stamps' an algorithm's suggestion, the decision may still be prohibited under the GDPR if it has significant effects.

National authorities have already begun enforcing these principles. For example, the Italian data protection authority fined Foodinho and Deliveroo approximately EUR 2.5 million for systems that scored riders without sufficient transparency. Additionally, a court in Amsterdam found that Uber's human review of driver deactivations was merely symbolic, highlighting the need for meaningful human intervention.

Impact on management and monitoring

While the use of technology to organize and discipline workers has roots in historical management styles like Taylor's scientific management, modern AI adds a layer of multidimensional analysis. Algorithms can now collect and analyze granular data simultaneously, from the pace of picking goods in a warehouse to the specific words used in a call center. This evolution makes the need for regulation more urgent as these systems become standard in many industries.

The new rules also place limits on the types of data that can be used for performance assessment. Under the PFD, workers' private conversations with colleagues or representatives are protected from monitoring. Furthermore, the analysis of a worker's tone of voice cannot be used to assess their performance, providing a safeguard against overly intrusive surveillance.

The success of these regulations depends on how they are implemented in practice. There is a question of whether employers will pull back on algorithmic management to avoid heavy fines, or if the technical complexity of these systems will make it too difficult for workers to exercise their rights. The goal is to ensure that workers have actual influence rather than just rights on paper.

What to watch

Try it

Check your company's internal handbook or employee portal to see if there is a formal policy regarding the use of automated systems for performance monitoring or scheduling.

Sources and links

Liked it? Say why

Add a line for other readers.

No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.

Listen to the AI Wire headlines

Listen to the AI Wire

Listen to our daily AI shows every morning: on your commute, in the shower, wherever you are

Listen to the daily shows

First reported by OnLabor · Read the original. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.

More AI news