"Google has a few months, three or four months, to comply. If it takes no action, we will enter a phase of litigation," said the head of France's CNIL data agency, which took a lead role in a European probe into the company.
It contends the move simplifies and unifies its policies across its various services such as Gmail, YouTube, Android mobile systems, social networks and Internet search.
But critics argue that the policy, which offers no ability to opt out aside from refraining from signing into Google services, gives the operator of the world's largest search engine unprecedented ability to monitor its users.
Google is already facing privacy probes by authorities across the globe as it steps up its battle with the social network site Facebook for both users and advertisers.
In a joint letter to Google made public ahead of the conference, the agencies wrote that the US firm "provides insufficient information to its users, especially on the purposes and the categories of data being processed.
"As a result, a Google user is unable to determine which categories of data are processed in the service he uses, and for which purpose these data are processed," it said.
CNIL said in a statement that after requests for more information about Google's new policy, the firm had given "several answers (that) were incomplete or approximate" and "did not provide satisfactory answers on key issues".
CNIL president Isabelle Falque-Pierrotin told reporters that "we now demand adjustments" to the policy, failing which "authorities in several countries can take action against Google".
Falque-Pierrotin added however that action would be taken on a national and not an EU level.
European states' data agencies differ widely in their investigative and enforcement powers.
The French government said in a statement that it will "soon invite Google representatives to show ... the manner in which they intend to conform with the recommendations" of CNIL.
Google, in response to CNIL's statement, insisted it was complying with EU law.
The California-based firm says the changes are designed to improve the user experience across the various Google products, and give the firm a more integrated view of its users, an advantage enjoyed by Apple and Facebook.
EU competition authorities are separately looking at whether the US firm used its search engine to boost its own services and disadvantage competitors by preferential rankings.
Explore further: 'Map spam' puts Google in awkward place