Data
-
BigDataFlow: Continuous Delivery of data pipelines
A new article in the Criteo DevXDays series. You can find all the articles about Developer Experience at Criteo here. Data at Criteo is a core asset and the source of reports we provide to both audiences, external and internal. We are talking about a massive amount of data daily and need a proper workflow…
-
Highlights from NeurIPS 2022
Criteo was pleased to send seven researchers to NeurIPS 2022 in the beautiful and entertaining city of New Orleans. It was the first NeurIPS in person in 3 years and was now running in hybrid mode. There were some modifications to the program, which was now a single track with keynotes, but all accepted papers…
-
Behind the scenes of the PEReN Hackathon: How our team triumphed
TL; DR The Criteo team won the PEReN Hackathon by using clustering approaches to distinguish pricing options from meal delivery data. We launched several exploratory data analysis to learn the data characteristics and extract many good features. The final solution combines a hand-made manual pricing cluster using a distance-fee correlation threshold and the Gaussian Mixture…
-
Highlights of ICML 2022
Follow us to Baltimore…. The 39th International Conference on Machine Learning (ICML) took place in Baltimore, the USA, from 17th to 23rd July. ICML is one of the most prestigious conferences in machine learning, and covers a wide range of topics in machine learning from both practical and theoretical viewpoints. As one of the largest…
-
Scheduling Data Pipelines at Criteo — Part 3
The Proven Model in Production Building a successful Platform is a quest of the good abstraction level. If you’ve missed it, check out the previous articles in this series: Scheduling Data Pipelines at Criteo — Part 2 This week we deep dive into the key ideas leveraged by BigDataFlow medium.com Scheduling Data Pipelines at Criteo — Part 1 Introducing…
-
Scheduling Data Pipelines at Criteo — Part 2
The key ideas leveraged by BigDataFlow Bringing database query planner inside Workflow Management Systems Going back to the goal we introduced in Part 1 for our data pipeline platform: Users should only write the task How does the project infer statically ? the type of inputs and outputs the DAG of tasks The first idea leveraged…
-
Using AI and NLP to Tackle Advertisement Spreading Disinformation on the Conflict in Ukraine
Disinformation* and glorification of violence in the context of the war in Ukraine At Criteo, we strive to provide rigorous Supply Partner Guidelines to create a safe and efficient advertising solution that benefits our marketers and media owners. Our guidelines state that ”sharing or propagating false information or fabricated information designed to deceptively imitate news media…
-
Scheduling Data Pipelines at Criteo — Part 1
Introducing Criteo’s BigDataFlow project Data @ Criteo Data is a core asset for Criteo as it feeds our ML engine, it is the source of the reports that we provide to our clients and it is explored internally to gain insights.Every interaction of our clients with the Criteo platform is logged and all this data is…
-
Data Science: real jobs beyond the buzz
It has been now almost 4 years since I joined Criteo and I still keep a vivid memory of my first day on the job. Hired to lead a team of 4 Data Scientists and being “given access to one of the world’s biggest datasets, and the computing power to exploit it” (as per the…