The Contextual Layer: Why AI unites marketing and data engineering teams
By Billy Loizou (pictured), APAC Area Vice President, Amperity
Customer experience has always required two things: knowing who a customer is and responding with relevant context.
For decades, Australian organisations split these responsibilities across separate functions. Marketing teams managed personalisation, loyalty programs, and channel execution. Data engineering teams handled data unification, system integration, quality control, and the pipelines that powered downstream operations.
Those functions are converging as organisations define new roles and responsibilities for the Artificial Intelligence (AI) era. Data engineering teams traditionally built customer profiles while marketing teams identified attributes and audience segments.
I want to stress that, in the marketing go-to-market context, AI has introduced the Contextual Layer, which interprets historical and real-time customer data so that it provides intelligence on sensible decisions and helps business leaders drive better outcomes.
By structuring data into contextually aware signals, this layer creates the foundation for Customer Data Intelligence. It also makes collaboration between data and marketing teams essential, because the quality of this shared context determines how effectively AI operates across the organisation.
The market has shifted but a consideration remains
Because of these newfound synergies in data and AI, personalisation no longer succeeds on channel tactics alone. Instead, it succeeds when every system and team knows the customer instantly and can act on signals the moment they appear.
Many martech vendors have already chosen a lane between marketing and data engineering. Some focus almost entirely on marketing activation and leave the harder problems of identity, real-time data, and governance to someone else. Others emphasise data infrastructure but stop short of helping teams deliver actual customer experiences.
The underlying challenge hasn’t changed. Brands can’t deliver meaningful personalisation if their data is fragmented and messy, and they can’t run a modern customer data foundation without a contextual layer that connects it directly to the moments where decisions are made and customer experiences are forged.
The gap between marketing and data engineering isn’t caused by misaligned goals. It’s the result of rising customer expectations, more complex data, new interaction modalities, and business systems that demand higher accuracy and speed than ever before.
Marketers feel this shift every day. While personalisation used to depend on segmentation and creative materials, it now hinges on recognising customers in real time, interpreting incomplete signals, and making decisions that reflect the full customer story.
None of that is possible without strong data engineering fundamentals. If customer identity is unreliable, personalisation falls apart. If data is stale or trapped in batch workflows, real-time decisioning becomes impossible. And if AI is working with partial or outdated context, it can’t produce reliable meaningful outcomes.
Capabilities like real-time profiles, event-driven journeys, and identity resolution aren’t abstract data projects. They’re the backbone of the moments that define loyalty — those precious seconds in which a customer chooses to engage or move on. Marketing teams want speed, precision, and truth, which can only be achieved when the foundation is engineered for scale, speed, and accuracy.
Data engineering demands systems that understand delivery
While marketers realise the essential role of data engineering, data teams themselves are faced with building the contextual layer by making sense of the unprecedented volume of data at their fingertips. To achieve this, engineers require AI solutions to organise and structure customer data, enabling the continuous evaluation of live behavior, journey state, and intent.
Meanwhile, engineering teams must manage orchestration, lakehouse environments, data pipelines, privacy controls, governance models, infosec guardrails, and the rollout of new and updated systems across the enterprise. They need tools that integrate cleanly with their architecture, protect data quality, and reduce manual work.
A solution that can unify data, improve quality with machine learning, and automate repetitive engineering tasks gives these teams leverage, but that leverage has to translate into outcomes. Data pipelines for their own sake aren’t the goal. Impact is the goal. Impact shows up the fastest in marketing in the form of higher match rates, more accurate predictions, and faster time from signal to insight to activation to outcome.
A platform that stops short of enabling those outcomes leaves value on the table and limits the organisation’s return on its customer data.
Customer Data Intelligence: A Unified Solution
AI has changed the equation. Its performance isn’t determined by which team owns the data, but by the context it has to work from.
This is why bridging the data-marketing gap with a contextual layer is no longer optional. The gap isn’t just about tools or capabilities. Marketing teams push for speed, experimentation, and the freedom to move quickly. Data engineering teams prioritise governance, stability, and centralised control. A contextual layer helps both sides work the way they need to. It gives marketing live, intent-rich customer understanding they can use with confidence, and it gives data teams a reliable, observable, and well-governed resource that fits their architecture without adding another pipeline to maintain.
The organisations that succeed will treat their customer data foundation as a shared system of contextual intelligence, what I call “The Customer Data Intelligence”, not a marketing tool or an engineering tool, but a platform that connects both sides of the enterprise.
The path forward for Australian organisations
The future belongs to brands that unify these functions. When strong data engineering meets real-time customer understanding, companies deliver experiences that feel both relevant and responsible.
The new architecture enables agentic decisioning loops, state-based journeys, semantic enrichment, and reasoning. When put together these can produce experiences that delight customers and drive real business outcomes.
Australian organisations that build this foundation position themselves to compete on customer experience while maintaining the data governance and operational discipline the market demands.
