Data Engineering in the New Age: AI is Here, Where is Your Data?

In a recent talk at the Data Engineering Summit 2023 in Bangalore, a conference by AIM, Sunil Krishnareddy, VP & Head of Data Engineering services at Genpact, shed light on the evolving landscape of data engineering in the era of Artificial Intelligence (AI). With a career spanning 25 years, starting as a software engineer with Infosys and leading application development practices for global Hi-tech customers, Sunil has a proven track record of delivering digital transformation programs for the world’s Fortune 500 companies.

The Evolution of Data Engineering

Sunil began his talk by emphasizing the importance of data in the current age. He quoted historian Yuval Noah Harari, who suggested that in the future, the only contribution of human beings will be their own data. This statement underscores the significance of data and its potential to drive AI and machine learning advancements.

Sunil also highlighted the rapid pace of technological change, with hundreds of AI tools emerging daily. He stressed that the success of AI is largely dependent on good data engineering.

Data-Driven vs Value-Driven Organizations

One of the key topics Sunil discussed was the difference between data-driven and value-driven organizations. He explained that while technology allows organizations to access and analyze vast amounts of data, the real challenge lies in deriving value from this data.