Cloud-Native Data Science: Turning Data-Oriented Business Problems Into Scalable Solutions



Abstract

The proliferation of Data Science is largely due to: ubiquitous data, increasing computational power and industry acceptance that solutions are an asset.

Data Science applications are no longer a simple dataset on a single laptop. In a recent project, we help develop a novel cloud-native machine learning service. It is unique in that problems are packaged as containers and submitted to the cloud for processing. This enables users to distribute and scale their models easily.

This talk will discuss the Data Science explosion and how that has altered the way engineers work. It will find that the boundaries between Data Science and Software Engineering are becoming even more blurred and techniques born out of Software Engineering can drastically improve many aspects of Data Science.

Through a demonstration of business-focused examples, we will follow the process of turning a business problem into a scalable solution. It will make heavy use of containers to smooth the development and productisation of a model.

This talk will be enjoyed by all and technical details will also be available for those who are interested.

More articles

LLM Architecture: RAG Implementation and Design Patterns

Discover the most common LLM architectures for retrieval augmented generation. Including pros and cons and how to choose the best RAG architecture.

Read more

Exploring Small Language Models

Learn about efficient Small Language Models (SLMs) as cost-effective, resource-saving alternative to Large Language Models (LLMs) for AI applications.

Read more
}