Series

DataOps

In this series we'll be covering about the core concepts, strategies, tools and software used in DataOps field.

Articles in this series

DataOps: A Brief Introduction

Mar 4, 202310 min read

You've heard of DevOps, but have you heard of DataOps before? Let's dig in and unravel the vast world of data management. · Background The volume of data...

DataOps: Apache Spark - Basic

Mar 6, 20238 min read

Apache Spark: A big data processing API · Introduction Big data workloads are processed using Apache Spark, an open-source distributed processing engine....

DataOps: Data Build Tool (DBT)

Mar 9, 20234 min read

A technical introduction to the Data Build Tool (DBT) data management platform, its features, and its integration capabilities. · Background Three key...

DataOps: Apache Kafka - Basic

Mar 13, 20234 min read

Apache Kafka: A scalable adaptable real-time message broker. · Introduction Technically speaking, event streaming is the practice of capturing data in...

DataOps: Apache Airflow - Basic

Mar 17, 20238 min read

Apache Airflow: A powerful workflow orchestration platform · Introduction Apache Airflow is an open-source platform for authoring, scheduling, and...

DataOps: Apache Spark - Intermediate (Part 1)

Apr 28, 202323 min read

A practical approach toward learning data science with the help of PySpark. Part 1: RDDs and DataFrames. · Overview In a previous article, we covered the...

DataOps: Apache Spark - Intermediate (Part 1)