Write-Audit-Publish (WAP) Pattern in Data Pipelines

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More

PII Management in Data Pipelines: Architecting for Compliance, Security, and Scalability

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More

Implementing SCD Type 2 Using Spark SQL Only (No dbt)

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More

How to Use dbt_utils.surrogate_key() for SCD Type 2 in dbt

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More

What ORDER BY does in ClickHouse

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More

Understanding Conditionals in ClickHouse

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More

ClickHouse: Understanding LowCardinality vs Enum Columns

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More

Understanding the Difference Between FILTER and WHERE in Spark SQL

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More

Managed vs External Tables in Apache Spark (Delta Lake)

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More

Understanding and Implementing PageRank in Apache Spark

Posted by Sathish Kumar Srinivasan ,
Machine Learning
Read More