In the previous post, we learnt [How Git manages version control](post.html?post=git-essentials) through its internal structures. In this continuation, we will delve deeper into h
cat inside-git.md →If you have ever played a video game, you know the anxiety of facing a difficult boss. What is the first thing you do before walking through that boss door? You save your game. W
cat git-essentials.md →## Why Version Control Exists - The Pendrive Problem **Analogy: The Pendrive Problem** Let's imagine a world where version control systems like Git do not exist. Instead, develo
cat why-version-control-exists.md →In this blog, we’ll explore how to set up a complete CI/CD pipeline using `Jenkins`, `pytest`, and `Terraform` to automate unit testing and deployment for AWS Glue and Lambda jobs
cat automate-unit-tests-using-ci-cd.md →In this blog, we will go in-depth on the overall life cycle of Spark Applications from outside the actual Spark code. Before going ahead, I recommend reading the [Execution Modes]
cat spark-application-lifecycle-outside.md →In this post, we will discuss the different execution modes available in Apache Spark. Apache Spark provides three execution modes to run Spark applications: Cluster mode, Client mode, and Local mode.
cat spark-execution-modes.md →Understanding the internal execution flow of a Spark application is key to optimizing performance and debugging. This blog dives into the details of Spark jobs, stages, and tasks, providing a thorough exploration of how Spark handles distributed execution.
cat spark-job-anatomy.md →In SQL null is a special marker used to indicate that a data value does not exist in the database. A null should not be confused with a value of 0. Let's deep dive into handling nulls in Spark.
cat handling-nulls-in-spark.md →Apache Spark's Column and Expression play a big role in making your pipeline more efficient. In this blog we will look into ALL the possible ways to select columns, use built-in functions and perform calculations with column objects and expressions in PySpark.
cat columns-and-expressions.md →Welcome to my Apache Spark series! I'll dive deep into Apache Spark, from basics to advanced concepts. This series is about learning, exploring, and sharing—documenting my journey to mastering Apache Spark.
cat spark-basics.md →Welcome to my blog! This is where I'll be sharing my thoughts, experiences, and insights on technology, development, and more.
cat welcome-to-my-blog.md →