Zines

Read Per Topic

Published Date
7 May 2026 12 AM
Article Title
Executing Remote Spark Dataframe Computing Using Clustered Mode Apache Spark
Short Description
Dataframe can be offloaded into different spark worker which can process huge amount of data. Spark master will act as the central resource manager to orchestrate the computation while spark worker is the job executors.
DF
Degananda Ferdian on spark
Table of Content
Topics Covered
Background
Regular pandas dataframe has limited scalability as it can only utilize single server resources. With spark cluster, the computation will be distributed on several servers.
Objectives
To execute remote spark command on spark cluster
Deliverables
Article & Illustration
About Us
Pipenpoof is techno-functional focused blog and built for sharing our roller coaster journey in software engineering industry as technical and functional role. We documented our experiences during the jobs/projects and our publications will be currated in a series.
  All content & publication which are published on this website (pipenpoof.com) are subject into writer (Article Author who wrote the post.) opinion and point of view (PoV).
None of our contents are related with our current employer (kindly check writer's linked in.) or any parties.
  • Copyright © Pipenpoof. Part of Degamedia 2024 - Present
version 0.9.1a - We Wrote 141 Articles; Across 48 Topics