Pandas to PySpark
Pandas to PySpark
Convert pandas scripts into optimized, production-ready PySpark DataFrame code with broadcast joins, partitioning, and mapping comments.
$0.02 a run3 runs, every one worked
import pandas as pd df = pd.read_csv('transactions.csv') df['category'] = df['category'].astype('category') pivot = df.pivot_table(index='user_id', columns='category',
# Single-line summary: Convert pandas pivot + merge into scalable PySpark using groupBy().pivot() and a broadcast join. from pyspark.sql import SparkSession from pyspark.sql import functions as F from pyspark.sql import types as T from pyspark.sql.functions import broadcast # Start Spark spark = SparkSession.builder.appName("pivot_transactions").getOrCreate() # ----------------------- # Read inputs (replace with real paths) # ----------------------- # pandas: df = pd.read_csv('transactions.csv') # PySpark: load with spark.read; TODO: set correct path/format/schema as needed df = ( spark.read .option("header", "true") .option("inferSchema", "true") # TODO: replace with
Cut short here. Run it to get the whole answer.
How Pandas to PySpark is set up
- OpenAI - GPT-4o mini
Run Pandas to PySpark from anywhere
Right here
Fill in the box above and the answer comes straight back. No account, no signup.
Open the run box →In your Discord server
Add the amnt bot to your server. Anyone types /run, picks Pandas to PySpark from the list, and the answer appears in the channel for everyone to see. Each person links their amnt account once with /link so their own credits pay for their own runs.
Add the bot to Discord →/run agent: pandas-to-pyspark prompt: what you wantFrom Claude, Cursor, or any MCP client
Point your MCP client at amnt with an API key and Pandas to PySpark shows up as a tool your assistant can call on its own.
How to connect →https://www.amnt.io/api/mcpFrom your own code
One HTTP call with an API key. Credits are charged per run and the result comes back in the same response.
Developer docs →curl -X POST https://www.amnt.io/api/v1/run \ -H "Authorization: Bearer amnt_sk_..." \ -H "Content-Type: application/json" \ -d '{"agent":"atomic_prairie/pandas-to-pyspark","input":{"prompt":"..."}}'
What it costs
No subscription, no minimum, no account. Pay with a card or a Hedera wallet. The creator earns 70% of every run.
Questions
- What does Pandas to PySpark do?
- Pandas to PySpark is Convert pandas scripts into optimized, production-ready PySpark DataFrame code with broadcast joins, partitioning, and mapping comments., created by @atomic_prairie. Describe what you want, pay once, and get the result in the same response.
- How much does Pandas to PySpark cost?
- $0.02 per run. You only pay when you use it - no subscription, no monthly fee, no minimum spend.
- Do I need an account to use Pandas to PySpark?
- No account and no email needed. Pay with a card or a Hedera wallet and you are ready. There is nothing to subscribe to and nothing to cancel.
- Can I call Pandas to PySpark from my own code?
- Yes. POST to /api/agent/atomic_prairie/pandas-to-pyspark with an x402 payment header and the required inputs. The result comes back in the same HTTP response - no API key, no account.
Details
How it works, proof it works, and how to call it from code
How it's performing
Three steps
- Tell it what you want
Fill in the box. No prompt-writing - the recipe is already built in.
- Pay once, per run
$0.02 a run. No subscription, no minimum, no account. You pay only when you press run.
- Get the result in the same reply
Pandas to PySpark returns your result immediately. Run it again with different inputs any time.
Use it from your own code
Pandas to PySpark is a live HTTP endpoint. POST to it with an x402 payment header and the result comes back in the same response - no API key, no account.
curl -X POST https://www.amnt.io/api/agent/atomic_prairie/pandas-to-pyspark \
-H "Content-Type: application/json" \
-H "X-Payment: <x402-payment-header>" \
-d '{ "prompt": "..." }'