- Download spark on Downloads | Apache Spark
- Install python on Download Python | Python.org
- Run
export SPARK_HOME=/opt/sparkto set spark home folder - Extract the contents of the spark download in
$SPARK_HOME - Install pyspark:
pip install pyspark - Install
mongo-sparkdependencies with:$SPARK_HOME/bin/pyspark --packages org.mongodb.spark:mongo-spark-connector_2.11:2.4.1
- Check “Ivy Default Cache set to” output and copy the files from this folder to
$SPARK_HOME/jars - Copy the current code:
Thiago Araujo thiau
thiau
/ stress_test.json
Last active
September 5, 2025 10:59
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "data": { | |
| "edges": [ | |
| { | |
| "animated": false, | |
| "className": "", | |
| "data": { | |
| "sourceHandle": { | |
| "dataType": "WatsonxEmbeddingsComponent", | |
| "id": "WatsonxEmbeddingsComponent-9atFF", |
thiau
/ sample_langflow.json
Created
September 5, 2025 00:19
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "data": { | |
| "edges": [ | |
| { | |
| "animated": false, | |
| "className": "", | |
| "data": { | |
| "sourceHandle": { | |
| "dataType": "ChatInput", | |
| "id": "ChatInput-vnngf", |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
thiau
/ mongo_spark_python.md
Last active
September 24, 2019 18:53
Using MongoDB with Spark and Python