Skip to content

Instantly share code, notes, and snippets.

@velotiotech
Created November 30, 2022 06:14
/usr/bin/python3.8 /home/aniketrajput/aniket_work/Spark/main.py
WARNING: An illegal reflective access operation has occurred
WARNING: Illegal reflective access by org.apache.spark.unsafe.Platform (file:/home/aniketrajput/.local/lib/python3.8/site-packages/pyspark/jars/spark-unsafe_2.12-3.2.1.jar) to constructor java.nio.DirectByteBuffer(long,int)
WARNING: Please consider reporting this to the maintainers of org.apache.spark.unsafe.Platform
WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
WARNING: All illegal access operations will be denied in a future release
:: loading settings :: url = jar:file:/home/aniketrajput/.local/lib/python3.8/site-packages/pyspark/jars/ivy-2.5.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
Ivy Default Cache set to: /home/aniketrajput/.ivy2/cache
The jars for the packages stored in: /home/aniketrajput/.ivy2/jars
org.postgresql#postgresql added as a dependency
:: resolving dependencies :: org.apache.spark#spark-submit-parent-8047b5cc-11e8-4efb-8a38-70edab0d5404;1.0
confs: [default]
found org.postgresql#postgresql;42.2.8 in central
:: resolution report :: resolve 104ms :: artifacts dl 3ms
:: modules in use:
org.postgresql#postgresql;42.2.8 from central in [default]
---------------------------------------------------------------------
| | modules || artifacts |
| conf | number| search|dwnlded|evicted|| number|dwnlded|
---------------------------------------------------------------------
| default | 1 | 0 | 0 | 0 || 1 | 0 |
---------------------------------------------------------------------
:: retrieving :: org.apache.spark#spark-submit-parent-8047b5cc-11e8-4efb-8a38-70edab0d5404
confs: [default]
0 artifacts copied, 1 already retrieved (0kB/4ms)
22/04/22 12:20:32 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
+-------------+-----------------+---------+---------+--------+-----+------+----------+
| state| district|confirmed|recovered|deceased|other|tested| date|
+-------------+-----------------+---------+---------+--------+-----+------+----------+
|Uttar Pradesh| Varanasi| 23512| 23010| 456| 0|595510|2021-02-24|
| Uttarakhand| Almora| 3259| 3081| 25| 127| 84443|2021-02-24|
| Uttarakhand| Bageshwar| 1534| 1488| 17| 26| 55626|2021-02-24|
| Uttarakhand| Chamoli| 3486| 3373| 15| 88| 90390|2021-02-24|
| Uttarakhand| Champawat| 1819| 1790| 9| 7| 95068|2021-02-24|
| Uttarakhand| Dehradun| 29619| 28152| 962| 439|401496|2021-02-24|
| Uttarakhand| Haridwar| 14137| 13697| 158| 175|369542|2021-02-24|
| Uttarakhand| Nainital| 12636| 12254| 237| 79|204422|2021-02-24|
| Uttarakhand| Pauri Garhwal| 5145| 5033| 60| 24|138878|2021-02-24|
| Uttarakhand| Pithoragarh| 3361| 3291| 47| 11| 72686|2021-02-24|
| Uttarakhand| Rudraprayag| 2270| 2251| 10| 7| 52378|2021-02-24|
| Uttarakhand| Tehri Garhwal| 4227| 4026| 16| 170|105111|2021-02-24|
| Uttarakhand|Udham Singh Nagar| 11538| 11267| 117| 123|337292|2021-02-24|
| Uttarakhand| Uttarkashi| 3789| 3645| 17| 118|120026|2021-02-24|
| West Bengal| Alipurduar| 7705| 7616| 86| 0| null|2021-02-24|
| West Bengal| Bankura| 11940| 11788| 92| 0| null|2021-02-24|
| West Bengal| Birbhum| 10035| 9876| 89| 0| null|2021-02-24|
| West Bengal| Cooch Behar| 11835| 11756| 72| 0| null|2021-02-24|
| West Bengal| Dakshin Dinajpur| 8179| 8099| 74| 0| null|2021-02-24|
| West Bengal| Darjeeling| 18423| 18155| 203| 0| null|2021-02-24|
+-------------+-----------------+---------+---------+--------+-----+------+----------+
only showing top 20 rows
Process finished with exit code 0
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment