Peter Kim tspeterkim

## PandasConcatWorkaround.adoc

      
              1 file
            
          
              3 forks
            
          
              11 comments
            
          
              15 stars
            
          
                TariqAHassan
                / PandasConcatWorkaround.adoc
            
            
              Last active
              November 6, 2023 22:57
            
              
                Fast Alternative to pd.concat() for row-wise concatenation
              
          
Pandas DataFrames are fantastic. However, concatenating them using standard approaches,
such as pandas.concat(), can be very slow with large dataframes.
This is a work around for that problem.


Note: this approach assumes that:
  (a) the goal is a row-wise concatenation (i.e., axis=0) and
  (b) all dataframes share the same column names.


If these assumptions are not met, this approach could still work…but it
will likely need to be modified.

  
## pg-pong.py
""" Trains an agent with (stochastic) Policy Gradients on Pong. Uses OpenAI Gym. """
import numpy as np
import cPickle as pickle
import gym

# hyperparameters
H = 200 # number of hidden layer neurons
batch_size = 10 # every how many episodes to do a param update?
learning_rate = 1e-4
gamma = 0.99 # discount factor for reward
	""" Trains an agent with (stochastic) Policy Gradients on Pong. Uses OpenAI Gym. """
	import numpy as np
	import cPickle as pickle
	import gym

	# hyperparameters
	H = 200 # number of hidden layer neurons
	batch_size = 10 # every how many episodes to do a param update?
	learning_rate = 1e-4
	gamma = 0.99 # discount factor for reward